Results for igt@xe_exec_system_allocator@threads-many-stride-new-prefetch

Result: Abort 360 Warning(s)

i915_display_info20 igt_runner20 results20.json results20-xe-load.json guc_logs20.tar i915_display_info_post_exec20 serial_data20 boot20 dmesg20

DetailValue
Duration unknown
Hostname
shard-bmg-3
Igt-Version
IGT-Version: 2.4-g3cb6109b3 (x86_64) (Linux: 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ x86_64)
Out
Using IGT_SRANDOM=1779301278 for randomisation
Opened device: /dev/dri/card0
Starting subtest: threads-many-stride-new-prefetch
[thread:2259] Stack trace:
[thread:2257] Stack trace:
[thread:2259]   #0 ../lib/igt_core.c:2074 __igt_fail_assert()
[thread:2257]   #0 ../lib/igt_core.c:2074 __igt_fail_assert()
[thread:2257]   #1 [xe_wait_ufence+0x57]
[thread:2258] Stack trace:
[thread:2259]   #1 [xe_exec+0x48]
[thread:2257]   #2 ../tests/intel/xe_exec_system_allocator.c:1789 test_exec()
[thread:2257]   #3 ../tests/intel/xe_exec_system_allocator.c:2082 thread()
[thread:2259]   #2 ../tests/intel/xe_exec_system_allocator.c:1767 test_exec()
[thread:2259]   #3 ../tests/intel/xe_exec_system_allocator.c:2082 thread()
[thread:2258]   #0 ../lib/igt_core.c:2074 __igt_fail_assert()
[thread:2258]   #1 [xe_wait_ufence+0x57]
[thread:2257]   #4 [pthread_condattr_setpshared+0x684]
[thread:2259]   #4 [pthread_condattr_setpshared+0x684]
[thread:2258]   #2 ../tests/intel/xe_exec_system_allocator.c:1789 test_exec()
[thread:2258]   #3 ../tests/intel/xe_exec_system_allocator.c:2082 thread()
[thread:2259]   #5 [__clone+0x24c]
[thread:2257]   #5 [__clone+0x24c]
[thread:2258]   #4 [pthread_condattr_setpshared+0x684]
[thread:2258]   #5 [__clone+0x24c]
[thread:2261] Stack trace:
[thread:2261]   #0 ../lib/igt_core.c:2074 __igt_fail_assert()
[thread:2261]   #1 [xe_wait_ufence+0x57]
[thread:2261]   #2 ../tests/intel/xe_exec_system_allocator.c:1789 test_exec()
[thread:2261]   #3 ../tests/intel/xe_exec_system_allocator.c:2082 thread()
[thread:2261]   #4 [pthread_condattr_setpshared+0x684]
[thread:2261]   #5 [__clone+0x24c]
[thread:2260] Stack trace:
[thread:2260]   #0 ../lib/igt_core.c:2074 __igt_fail_assert()
[thread:2260]   #1 [xe_wait_ufence+0x57]
[thread:2260]   #2 ../tests/intel/xe_exec_system_allocator.c:1789 test_exec()
[thread:2260]   #3 ../tests/intel/xe_exec_system_allocator.c:2082 thread()
[thread:2260]   #4 [pthread_condattr_setpshared+0x684]
[thread:2260]   #5 [__clone+0x24c]
[thread:2263] Stack trace:
[thread:2263]   #0 ../lib/igt_core.c:2074 __igt_fail_assert()
[thread:2263]   #1 [xe_wait_ufence+0x57]
[thread:2263]   #2 ../tests/intel/xe_exec_system_allocator.c:1789 test_exec()
[thread:2263]   #3 ../tests/intel/xe_exec_system_allocator.c:2082 thread()
[thread:2263]   #4 [pthread_condattr_setpshared+0x684]
[thread:2263]   #5 [__clone+0x24c]
runner: This test was killed due to a kernel taint (0x244).

This test caused an abort condition: Kernel badly tainted (0x244, 0x200) (check dmesg for details):
	TAINT_WARN: WARN_ON has happened.
Err
Starting subtest: threads-many-stride-new-prefetch
[59.521401] (xe_exec_system_allocator:2255) [thread:2259] xe/xe_ioctl-CRITICAL: Test assertion failure function xe_exec, file ../lib/xe/xe_ioctl.c:652:
[59.521425] (xe_exec_system_allocator:2255) [thread:2259] xe/xe_ioctl-CRITICAL: Failed assertion: __xe_exec(fd, exec) == 0
[59.521434] (xe_exec_system_allocator:2255) [thread:2259] xe/xe_ioctl-CRITICAL: error: -125 != 0
[59.538186] (xe_exec_system_allocator:2255) [thread:2257] xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:763:
[59.538207] (xe_exec_system_allocator:2255) [thread:2257] xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0
[59.538221] (xe_exec_system_allocator:2255) [thread:2257] xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error
[59.538231] (xe_exec_system_allocator:2255) [thread:2257] xe/xe_ioctl-CRITICAL: error: -5 != 0
[59.769675] (xe_exec_system_allocator:2255) [thread:2258] xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:763:
[59.769689] (xe_exec_system_allocator:2255) [thread:2258] xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0
[59.769699] (xe_exec_system_allocator:2255) [thread:2258] xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error
[59.769707] (xe_exec_system_allocator:2255) [thread:2258] xe/xe_ioctl-CRITICAL: error: -5 != 0
[60.732608] (xe_exec_system_allocator:2255) [thread:2261] xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:763:
[60.732690] (xe_exec_system_allocator:2255) [thread:2261] xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0
[60.732729] (xe_exec_system_allocator:2255) [thread:2261] xe/xe_ioctl-CRITICAL: Last errno: 62, Timer expired
[60.732768] (xe_exec_system_allocator:2255) [thread:2261] xe/xe_ioctl-CRITICAL: error: -62 != 0
Received signal SIGSEGV.
Stack trace: 
[61.809276] (xe_exec_system_allocator:2255) [thread:2260] xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:763:
[61.809390] (xe_exec_system_allocator:2255) [thread:2260] xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0
[61.809447] (xe_exec_system_allocator:2255) [thread:2260] xe/xe_ioctl-CRITICAL: Last errno: 62, Timer expired
[61.809495] (xe_exec_system_allocator:2255) [thread:2260] xe/xe_ioctl-CRITICAL: error: -62 != 0
[62.824750] (xe_exec_system_allocator:2255) [thread:2263] xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:763:
[62.824873] (xe_exec_system_allocator:2255) [thread:2263] xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0
[62.824942] (xe_exec_system_allocator:2255) [thread:2263] xe/xe_ioctl-CRITICAL: Last errno: 62, Timer expired
[62.825003] (xe_exec_system_allocator:2255) [thread:2263] xe/xe_ioctl-CRITICAL: error: -62 != 0
Received signal SIGQUIT.
Stack trace: 
 #0 [fatal_sig_handler+0x17b]
 #1 [__sigaction+0x50]
 #2 [__nptl_death_event+0x17f]
 #3 [pthread_join+0x173]
 #4 [threads.constprop.0+0x29f]
 #5 [__igt_unique____real_main2385+0x2f31]
 #6 [main+0x2d]
 #7 [__libc_init_first+0x8a]
 #8 [__libc_start_main+0x8b]
 #9 [_start+0x25]
Dmesg

<6> [54.277914] Console: switching to colour dummy device 80x25
<6> [54.278067] [IGT] xe_exec_system_allocator: executing
<7> [54.383920] xe 0000:03:00.0: [drm:drm_pagemap_dev_unhold_work [drm_gpusvm_helper]] Releasing reference on provider device and module.
<6> [54.384571] [IGT] xe_exec_system_allocator: starting subtest threads-many-stride-new-prefetch
<7> [54.401763] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.401768] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.404690] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.404692] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.404700] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.406122] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.406318] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.407082] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.407084] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.408269] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.408632] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.408704] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.408872] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.409701] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.410261] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.410336] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.410444] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.410452] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.411795] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.411902] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.411913] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.411948] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.413950] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.413969] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.413993] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.414030] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.414930] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.415509] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.415586] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.415655] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.415666] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.416801] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.416849] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.418549] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.418859] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.418883] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.418905] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.419088] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.419142] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.419197] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.419408] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.419462] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.419617] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.420778] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.420911] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.421664] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.421781] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.421781] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.422035] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.422376] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.422495] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.422691] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.423246] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.423385] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Raced while finalizing migration.
<7> [54.424068] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.424068] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.424088] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.428022] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.429124] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.429155] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.429160] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.430860] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.430875] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.430884] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.431319] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.431334] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.431440] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.431440] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.432227] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.432317] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.432458] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.433264] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.433324] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 11.
<7> [54.433329] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.433330] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Migration aborted due to fragmentation.
<7> [54.433546] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.434628] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.434635] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.434601] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.434727] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.434826] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.440399] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.441381] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.441611] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.441646] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.442711] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.442781] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.442871] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.442911] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.443085] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.443468] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.443600] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.444042] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.444547] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.444695] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.445271] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.446520] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.446633] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.447468] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.447614] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.447633] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.447673] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.448102] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.448403] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.449282] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.449917] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.451778] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.451800] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.452283] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.452298] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.453176] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 23.
<7> [54.453182] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Migration aborted due to fragmentation.
<7> [54.456311] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.457877] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.460774] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.460958] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.460970] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.461005] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.461372] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Raced while finalizing migration.
<7> [54.462724] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.462849] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.462947] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.466624] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.468242] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.468261] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.468369] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.470509] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.470797] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.470817] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.470870] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.471016] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.472441] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.472837] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.473031] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.474608] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.474717] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.474723] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.477039] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.477048] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.480522] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.481389] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.481524] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.481571] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.481661] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.483669] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.483794] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.483795] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.483794] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.483882] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.483942] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.485121] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.485139] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.485162] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.485270] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.485270] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.485940] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.485946] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.486435] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.486492] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.486495] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.487057] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.487074] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.487205] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.487646] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.489079] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.490148] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.490157] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.490226] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.491618] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.491633] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.491712] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.491715] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.492130] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.492220] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.492568] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.492961] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.493062] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.493878] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.493975] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.494312] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.495722] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.496765] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.496780] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.496867] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.497529] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.497691] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.497731] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.497764] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.498750] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.498953] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.499052] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.499400] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.500008] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.502472] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.502481] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.502959] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.504729] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.505673] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.506783] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.506919] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.509463] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 11.
<7> [54.509476] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Migration aborted due to fragmentation.
<7> [54.509536] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.511298] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.511305] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.515162] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.516149] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.517536] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.518955] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.519416] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 200.
<7> [54.519424] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Migration aborted due to fragmentation.
<7> [54.519557] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.519586] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.525182] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.526359] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 16.
<7> [54.526362] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.526369] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Migration wasn't necessary.
<7> [54.526723] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.528078] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.528354] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.528714] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Raced while finalizing migration.
<7> [54.528840] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.528919] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.529087] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.529894] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.530171] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.532379] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.533281] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.533405] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.533410] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.533561] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.535575] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.535540] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.535718] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.535715] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.535869] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.535905] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.535871] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.536042] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.536039] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.536369] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.536761] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.537361] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.537627] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.539786] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.539828] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.539867] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.540400] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.540811] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.542044] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.542907] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.543018] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.543137] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.543137] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.543139] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.543199] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.543924] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.544046] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.544061] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.545449] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.545898] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.546601] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.547095] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.547118] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.547219] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.550446] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.551614] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.551758] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 16.
<7> [54.551765] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Migration wasn't necessary.
<7> [54.551804] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.555533] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.555545] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.555560] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.556217] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.556307] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.556341] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.556360] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.556380] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.557321] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.557618] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.557976] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.558826] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.558842] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.558916] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.559068] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.559081] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.559091] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.559083] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.559179] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.559278] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.559278] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.559394] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.559481] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.559571] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.559666] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.559665] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.559810] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.559815] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.559807] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.559890] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.559985] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.559984] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.560487] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.560603] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.560864] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.560948] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.561061] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.561042] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.561173] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.561196] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.561212] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.561909] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.561990] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.562077] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.562203] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.562241] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.562243] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.562262] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.562231] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.562695] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.562695] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.563113] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.563383] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.563414] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.563698] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.563883] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.564453] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 178.
<7> [54.564457] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Migration aborted due to fragmentation.
<7> [54.568098] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.573009] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.574014] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.574038] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.574105] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.574904] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.576428] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.576542] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.577458] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.577790] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.577794] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.577836] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.577884] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.577921] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.578088] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.578708] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.578792] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.578813] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.578875] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.580048] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.580054] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.580061] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.580115] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.580542] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.580543] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.581449] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.581473] xe 0000:03:00.0: [drm:xe_vm_bind_ioctl [xe]] Get pages failed, asid=5, gpusvm=ffff888112ce9190, errno=-EOPNOTSUPP
<7> [54.581660] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.581779] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.581779] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.581869] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.582322] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.582323] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.582651] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.582820] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.582884] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.583623] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.584060] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.584249] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.585134] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.585190] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.585211] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.585229] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.586112] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.586133] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.586360] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.586424] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.586541] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.586811] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.587066] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.587197] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.587225] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.587276] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.587290] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.587351] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.587707] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.587739] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.587853] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.588048] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.588084] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.588300] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.588301] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.588387] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.588690] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.589845] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.590167] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.591123] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.591282] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.591284] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.591284] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.591277] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.591913] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 264.
<7> [54.591919] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Migration aborted due to fragmentation.
<7> [54.591994] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.592772] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.593102] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.595594] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.596133] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.596280] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.600043] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.601156] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.601160] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.601715] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 1.
<7> [54.601723] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.601727] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Migration wasn't necessary.
<7> [54.602238] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.602579] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.602724] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.602765] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.602792] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.602754] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.602824] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.602939] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.602931] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.603093] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.603090] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.603190] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.603192] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.603280] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.603394] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.603553] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.603730] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.603721] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.603842] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.603866] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.603863] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.603881] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.604362] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.604362] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.604527] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.604548] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.604579] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.604582] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.605280] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.605413] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.605453] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.605467] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.605512] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.605742] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.605846] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.606205] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.606435] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.607109] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.607437] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.607480] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.607481] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.607789] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.607979] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.608051] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.609049] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.609150] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.609246] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.609317] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 23.
<7> [54.609324] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Migration aborted due to fragmentation.
<7> [54.609334] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.609416] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.609499] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.612668] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.614081] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.614152] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.614358] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.615208] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.615210] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.615268] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.615346] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.615478] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.615498] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.616261] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.616355] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.616358] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.616588] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.617218] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.618472] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.618841] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.619989] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.620009] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.620020] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.623662] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.623913] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 29.
<7> [54.623923] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Migration aborted due to fragmentation.
<7> [54.624012] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 11.
<7> [54.624023] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Migration aborted due to fragmentation.
<7> [54.624197] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.625622] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.629832] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.633607] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.634911] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.636169] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.637234] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.637374] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.637386] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.637412] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.637369] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.637428] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.638992] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.639154] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.640778] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.640797] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.642230] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.642244] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.643179] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.643318] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.643319] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.643443] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.643560] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.644725] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.644981] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.645445] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.645986] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Raced while finalizing migration.
<7> [54.648372] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.649399] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.650468] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.651313] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.651353] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.651448] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Raced while finalizing migration.
<7> [54.652017] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.652238] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.654122] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.655219] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.656540] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.656542] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 24.
<7> [54.656550] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Migration aborted due to fragmentation.
<7> [54.657138] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.657182] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.658492] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.658953] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.659947] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.659952] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.663405] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.664566] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.664572] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 16.
<7> [54.664579] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Migration wasn't necessary.
<7> [54.664633] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.665322] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.665493] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.665496] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.665595] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.665596] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.665565] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.665749] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.665866] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.666679] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.666798] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.666874] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.667129] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.667849] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.667919] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.668101] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.668101] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.669478] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.670021] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.670310] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.670433] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.670727] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.671314] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.671417] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.671419] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.671581] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.672217] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.672402] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.672356] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.672489] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.672619] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.672746] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.672848] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.672950] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.673039] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.673123] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.673208] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.673290] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.673382] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.673385] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.674454] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.674669] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.678567] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.679525] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.683020] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.684006] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 16.
<7> [54.684012] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Migration wasn't necessary.
<7> [54.684118] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.684119] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.685147] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.685132] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.685260] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.685257] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.685349] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.685364] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.685366] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.686117] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.686356] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.686494] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.686622] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.686748] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.687696] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.687846] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.688089] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.688113] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.688110] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.688280] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.691037] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.692503] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.692540] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 23.
<7> [54.692546] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Migration aborted due to fragmentation.
<7> [54.692625] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.692732] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.693367] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.694949] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.697695] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.699230] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.699286] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.700481] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.700514] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.700674] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.700693] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.700712] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.700747] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.700937] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.701051] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.701051] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.701416] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.701407] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.701647] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.701798] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.701959] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.701962] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.702668] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.702809] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 130.
<7> [54.702815] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Migration aborted due to fragmentation.
<7> [54.702912] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.704233] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.704505] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.704442] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.704515] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.704540] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.704590] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.704736] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.704882] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.705037] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.705185] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.705331] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.705476] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.705621] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.705766] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.706001] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.709901] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.711035] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.711065] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 16.
<7> [54.711079] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Migration wasn't necessary.
<7> [54.712179] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.712188] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.712252] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 5.
<7> [54.712263] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Migration aborted due to fragmentation.
<7> [54.713960] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.714384] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.714414] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.715308] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.715408] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.715495] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.715472] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.721082] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.722073] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.722355] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.723505] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.723629] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.723630] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.723697] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.723707] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.723751] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.723924] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.724053] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.724137] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.724742] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.724755] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.724847] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.725740] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.726792] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.727110] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.728113] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.728164] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.728206] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 12.
<7> [54.728212] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Migration aborted due to fragmentation.
<7> [54.728184] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.728310] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.728408] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.728499] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.728589] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.728676] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.728761] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.728848] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.728934] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [54.729182] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.729523] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [54.729643] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.730491] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.734382] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [54.735557] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.735636] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [54.735847] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 1.
<7> [54.735859] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Migration wasn't necessary.
<6> [54.736706] xe 0000:03:00.0: [drm] Tile0: GT0:
ASID: 0
Faulted Address: 0x000000000060b000
FaultType: 0
AccessType: 1
FaultLevel: 0
EngineClass: 3 bcs
EngineInstance: 8
<6> [54.736716] xe 0000:03:00.0: [drm] Tile0: GT0: Fault response: Unsuccessful -EINVAL
<6> [54.737278] xe 0000:03:00.0: [drm] Tile0: GT0: Engine memory CAT error [18]: class=bcs, logical_mask: 0x2, guc_id=0
<7> [54.737889] xe 0000:03:00.0: [drm:xe_hw_engine_snapshot_capture [xe]] Tile0: GT0: Proceeding with manual engine snapshot
<7> [54.738048] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 68.
<7> [54.738058] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Migration aborted due to fragmentation.
<6> [54.738611] xe 0000:03:00.0: [drm] Tile0: GT0: Engine reset: engine_class=bcs, logical_mask: 0x2, guc_id=0, state=0x249
<5> [54.738871] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1298, lrc_seqno=1298, guc_id=0, flags=0x73 in no process [-1]
<6> [54.932747] xe 0000:03:00.0: [drm] Xe device coredump has been created
<6> [54.932765] xe 0000:03:00.0: [drm] Check your /sys/class/drm/card0/device/devcoredump/data
<4> [54.932769] ------------[ cut here ]------------
<4> [54.932770] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [54.932772] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:2/121
<4> [54.932877] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [54.932966]
<4> [54.932969] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [54.932972] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER
<4> [54.932973] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [54.932975] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [54.932981] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [54.933056] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [54.933058] RSP: 0000:ffffc90000563ca0 EFLAGS: 00010246
<4> [54.933060] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [54.933062] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [54.933063] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000
<4> [54.933064] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [54.933065] R13: ffff888104ddc410 R14: ffff88810b3ae800 R15: 00000000fffffffb
<4> [54.933066] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000
<4> [54.933068] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [54.933069] CR2: 000079d511ce9000 CR3: 000000000344a002 CR4: 0000000000f72ef0
<4> [54.933070] PKRU: 55555554
<4> [54.933072] Call Trace:
<4> [54.933073] <TASK>
<4> [54.933076] ? lock_acquire+0xb0/0x300
<4> [54.933083] ? __pfx_autoremove_wake_function+0x10/0x10
<4> [54.933087] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [54.933093] process_one_work+0x239/0x740
<4> [54.933099] worker_thread+0x200/0x3f0
<4> [54.933102] ? __pfx_worker_thread+0x10/0x10
<4> [54.933104] kthread+0x10d/0x150
<4> [54.933107] ? __pfx_kthread+0x10/0x10
<4> [54.933109] ret_from_fork+0x3bd/0x470
<4> [54.933112] ? __pfx_kthread+0x10/0x10
<4> [54.933114] ret_from_fork_asm+0x1a/0x30
<4> [54.933122] </TASK>
<4> [54.933123] irq event stamp: 56197
<4> [54.933124] hardirqs last enabled at (56203): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [54.933126] hardirqs last disabled at (56208): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [54.933128] softirqs last enabled at (55242): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [54.933131] softirqs last disabled at (55221): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [54.933134] ---[ end trace 0000000000000000 ]---
<6> [54.933136] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [54.933683] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [54.934281] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [54.934887] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [54.935290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [54.935422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [54.935523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [54.935606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [54.935686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [54.935763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [54.935840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [54.935918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [54.935991] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [54.936087] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [54.936172] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [54.937199] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [54.946764] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [54.947200] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [54.948783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [54.948872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [54.948952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [54.949033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [54.949110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [54.949186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [54.949261] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [54.949336] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [54.949411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [54.949484] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [54.949557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [54.949628] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [54.949709] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [54.949780] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [54.949853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [54.949927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [54.950000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [54.950073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [54.950143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [54.950223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [54.950302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [54.950380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [54.950460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [54.950537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [54.950613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [54.950702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [54.950782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [54.950856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [54.950928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [54.951002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [54.951076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [54.951151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [54.951226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [54.951304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [54.951387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [54.951468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [54.951549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [54.951627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [54.951704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [54.951776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [54.951847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [54.951918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [54.951989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [54.952060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [54.952132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [54.952204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [54.952277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [54.952349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [54.952421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [54.952494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [54.952569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [54.952651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [54.952726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [54.952803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [54.952874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [54.952946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [54.953018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [54.953086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [54.953156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [54.953230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [54.953302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [54.953372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [54.953443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [54.953515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [54.953598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [54.953678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [54.953757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [54.953830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [54.953902] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [54.954543] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [54.954552] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1298, lrc_seqno=1298, guc_id=0, flags=0x73 in no process [-1]
<7> [54.954556] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [54.954657] ------------[ cut here ]------------
<4> [54.954659] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [54.954661] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:2/121
<4> [54.954967] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [54.955087]
<4> [54.955092] CPU: 9 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [54.955098] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [54.955100] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [54.955104] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [54.955124] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [54.955465] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [54.955469] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246
<4> [54.955473] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [54.955475] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [54.955477] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000
<4> [54.955479] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [54.955481] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [54.955483] FS: 0000000000000000(0000) GS:ffff8888db103000(0000) knlGS:0000000000000000
<4> [54.955485] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [54.955496] CR2: 000079d50afa3000 CR3: 000000000344a001 CR4: 0000000000f72ef0
<4> [54.955498] PKRU: 55555554
<4> [54.955500] Call Trace:
<4> [54.955502] <TASK>
<4> [54.955508] ? lock_acquire+0xb0/0x300
<4> [54.955517] ? lock_release+0xd0/0x2b0
<4> [54.955525] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [54.955533] process_one_work+0x239/0x740
<4> [54.955544] worker_thread+0x200/0x3f0
<4> [54.955549] ? __pfx_worker_thread+0x10/0x10
<4> [54.955553] kthread+0x10d/0x150
<4> [54.955556] ? __pfx_kthread+0x10/0x10
<4> [54.955561] ret_from_fork+0x3bd/0x470
<4> [54.955565] ? __pfx_kthread+0x10/0x10
<4> [54.955570] ret_from_fork_asm+0x1a/0x30
<4> [54.955583] </TASK>
<4> [54.955585] irq event stamp: 59555
<4> [54.955587] hardirqs last enabled at (59561): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [54.955590] hardirqs last disabled at (59566): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [54.955593] softirqs last enabled at (59454): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [54.955597] softirqs last disabled at (59449): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [54.955601] ---[ end trace 0000000000000000 ]---
<6> [54.955604] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [54.955943] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [54.955954] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [54.956332] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [54.956439] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [54.956586] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [54.956808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [54.956895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [54.956983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [54.957064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [54.957144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [54.957222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [54.957300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [54.957384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [54.957475] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [54.957571] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [54.957662] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [54.958690] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [54.969101] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [54.969355] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [54.970427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [54.970509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [54.970590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [54.970671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [54.970747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [54.970823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [54.970898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [54.970970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [54.971050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [54.971124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [54.971198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [54.971272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [54.971344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [54.971417] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [54.971490] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [54.971562] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [54.971635] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [54.971707] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [54.971783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [54.971867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [54.971950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [54.972039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [54.972117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [54.972196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [54.972274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [54.972349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [54.972425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [54.972502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [54.972576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [54.972652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [54.972729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [54.972805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [54.972880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [54.972955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [54.973049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [54.973133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [54.973217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [54.973295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [54.973370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [54.973444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [54.973517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [54.973588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [54.973661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [54.973735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [54.973811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [54.973885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [54.973965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [54.974039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [54.974111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [54.974186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [54.974261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [54.974332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [54.974404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [54.974475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [54.974547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [54.974619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [54.974690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [54.974761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [54.974831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [54.974906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [54.974992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [54.975068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [54.975142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [54.975214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [54.975288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [54.975362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [54.975432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [54.975502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [54.975576] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [54.975706] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [54.975745] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1298, lrc_seqno=1298, guc_id=0, flags=0x73 in no process [-1]
<7> [54.975752] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [54.976363] ------------[ cut here ]------------
<4> [54.976365] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [54.976367] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:9/992
<4> [54.976490] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [54.976569]
<4> [54.976572] CPU: 4 UID: 0 PID: 992 Comm: kworker/u64:9 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [54.976576] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [54.976577] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [54.976579] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [54.976585] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [54.976663] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [54.976665] RSP: 0018:ffffc90003203ca0 EFLAGS: 00010246
<4> [54.976667] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [54.976668] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [54.976670] RBP: ffffc90003203db0 R08: 0000000000000000 R09: 0000000000000000
<4> [54.976671] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [54.976672] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [54.976673] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000
<4> [54.976675] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [54.976676] CR2: 0000732e9c060068 CR3: 000000012441f003 CR4: 0000000000f72ef0
<4> [54.976678] PKRU: 55555554
<4> [54.976679] Call Trace:
<4> [54.976680] <TASK>
<4> [54.976684] ? lock_acquire+0xb0/0x300
<4> [54.976690] ? lock_release+0xd0/0x2b0
<4> [54.976695] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [54.976701] process_one_work+0x239/0x740
<4> [54.976708] worker_thread+0x200/0x3f0
<4> [54.976711] ? __pfx_worker_thread+0x10/0x10
<4> [54.976714] kthread+0x10d/0x150
<4> [54.976716] ? __pfx_kthread+0x10/0x10
<4> [54.976719] ret_from_fork+0x3bd/0x470
<4> [54.976722] ? __pfx_kthread+0x10/0x10
<4> [54.976725] ret_from_fork_asm+0x1a/0x30
<4> [54.976733] </TASK>
<4> [54.976734] irq event stamp: 545951
<4> [54.976735] hardirqs last enabled at (545957): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [54.976738] hardirqs last disabled at (545962): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [54.976740] softirqs last enabled at (545186): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [54.976743] softirqs last disabled at (545177): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [54.976746] ---[ end trace 0000000000000000 ]---
<7> [54.976714] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [54.976817] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [54.977065] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<5> [54.977210] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1301, lrc_seqno=1301, guc_id=0, flags=0x73 in no process [-1]
<7> [54.977214] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [54.977284] ------------[ cut here ]------------
<4> [54.977285] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [54.977286] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:9/992
<4> [54.977362] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [54.977430]
<4> [54.977432] CPU: 4 UID: 0 PID: 992 Comm: kworker/u64:9 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [54.977435] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [54.977436] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [54.977438] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [54.977443] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [54.977516] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [54.977517] RSP: 0018:ffffc90003203ca0 EFLAGS: 00010246
<4> [54.977520] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [54.977521] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [54.977522] RBP: ffffc90003203db0 R08: 0000000000000000 R09: 0000000000000000
<4> [54.977523] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [54.977525] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [54.977526] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000
<4> [54.977527] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [54.977529] CR2: 0000732e9c060068 CR3: 000000012441f003 CR4: 0000000000f72ef0
<4> [54.977530] PKRU: 55555554
<4> [54.977531] Call Trace:
<4> [54.977532] <TASK>
<4> [54.977536] ? lock_acquire+0xb0/0x300
<4> [54.977542] ? lock_release+0xd0/0x2b0
<4> [54.977547] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [54.977552] process_one_work+0x239/0x740
<4> [54.977559] worker_thread+0x200/0x3f0
<4> [54.977563] ? __pfx_worker_thread+0x10/0x10
<4> [54.977565] kthread+0x10d/0x150
<4> [54.977568] ? __pfx_kthread+0x10/0x10
<4> [54.977570] ret_from_fork+0x3bd/0x470
<4> [54.977573] ? __pfx_kthread+0x10/0x10
<4> [54.977576] ret_from_fork_asm+0x1a/0x30
<4> [54.977584] </TASK>
<4> [54.977585] irq event stamp: 546893
<4> [54.977586] hardirqs last enabled at (546899): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [54.977588] hardirqs last disabled at (546904): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [54.977590] softirqs last enabled at (546030): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [54.977593] softirqs last disabled at (546017): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [54.977596] ---[ end trace 0000000000000000 ]---
<6> [54.977597] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [54.977669] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [54.977680] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [54.978095] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [54.978314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [54.978408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [54.978505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [54.978597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [54.978685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [54.978769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [54.978867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [54.978955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [54.979037] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [54.979137] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [54.979229] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [54.980266] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [54.990455] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [54.990708] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [54.991766] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [54.991851] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [54.991929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [54.992004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [54.992080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [54.992154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [54.992227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [54.992301] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [54.992373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [54.992460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [54.992532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [54.992603] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [54.992675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [54.992748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [54.992820] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [54.992894] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [54.992968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [54.993042] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [54.993118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [54.993200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [54.993281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [54.993366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [54.993443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [54.993521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [54.993600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [54.993677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [54.993750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [54.993823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [54.993897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [54.993975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [54.994053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [54.994128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [54.994205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [54.994281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [54.994375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [54.994458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [54.994540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [54.994619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [54.994696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [54.994771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [54.994846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [54.994920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [54.994995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [54.995069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [54.995145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [54.995220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [54.995293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [54.995383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [54.995459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [54.995533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [54.995609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [54.995682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [54.995757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [54.995830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [54.995903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [54.995976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [54.996049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [54.996121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [54.996192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [54.996270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [54.996359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [54.996434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [54.996508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [54.996580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [54.996654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [54.996728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [54.996799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [54.996871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [54.996948] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [54.997214] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [54.997219] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1301, lrc_seqno=1301, guc_id=0, flags=0x73 in no process [-1]
<7> [54.997222] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [54.997443] ------------[ cut here ]------------
<4> [54.997444] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [54.997445] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:9/992
<4> [54.997526] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [54.997591]
<4> [54.997593] CPU: 4 UID: 0 PID: 992 Comm: kworker/u64:9 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [54.997596] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [54.997597] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [54.997599] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [54.997604] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [54.997678] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [54.997680] RSP: 0018:ffffc90003203ca0 EFLAGS: 00010246
<4> [54.997682] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [54.997683] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [54.997685] RBP: ffffc90003203db0 R08: 0000000000000000 R09: 0000000000000000
<4> [54.997686] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [54.997687] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [54.997688] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000
<4> [54.997690] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [54.997691] CR2: 0000732e9c060068 CR3: 000000012441f003 CR4: 0000000000f72ef0
<4> [54.997693] PKRU: 55555554
<4> [54.997694] Call Trace:
<4> [54.997695] <TASK>
<4> [54.997699] ? lock_acquire+0xb0/0x300
<4> [54.997704] ? lock_release+0xd0/0x2b0
<4> [54.997709] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [54.997714] process_one_work+0x239/0x740
<4> [54.997721] worker_thread+0x200/0x3f0
<4> [54.997724] ? __pfx_worker_thread+0x10/0x10
<4> [54.997727] kthread+0x10d/0x150
<4> [54.997729] ? __pfx_kthread+0x10/0x10
<4> [54.997732] ret_from_fork+0x3bd/0x470
<4> [54.997734] ? __pfx_kthread+0x10/0x10
<4> [54.997737] ret_from_fork_asm+0x1a/0x30
<4> [54.997744] </TASK>
<4> [54.997745] irq event stamp: 550265
<4> [54.997747] hardirqs last enabled at (550271): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [54.997749] hardirqs last disabled at (550276): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [54.997751] softirqs last enabled at (549212): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [54.997753] softirqs last disabled at (549205): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [54.997756] ---[ end trace 0000000000000000 ]---
<6> [54.997758] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [54.997829] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [54.997837] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [54.999141] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [54.999261] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [54.999373] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [54.999661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [54.999809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [54.999957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.000098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.000248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.000388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.000528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.000670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.000807] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.000957] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.001103] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.002601] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.012786] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.013042] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.014079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.014163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.014242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.014320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.014397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.014476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.014553] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.014629] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.014704] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.014794] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.014871] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.014946] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.015022] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.015095] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.015168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.015241] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.015313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.015384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.015455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.015539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.015619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.015702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.015780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.015859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.015935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.016008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.016082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.016155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.016228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.016305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.016381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.016456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.016531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.016606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.016690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.016770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.016851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.016928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.017003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.017076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.017153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.017227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.017300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.017375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.017450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.017525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.017599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.017685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.017756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.017830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.017906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.017978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.018052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.018124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.018196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.018269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.018343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.018417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.018489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.018564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.018645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.018718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.018791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.018862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.018934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.019007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.019077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.019146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.019219] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.019384] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.019388] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1301, lrc_seqno=1301, guc_id=0, flags=0x73 in no process [-1]
<7> [55.019391] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.019456] ------------[ cut here ]------------
<4> [55.019457] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.019458] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:9/992
<4> [55.019533] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.019756]
<4> [55.019758] CPU: 8 UID: 0 PID: 992 Comm: kworker/u64:9 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.019761] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.019762] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.019764] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.019770] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.019842] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.019844] RSP: 0018:ffffc90003203ca0 EFLAGS: 00010246
<4> [55.019846] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.019848] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.019849] RBP: ffffc90003203db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.019850] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.019852] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.019853] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000
<4> [55.019854] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.019856] CR2: 000079d508de0000 CR3: 000000012441f001 CR4: 0000000000f72ef0
<4> [55.019857] PKRU: 55555554
<4> [55.019858] Call Trace:
<4> [55.019859] <TASK>
<4> [55.019863] ? lock_acquire+0xb0/0x300
<4> [55.019869] ? lock_release+0xd0/0x2b0
<4> [55.019873] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.019879] process_one_work+0x239/0x740
<4> [55.019886] worker_thread+0x200/0x3f0
<4> [55.019889] ? __pfx_worker_thread+0x10/0x10
<4> [55.019892] kthread+0x10d/0x150
<4> [55.019894] ? __pfx_kthread+0x10/0x10
<4> [55.019897] ret_from_fork+0x3bd/0x470
<4> [55.019900] ? __pfx_kthread+0x10/0x10
<4> [55.019902] ret_from_fork_asm+0x1a/0x30
<4> [55.019910] </TASK>
<4> [55.019911] irq event stamp: 553663
<4> [55.019912] hardirqs last enabled at (553669): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.019915] hardirqs last disabled at (553674): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.019916] softirqs last enabled at (552696): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.019919] softirqs last disabled at (552689): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.019922] ---[ end trace 0000000000000000 ]---
<7> [55.020989] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [55.021282] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.021389] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [55.021445] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1303, lrc_seqno=1303, guc_id=0, flags=0x73 in no process [-1]
<7> [55.021451] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.021582] ------------[ cut here ]------------
<4> [55.021584] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.021587] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#12: kworker/u64:9/992
<4> [55.021713] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.021808]
<4> [55.021811] CPU: 12 UID: 0 PID: 992 Comm: kworker/u64:9 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.021815] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.021817] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.021819] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.021827] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.021947] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.021949] RSP: 0000:ffffc90003203ca0 EFLAGS: 00010246
<4> [55.021953] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.021955] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.021957] RBP: ffffc90003203db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.021958] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.021960] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.021962] FS: 0000000000000000(0000) GS:ffff8888db283000(0000) knlGS:0000000000000000
<4> [55.021964] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.021966] CR2: 00005dbbac6bbd08 CR3: 000000012441f005 CR4: 0000000000f72ef0
<4> [55.021968] PKRU: 55555554
<4> [55.021970] Call Trace:
<4> [55.021971] <TASK>
<4> [55.021978] ? lock_acquire+0xb0/0x300
<4> [55.021986] ? lock_release+0xd0/0x2b0
<4> [55.021993] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.022003] process_one_work+0x239/0x740
<4> [55.022014] worker_thread+0x200/0x3f0
<4> [55.022018] ? __pfx_worker_thread+0x10/0x10
<4> [55.022022] kthread+0x10d/0x150
<4> [55.022025] ? __pfx_kthread+0x10/0x10
<4> [55.022029] ret_from_fork+0x3bd/0x470
<4> [55.022032] ? __pfx_kthread+0x10/0x10
<4> [55.022037] ret_from_fork_asm+0x1a/0x30
<4> [55.022049] </TASK>
<4> [55.022051] irq event stamp: 554585
<4> [55.022052] hardirqs last enabled at (554591): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.022056] hardirqs last disabled at (554596): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.022058] softirqs last enabled at (553824): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.022062] softirqs last disabled at (553819): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.022065] ---[ end trace 0000000000000000 ]---
<6> [55.022068] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.022189] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.022201] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.022620] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.022908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.023058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.023208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.023353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.023502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.023655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.023763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.023861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.023948] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.024048] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.024141] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.025183] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.035124] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.035378] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.036718] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.036808] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.036891] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.036972] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.037048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.037148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.037228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.037316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.037392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.037467] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.037542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.037616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.037690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.037763] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.037838] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.037914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.037987] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.038082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.038155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.038239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.038322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.038403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.038481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.038558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.038634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.038708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.038782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.038855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.038928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.039009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.039089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.039164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.039238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.039313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.039392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.039473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.039555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.039634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.039713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.039787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.039859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.039931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.040016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.040093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.040167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.040240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.040314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.040385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.040455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.040527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.040602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.040677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.040754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.040971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.041047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.041121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.041195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.041266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.041339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.041413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.041488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.041559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.041632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.041704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.041777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.041848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.041921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.041993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.042066] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.042227] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.042232] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1303, lrc_seqno=1303, guc_id=0, flags=0x73 in no process [-1]
<7> [55.042235] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.042299] ------------[ cut here ]------------
<4> [55.042301] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.042302] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:5/204
<4> [55.042377] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.042442]
<4> [55.042444] CPU: 1 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.042447] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.042449] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.042450] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.042455] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.042527] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.042528] RSP: 0000:ffffc90001627ca0 EFLAGS: 00010246
<4> [55.042531] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.042532] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.042533] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.042535] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.042536] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.042537] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000
<4> [55.042539] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.042540] CR2: 000079d50a1ec000 CR3: 0000000123785002 CR4: 0000000000f72ef0
<4> [55.042542] PKRU: 55555554
<4> [55.042543] Call Trace:
<4> [55.042544] <TASK>
<4> [55.042548] ? lock_acquire+0xb0/0x300
<4> [55.042553] ? lock_release+0xd0/0x2b0
<4> [55.042558] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.042564] process_one_work+0x239/0x740
<4> [55.042571] worker_thread+0x200/0x3f0
<4> [55.042574] ? __pfx_worker_thread+0x10/0x10
<4> [55.042577] kthread+0x10d/0x150
<4> [55.042579] ? __pfx_kthread+0x10/0x10
<4> [55.042582] ret_from_fork+0x3bd/0x470
<4> [55.042584] ? __pfx_kthread+0x10/0x10
<4> [55.042587] ret_from_fork_asm+0x1a/0x30
<4> [55.042594] </TASK>
<4> [55.042595] irq event stamp: 81847
<4> [55.042596] hardirqs last enabled at (81853): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.042599] hardirqs last disabled at (81858): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.042600] softirqs last enabled at (80920): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.042603] softirqs last disabled at (80913): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.042606] ---[ end trace 0000000000000000 ]---
<6> [55.042608] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.042683] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.042689] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.043973] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.044090] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.044197] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.044427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.044528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.044626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.044720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.044809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.044908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.044994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.045079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.045160] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.045260] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.045352] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.046388] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.056528] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.056789] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.057830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.057915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.057996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.058077] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.058157] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.058233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.058307] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.058379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.058450] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.058541] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.058615] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.058689] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.058761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.058833] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.058903] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.058973] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.059045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.059114] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.059186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.059270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.059350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.059429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.059519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.059596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.059671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.059746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.059819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.059894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.059968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.060043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.060119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.060192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.060265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.060340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.060426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.060507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.060588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.060667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.060746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.060819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.060892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.060963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.061035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.061108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.061181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.061254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.061327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.061410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.061481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.061554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.061628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.061699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.061771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.061844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.061917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.061990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.062062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.062132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.062202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.062276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.062348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.062431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.062503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.062575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.062648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.062720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.062790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.062860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.062934] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.063070] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.063074] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1303, lrc_seqno=1303, guc_id=0, flags=0x73 in no process [-1]
<7> [55.063076] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.063141] ------------[ cut here ]------------
<4> [55.063142] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.063143] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:5/204
<4> [55.063217] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.063282]
<4> [55.063284] CPU: 8 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.063287] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.063288] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.063289] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.063294] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.063376] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.063378] RSP: 0018:ffffc90001627ca0 EFLAGS: 00010246
<4> [55.063380] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.063382] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.063383] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.063385] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.063386] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.063388] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000
<4> [55.063389] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.063391] CR2: 000079d508de0000 CR3: 000000012441f001 CR4: 0000000000f72ef0
<4> [55.063392] PKRU: 55555554
<4> [55.063394] Call Trace:
<4> [55.063395] <TASK>
<4> [55.063399] ? lock_acquire+0xb0/0x300
<4> [55.063404] ? lock_release+0xd0/0x2b0
<4> [55.063408] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.063414] process_one_work+0x239/0x740
<4> [55.063421] worker_thread+0x200/0x3f0
<4> [55.063424] ? __pfx_worker_thread+0x10/0x10
<4> [55.063427] kthread+0x10d/0x150
<4> [55.063429] ? __pfx_kthread+0x10/0x10
<4> [55.063432] ret_from_fork+0x3bd/0x470
<4> [55.063434] ? __pfx_kthread+0x10/0x10
<4> [55.063437] ret_from_fork_asm+0x1a/0x30
<4> [55.063444] </TASK>
<4> [55.063445] irq event stamp: 85275
<4> [55.063446] hardirqs last enabled at (85281): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.063449] hardirqs last disabled at (85286): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.063450] softirqs last enabled at (84316): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.063453] softirqs last disabled at (84309): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.063456] ---[ end trace 0000000000000000 ]---
<7> [55.064038] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [55.064074] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [55.064103] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [55.064132] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<5> [55.064346] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1305, lrc_seqno=1305, guc_id=0, flags=0x73 in no process [-1]
<7> [55.064353] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.064529] ------------[ cut here ]------------
<4> [55.064530] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.064533] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#15: kworker/u64:5/204
<4> [55.064660] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.064757]
<4> [55.064761] CPU: 15 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.064765] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.064766] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.064768] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.064777] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<7> [55.064860] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [55.064835] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<4> [55.064898] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.064900] RSP: 0018:ffffc90001627ca0 EFLAGS: 00010246
<4> [55.064903] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.064905] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.064906] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.064908] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.064909] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.064911] FS: 0000000000000000(0000) GS:ffff8888db403000(0000) knlGS:0000000000000000
<4> [55.064913] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.064914] CR2: 00005dbbac42c42c CR3: 000000000344a004 CR4: 0000000000f72ef0
<4> [55.064916] PKRU: 55555554
<4> [55.064917] Call Trace:
<4> [55.064919] <TASK>
<4> [55.064925] ? lock_acquire+0xb0/0x300
<4> [55.064932] ? lock_release+0xd0/0x2b0
<4> [55.064940] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.064950] process_one_work+0x239/0x740
<4> [55.064960] worker_thread+0x200/0x3f0
<4> [55.064965] ? __pfx_worker_thread+0x10/0x10
<4> [55.064969] kthread+0x10d/0x150
<4> [55.064972] ? __pfx_kthread+0x10/0x10
<4> [55.064976] ret_from_fork+0x3bd/0x470
<4> [55.064979] ? __pfx_kthread+0x10/0x10
<4> [55.064983] ret_from_fork_asm+0x1a/0x30
<7> [55.064946] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<4> [55.064996] </TASK>
<4> [55.064997] irq event stamp: 86203
<4> [55.064998] hardirqs last enabled at (86209): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.065001] hardirqs last disabled at (86214): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.065003] softirqs last enabled at (85398): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.065007] softirqs last disabled at (85391): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.065010] ---[ end trace 0000000000000000 ]---
<6> [55.065012] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.065133] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.065147] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.065227] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.065507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.065600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.065695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.065786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.065874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.065958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.066040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.066125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.066204] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.066306] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.066395] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.067428] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.076994] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.077245] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.078212] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.078293] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.078372] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.078448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.078522] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.078595] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.078670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.078743] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.078815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.078886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.078964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.079035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.079109] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.079183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.079257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.079330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.079404] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.079477] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.079550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.079632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.079713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.079793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.079872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.079962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.080042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.080119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.080192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.080266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.080339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.080414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.080491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.080566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.080641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.080715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.080796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.080876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.080973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.081054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.081133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.081209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.081287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.081362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.081438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.081515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.081593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.081670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.081746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.081822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.081902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.081976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.082052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.082126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.082199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.082271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.082343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.082414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.082485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.082555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.082626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.082698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.082768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.082842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.082913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.082983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.083055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.083128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.083197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.083271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.083347] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.083514] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.083518] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1305, lrc_seqno=1305, guc_id=0, flags=0x73 in no process [-1]
<7> [55.083521] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.083586] ------------[ cut here ]------------
<4> [55.083587] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.083588] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:5/204
<4> [55.083664] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.083729]
<4> [55.083731] CPU: 8 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.083734] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.083735] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.083736] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.083742] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.083828] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.083830] RSP: 0018:ffffc90001627ca0 EFLAGS: 00010246
<4> [55.083832] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.083834] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.083835] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.083837] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.083838] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.083840] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000
<4> [55.083841] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.083843] CR2: 000079d508de0000 CR3: 000000012441f001 CR4: 0000000000f72ef0
<4> [55.083844] PKRU: 55555554
<4> [55.083846] Call Trace:
<4> [55.083847] <TASK>
<4> [55.083850] ? lock_acquire+0xb0/0x300
<4> [55.083856] ? lock_release+0xd0/0x2b0
<4> [55.083861] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.083867] process_one_work+0x239/0x740
<4> [55.083874] worker_thread+0x200/0x3f0
<4> [55.083877] ? __pfx_worker_thread+0x10/0x10
<4> [55.083879] kthread+0x10d/0x150
<4> [55.083881] ? __pfx_kthread+0x10/0x10
<4> [55.083885] ret_from_fork+0x3bd/0x470
<4> [55.083887] ? __pfx_kthread+0x10/0x10
<4> [55.083890] ret_from_fork_asm+0x1a/0x30
<4> [55.083898] </TASK>
<4> [55.083899] irq event stamp: 89573
<4> [55.083900] hardirqs last enabled at (89579): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.083902] hardirqs last disabled at (89584): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.083904] softirqs last enabled at (88438): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.083907] softirqs last disabled at (88429): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.083910] ---[ end trace 0000000000000000 ]---
<6> [55.084807] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.084903] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.084910] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.084937] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.085046] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.085155] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.085373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.085466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.085557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.085645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.085728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.085823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.085905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.085990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.086067] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.086161] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.086249] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.087281] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.097737] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.097987] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.099030] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.099111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.099187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.099263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.099341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.099425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.099502] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.099574] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.099646] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.099721] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.099791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.099864] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.099935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.100004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.100074] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.100144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.100214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.100283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.100353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.100442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.100522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.100599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.100674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.100749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.100825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.100897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.100971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.101043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.101116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.101191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.101266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.101346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.101440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.101517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.101598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.101680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.101759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.101835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.101912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.101985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.102057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.102129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.102200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.102274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.102355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.102432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.102506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.102579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.102652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.102725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.102802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.102873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.102948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.103021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.103092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.103167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.103239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.103320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.103395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.103472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.103548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.103623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.103696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.103768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.103841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.103913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.103984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.104055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.104130] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.104266] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.104270] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1305, lrc_seqno=1305, guc_id=0, flags=0x73 in no process [-1]
<7> [55.104278] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.104344] ------------[ cut here ]------------
<4> [55.104345] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.104347] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:5/204
<4> [55.104422] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.104487]
<4> [55.104489] CPU: 9 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.104492] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.104493] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.104494] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.104500] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.104572] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.104574] RSP: 0018:ffffc90001627ca0 EFLAGS: 00010246
<4> [55.104577] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.104578] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.104579] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.104580] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.104582] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.104583] FS: 0000000000000000(0000) GS:ffff8888db103000(0000) knlGS:0000000000000000
<4> [55.104585] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.104586] CR2: 000079d50afa3000 CR3: 000000000344a001 CR4: 0000000000f72ef0
<4> [55.104587] PKRU: 55555554
<4> [55.104588] Call Trace:
<4> [55.104590] <TASK>
<4> [55.104594] ? lock_acquire+0xb0/0x300
<4> [55.104599] ? lock_release+0xd0/0x2b0
<4> [55.104603] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.104610] process_one_work+0x239/0x740
<4> [55.104616] worker_thread+0x200/0x3f0
<4> [55.104619] ? __pfx_worker_thread+0x10/0x10
<4> [55.104622] kthread+0x10d/0x150
<4> [55.104624] ? __pfx_kthread+0x10/0x10
<4> [55.104627] ret_from_fork+0x3bd/0x470
<4> [55.104630] ? __pfx_kthread+0x10/0x10
<4> [55.104632] ret_from_fork_asm+0x1a/0x30
<4> [55.104640] </TASK>
<4> [55.104641] irq event stamp: 92931
<4> [55.104642] hardirqs last enabled at (92937): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.104644] hardirqs last disabled at (92942): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.104646] softirqs last enabled at (91944): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.104648] softirqs last disabled at (91939): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.104651] ---[ end trace 0000000000000000 ]---
<5> [55.105833] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1315, lrc_seqno=1315, guc_id=0, flags=0x73 in no process [-1]
<7> [55.105840] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.105959] ------------[ cut here ]------------
<4> [55.105961] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.105963] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:9/992
<4> [55.106049] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.106122]
<4> [55.106126] CPU: 6 UID: 0 PID: 992 Comm: kworker/u64:9 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.106129] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.106130] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<7> [55.106040] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<4> [55.106131] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.106140] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.106239] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.106241] RSP: 0018:ffffc90003203ca0 EFLAGS: 00010246
<4> [55.106243] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.106245] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.106246] RBP: ffffc90003203db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.106247] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.106248] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.106250] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000
<4> [55.106251] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.106253] CR2: 000079d5088dd000 CR3: 0000000123785002 CR4: 0000000000f72ef0
<7> [55.106200] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<4> [55.106255] PKRU: 55555554
<4> [55.106256] Call Trace:
<4> [55.106257] <TASK>
<4> [55.106261] ? lock_acquire+0xb0/0x300
<4> [55.106266] ? lock_release+0xd0/0x2b0
<4> [55.106270] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.106276] process_one_work+0x239/0x740
<4> [55.106282] worker_thread+0x200/0x3f0
<4> [55.106285] ? __pfx_worker_thread+0x10/0x10
<4> [55.106288] kthread+0x10d/0x150
<4> [55.106290] ? __pfx_kthread+0x10/0x10
<4> [55.106293] ret_from_fork+0x3bd/0x470
<4> [55.106294] ? __pfx_kthread+0x10/0x10
<4> [55.106297] ret_from_fork_asm+0x1a/0x30
<4> [55.106304] </TASK>
<4> [55.106308] irq event stamp: 556999
<4> [55.106310] hardirqs last enabled at (557005): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.106312] hardirqs last disabled at (557010): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.106314] softirqs last enabled at (556838): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.106317] softirqs last disabled at (556801): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.106320] ---[ end trace 0000000000000000 ]---
<7> [55.106312] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<6> [55.106322] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.106400] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.106407] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.106412] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.106499] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.106584] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.106668] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.106660] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.106749] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.106771] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.106830] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.106880] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.106913] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.106994] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.107076] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.107112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.107158] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.107216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.107253] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.107323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.107336] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.107417] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.107417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.107499] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.107507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.107580] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.107591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.107660] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.107676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.107761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.107841] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.107938] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.108034] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<4> [55.109190] ------------[ cut here ]------------
<7> [55.109158] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<4> [55.109215] WARNING: drivers/gpu/drm/xe/xe_svm.c:283 at xe_svm_invalidate+0x6d2/0x710 [xe], CPU#5: xe_exec_system_/2262
<4> [55.109321] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.109425]
<4> [55.109428] CPU: 5 UID: 0 PID: 2262 Comm: xe_exec_system_ Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.109431] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.109432] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.109434] RIP: 0010:xe_svm_invalidate+0x6d2/0x710 [xe]
<4> [55.109530] Code: 8b b5 f0 fc ff ff 48 8b 95 e8 fc ff ff 48 89 bb 48 01 00 00 49 89 97 90 00 00 00 49 89 b7 98 00 00 00 48 89 3e e9 0b fc ff ff <0f> 0b e9 da f9 ff ff 0f 0b e9 9f fc ff ff 48 c7 c7 e0 48 c3 a0 e8
<4> [55.109532] RSP: 0000:ffffc900034a7790 EFLAGS: 00010286
<4> [55.109535] RAX: 00000000ffffffed RBX: ffff888112cec190 RCX: 0000000000000000
<4> [55.109536] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000
<4> [55.109538] RBP: ffffc900034a7ad0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.109539] R10: ffff88816b357dc0 R11: 0000000000000000 R12: 000079d50a800000
<4> [55.109540] R13: ffff888137e98000 R14: 0000000000000001 R15: ffff88816b356440
<4> [55.109542] FS: 000079d5321ff6c0(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000
<4> [55.109543] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.109545] CR2: 000079d50a742098 CR3: 0000000123785006 CR4: 0000000000f72ef0
<4> [55.109546] PKRU: 55555554
<4> [55.109547] Call Trace:
<4> [55.109548] <TASK>
<4> [55.109555] ? is_bpf_text_address+0x74/0x140
<4> [55.109563] ? __lock_acquire+0x43e/0x2790
<4> [55.109567] ? stack_depot_save_flags+0x28/0x960
<4> [55.109571] ? __lock_acquire+0x43e/0x2790
<4> [55.109575] ? __lock_acquire+0x43e/0x2790
<4> [55.109580] ? lock_acquire+0xc4/0x300
<4> [55.109582] ? drm_gpusvm_notifier_invalidate+0x3e/0x80 [drm_gpusvm_helper]
<4> [55.109591] drm_gpusvm_notifier_invalidate+0x59/0x80 [drm_gpusvm_helper]
<4> [55.109596] __mmu_notifier_invalidate_range_start+0x2b1/0x380
<4> [55.109600] migrate_vma_setup+0x2b5/0x2d0
<4> [55.109606] __drm_pagemap_migrate_to_ram+0x18f/0x3b0 [drm_gpusvm_helper]
<4> [55.109615] drm_pagemap_migrate_to_ram+0x39/0x60 [drm_gpusvm_helper]
<4> [55.109618] ? drm_pagemap_migrate_to_ram+0x39/0x60 [drm_gpusvm_helper]
<4> [55.109621] do_swap_page+0x1450/0x17d0
<4> [55.109627] ? __pte_offset_map+0x46/0x250
<4> [55.109629] ? __pte_offset_map+0x19c/0x250
<4> [55.109633] __handle_mm_fault+0xa0c/0x1000
<4> [55.109642] handle_mm_fault+0x12c/0x300
<4> [55.109644] ? lock_mm_and_find_vma+0x4b/0x8e0
<4> [55.109648] do_user_addr_fault+0x2d3/0x8e0
<4> [55.109654] exc_page_fault+0x96/0x2b0
<4> [55.109658] asm_exc_page_fault+0x27/0x30
<4> [55.109660] RIP: 0033:0x5870fb0fc9cb
<4> [55.109663] Code: 00 00 00 00 00 48 83 7c 24 58 00 74 0b f6 44 24 08 01 0f 84 d9 fd ff ff 4d 8d 64 2d 00 41 f7 c6 00 40 00 00 0f 85 85 09 00 00 <41> 8b 84 24 98 00 00 00 41 8b b4 24 9c 00 00 00 39 f0 0f 85 f2 18
<4> [55.109664] RSP: 002b:000079d5321fd9b0 EFLAGS: 00010246
<4> [55.109667] RAX: 0000000129fc62cb RBX: 000079d50a742000 RCX: 000079d536b24e1d
<4> [55.109668] RDX: 0000000000000000 RSI: 00000000c048644a RDI: 0000000000000005
<4> [55.109669] RBP: 0000000000050000 R08: 000079d5321fd998 R09: 0000000000000000
<4> [55.109670] R10: 0000000000000000 R11: 0000000000000246 R12: 000079d50a742000
<4> [55.109672] R13: 000079d50a6f2000 R14: 0000000000c00002 R15: 000079d5364ac000
<4> [55.109679] </TASK>
<4> [55.109680] irq event stamp: 223437
<4> [55.109681] hardirqs last enabled at (223443): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.109683] hardirqs last disabled at (223448): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.109685] softirqs last enabled at (222578): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.109688] softirqs last disabled at (222573): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.109690] ---[ end trace 0000000000000000 ]---
<7> [55.118900] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.119156] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.120161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.120251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.120331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.120411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.120488] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.120563] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.120639] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.120714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.120787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.120869] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.120942] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.121015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.121087] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.121160] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.121232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.121304] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.121376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.121448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.121520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.121605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.121687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.121767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.121854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.121937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.122017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.122093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.122167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.122240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.122313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.122389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.122467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.122544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.122620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.122696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.122778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.122877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.122960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.123039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.123117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.123191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.123267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.123342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.123416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.123489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.123564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.123640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.123715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.123804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.123878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.123955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.124032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.124107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.124181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.124255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.124327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.124401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.124477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.124550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.124621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.124697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.124779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.124853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.124926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.125000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.125074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.125147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.125221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.125292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.125367] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.125622] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.125626] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1315, lrc_seqno=1315, guc_id=0, flags=0x73 in no process [-1]
<7> [55.125629] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.125697] ------------[ cut here ]------------
<4> [55.125698] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.125700] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:5/204
<4> [55.125786] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.125854]
<4> [55.125856] CPU: 2 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.125859] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.125861] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.125862] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.125868] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.125944] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.125946] RSP: 0018:ffffc90001627ca0 EFLAGS: 00010246
<4> [55.125948] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.125950] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.125951] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.125952] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.125953] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.125955] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000
<4> [55.125956] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.125958] CR2: 0000732eb25a0000 CR3: 000000012441f006 CR4: 0000000000f72ef0
<4> [55.125959] PKRU: 55555554
<4> [55.125960] Call Trace:
<4> [55.125961] <TASK>
<4> [55.125966] ? lock_acquire+0xb0/0x300
<4> [55.125971] ? lock_release+0xd0/0x2b0
<4> [55.125976] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.125982] process_one_work+0x239/0x740
<4> [55.125988] worker_thread+0x200/0x3f0
<4> [55.125991] ? __pfx_worker_thread+0x10/0x10
<4> [55.125994] kthread+0x10d/0x150
<4> [55.125996] ? __pfx_kthread+0x10/0x10
<4> [55.125999] ret_from_fork+0x3bd/0x470
<4> [55.126001] ? __pfx_kthread+0x10/0x10
<4> [55.126004] ret_from_fork_asm+0x1a/0x30
<4> [55.126012] </TASK>
<4> [55.126013] irq event stamp: 96571
<4> [55.126014] hardirqs last enabled at (96577): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.126016] hardirqs last disabled at (96582): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.126018] softirqs last enabled at (95604): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.126021] softirqs last disabled at (95597): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.126023] ---[ end trace 0000000000000000 ]---
<6> [55.126025] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.126099] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.126105] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.127577] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.127696] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.127806] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.128031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.128126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.128220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.128309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.128397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.128485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.128574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.128662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.128744] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.128841] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.128933] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.129962] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.140667] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.140918] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.141884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.141966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.142046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.142124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.142202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.142280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.142370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.142447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.142520] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.142596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.142673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.142747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.142820] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.142893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.142966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.143039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.143111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.143182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.143252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.143350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.143433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.143514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.143597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.143679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.143757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.143834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.143909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.143987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.144065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.144144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.144222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.144310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.144386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.144460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.144542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.144624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.144707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.144786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.144862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.144935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.145010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.145086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.145162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.145246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.145321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.145398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.145474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.145546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.145618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.145691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.145766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.145838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.145912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.145985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.146057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.146131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.146214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.146289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.146362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.146439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.146514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.146588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.146659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.146731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.146805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.146879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.146952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.147025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.147100] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.147241] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.147245] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1315, lrc_seqno=1315, guc_id=0, flags=0x73 in no process [-1]
<7> [55.147247] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.147312] ------------[ cut here ]------------
<4> [55.147313] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.147315] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:2/121
<4> [55.147391] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.147456]
<4> [55.147459] CPU: 9 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.147462] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.147463] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.147464] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.147469] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.147543] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.147545] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246
<4> [55.147547] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.147549] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.147550] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.147551] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.147552] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.147554] FS: 0000000000000000(0000) GS:ffff8888db103000(0000) knlGS:0000000000000000
<4> [55.147555] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.147557] CR2: 000079d50afa3000 CR3: 000000000344a001 CR4: 0000000000f72ef0
<4> [55.147558] PKRU: 55555554
<4> [55.147559] Call Trace:
<4> [55.147560] <TASK>
<4> [55.147564] ? lock_acquire+0xb0/0x300
<4> [55.147569] ? lock_release+0xd0/0x2b0
<4> [55.147574] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.147580] process_one_work+0x239/0x740
<4> [55.147586] worker_thread+0x200/0x3f0
<4> [55.147589] ? __pfx_worker_thread+0x10/0x10
<4> [55.147592] kthread+0x10d/0x150
<4> [55.147594] ? __pfx_kthread+0x10/0x10
<4> [55.147597] ret_from_fork+0x3bd/0x470
<4> [55.147599] ? __pfx_kthread+0x10/0x10
<4> [55.147602] ret_from_fork_asm+0x1a/0x30
<4> [55.147609] </TASK>
<4> [55.147611] irq event stamp: 65619
<4> [55.147612] hardirqs last enabled at (65625): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.147614] hardirqs last disabled at (65630): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.147615] softirqs last enabled at (64712): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.147618] softirqs last disabled at (64707): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.147621] ---[ end trace 0000000000000000 ]---
<5> [55.148316] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1317, lrc_seqno=1317, guc_id=0, flags=0x73 in no process [-1]
<7> [55.148322] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.148439] ------------[ cut here ]------------
<4> [55.148440] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.148443] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:7/709
<4> [55.148528] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.148597]
<4> [55.148599] CPU: 5 UID: 0 PID: 709 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.148602] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.148603] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.148605] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.148611] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.148687] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.148689] RSP: 0018:ffffc90001fdfca0 EFLAGS: 00010246
<4> [55.148691] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.148693] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.148694] RBP: ffffc90001fdfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.148695] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.148696] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.148698] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000
<4> [55.148699] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.148701] CR2: 000079d50a742098 CR3: 0000000123785006 CR4: 0000000000f72ef0
<4> [55.148702] PKRU: 55555554
<4> [55.148703] Call Trace:
<4> [55.148704] <TASK>
<4> [55.148708] ? lock_acquire+0xb0/0x300
<4> [55.148713] ? lock_release+0xd0/0x2b0
<4> [55.148718] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.148724] process_one_work+0x239/0x740
<4> [55.148730] worker_thread+0x200/0x3f0
<4> [55.148733] ? __pfx_worker_thread+0x10/0x10
<4> [55.148736] kthread+0x10d/0x150
<4> [55.148738] ? __pfx_kthread+0x10/0x10
<4> [55.148741] ret_from_fork+0x3bd/0x470
<4> [55.148743] ? __pfx_kthread+0x10/0x10
<4> [55.148746] ret_from_fork_asm+0x1a/0x30
<7> [55.148698] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<4> [55.148753] </TASK>
<4> [55.148754] irq event stamp: 425523
<4> [55.148755] hardirqs last enabled at (425529): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.148757] hardirqs last disabled at (425534): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.148759] softirqs last enabled at (424722): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.148761] softirqs last disabled at (424717): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.148764] ---[ end trace 0000000000000000 ]---
<6> [55.148765] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.148839] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.148846] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.148805] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.149017] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.149244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.149340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.149437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.149526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.149616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.149701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.149786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.149872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.149951] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.150047] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.150151] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.151186] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.160809] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.161068] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.162097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.162182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.162262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.162340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.162418] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.162497] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.162573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.162647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.162721] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.162807] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.162893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.162967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.163041] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.163118] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.163193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.163267] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.163342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.163416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.163491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.163577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.163660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.163755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.163843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.163922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.164000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.164077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.164153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.164228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.164301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.164377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.164457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.164537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.164615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.164691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.164805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.164898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.164981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.165062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.165140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.165217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.165292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.165369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.165444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.165519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.165595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.165819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.165901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.165982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.166058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.166135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.166214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.166291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.166370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.166444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.166517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.166593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.166681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.166767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.166844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.166921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.166995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.167069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.167142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.167215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.167289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.167363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.167435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.167507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.167584] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.167758] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.167763] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1317, lrc_seqno=1317, guc_id=0, flags=0x73 in no process [-1]
<7> [55.167766] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.167831] ------------[ cut here ]------------
<4> [55.167832] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.167833] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:7/709
<4> [55.167908] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.167973]
<4> [55.167976] CPU: 5 UID: 0 PID: 709 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.167978] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.167980] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.167981] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.167986] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.168060] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.168062] RSP: 0018:ffffc90001fdfca0 EFLAGS: 00010246
<4> [55.168064] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.168066] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.168067] RBP: ffffc90001fdfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.168068] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.168069] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.168071] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000
<4> [55.168072] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.168074] CR2: 000079d50a742098 CR3: 0000000123785006 CR4: 0000000000f72ef0
<4> [55.168075] PKRU: 55555554
<4> [55.168076] Call Trace:
<4> [55.168078] <TASK>
<4> [55.168082] ? lock_acquire+0xb0/0x300
<4> [55.168087] ? lock_release+0xd0/0x2b0
<4> [55.168092] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.168098] process_one_work+0x239/0x740
<4> [55.168104] worker_thread+0x200/0x3f0
<4> [55.168107] ? __pfx_worker_thread+0x10/0x10
<4> [55.168110] kthread+0x10d/0x150
<4> [55.168112] ? __pfx_kthread+0x10/0x10
<4> [55.168115] ret_from_fork+0x3bd/0x470
<4> [55.168117] ? __pfx_kthread+0x10/0x10
<4> [55.168120] ret_from_fork_asm+0x1a/0x30
<4> [55.168127] </TASK>
<4> [55.168128] irq event stamp: 428899
<4> [55.168129] hardirqs last enabled at (428905): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.168132] hardirqs last disabled at (428910): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.168133] softirqs last enabled at (427744): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.168136] softirqs last disabled at (427737): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.168139] ---[ end trace 0000000000000000 ]---
<6> [55.168140] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.168214] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.168220] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.169458] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.169566] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.169690] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.170044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.170143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.170240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.170332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.170423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.170509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.170605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.170691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.170772] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.170871] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.170965] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.171997] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.182249] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.182499] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.183500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.183581] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.183659] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.183739] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.183816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.183889] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.183962] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.184034] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.184106] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.184177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.184263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.184336] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.184408] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.184479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.184552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.184624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.184696] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.184770] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.184842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.184924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.185006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.185087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.185172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.185254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.185332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.185407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.185483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.185558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.185632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.185708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.185786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.185862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.185939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.186016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.186096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.186205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.186292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.186373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.186454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.186531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.186608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.186683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.186756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.186830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.186905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.186980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.187053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.187130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.187203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.187279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.187357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.187431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.187509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.187587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.187660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.187735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.187810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.187882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.187953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.188029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.188107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.188182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.188255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.188326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.188399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.188474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.188546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.188618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.188695] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.188851] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.188855] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1317, lrc_seqno=1317, guc_id=0, flags=0x73 in no process [-1]
<7> [55.188858] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.188922] ------------[ cut here ]------------
<4> [55.188923] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.188925] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:5/204
<4> [55.189000] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.189249]
<4> [55.189251] CPU: 2 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.189254] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.189255] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.189257] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.189263] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.189340] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.189341] RSP: 0018:ffffc90001627ca0 EFLAGS: 00010246
<4> [55.189344] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.189346] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.189347] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.189348] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.189350] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.189351] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000
<4> [55.189353] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.189354] CR2: 0000732eb25a0000 CR3: 000000011e8d6003 CR4: 0000000000f72ef0
<4> [55.189356] PKRU: 55555554
<4> [55.189357] Call Trace:
<4> [55.189359] <TASK>
<4> [55.189363] ? lock_acquire+0xb0/0x300
<4> [55.189369] ? lock_release+0xd0/0x2b0
<4> [55.189374] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.189380] process_one_work+0x239/0x740
<4> [55.189386] worker_thread+0x200/0x3f0
<4> [55.189390] ? __pfx_worker_thread+0x10/0x10
<4> [55.189392] kthread+0x10d/0x150
<4> [55.189395] ? __pfx_kthread+0x10/0x10
<4> [55.189398] ret_from_fork+0x3bd/0x470
<4> [55.189400] ? __pfx_kthread+0x10/0x10
<4> [55.189403] ret_from_fork_asm+0x1a/0x30
<4> [55.189410] </TASK>
<4> [55.189412] irq event stamp: 100653
<4> [55.189413] hardirqs last enabled at (100659): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.189415] hardirqs last disabled at (100664): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.189417] softirqs last enabled at (99600): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.189420] softirqs last disabled at (99593): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.189423] ---[ end trace 0000000000000000 ]---
<5> [55.190085] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1318, lrc_seqno=1318, guc_id=0, flags=0x73 in no process [-1]
<7> [55.190097] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.190475] ------------[ cut here ]------------
<4> [55.190478] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.190481] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:5/204
<4> [55.190568] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.190671]
<4> [55.190674] CPU: 3 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.190678] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.190680] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<7> [55.190609] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<4> [55.190683] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.190691] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.190815] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.190818] RSP: 0000:ffffc90001627ca0 EFLAGS: 00010246
<4> [55.190821] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.190824] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.190826] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.190828] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.190830] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.190832] FS: 0000000000000000(0000) GS:ffff8888dae03000(0000) knlGS:0000000000000000
<4> [55.190835] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.190837] CR2: 000079d5212f0098 CR3: 000000000344a004 CR4: 0000000000f72ef0
<7> [55.190766] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<4> [55.190840] PKRU: 55555554
<4> [55.190841] Call Trace:
<4> [55.190843] <TASK>
<4> [55.190850] ? lock_acquire+0xb0/0x300
<4> [55.190857] ? lock_release+0xd0/0x2b0
<4> [55.190863] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.190872] process_one_work+0x239/0x740
<4> [55.190883] worker_thread+0x200/0x3f0
<4> [55.190888] ? __pfx_worker_thread+0x10/0x10
<4> [55.190892] kthread+0x10d/0x150
<4> [55.190895] ? __pfx_kthread+0x10/0x10
<4> [55.190900] ret_from_fork+0x3bd/0x470
<4> [55.190902] ? __pfx_kthread+0x10/0x10
<4> [55.190907] ret_from_fork_asm+0x1a/0x30
<4> [55.190923] </TASK>
<4> [55.190924] irq event stamp: 101545
<4> [55.190925] hardirqs last enabled at (101551): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.190927] hardirqs last disabled at (101556): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.190929] softirqs last enabled at (99600): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.190932] softirqs last disabled at (99593): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.190935] ---[ end trace 0000000000000000 ]---
<6> [55.190936] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.191020] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.191027] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.191432] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.191654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.191746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.191839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.191926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.192028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.192112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.192196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.192280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.192359] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.192454] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.192543] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.193577] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.204031] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.204282] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.205300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.205382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.205458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.205534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.205607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.205696] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.205771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.205846] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.205920] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.205992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.206066] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.206137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.206210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.206283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.206379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.206491] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.206568] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.206656] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.206730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.206814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.206895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.206973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.207048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.207125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.207203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.207278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.207353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.207427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.207501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.207576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.207668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.207745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.207820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.207896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.207977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.208056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.208146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.208224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.208299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.208373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.208449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.208525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.208611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.208688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.208765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.208842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.208917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.208994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.209071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.209149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.209227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.209304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.209378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.209452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.209525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.209615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.209689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.209762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.209832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.209907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.209982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.210056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.210130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.210202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.210274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.210347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.210417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.210492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.210588] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.210743] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.210748] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1318, lrc_seqno=1318, guc_id=0, flags=0x73 in no process [-1]
<7> [55.210750] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.210816] ------------[ cut here ]------------
<4> [55.210817] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.210818] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:5/204
<4> [55.210893] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.210958]
<4> [55.210960] CPU: 3 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.210964] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.210965] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.210966] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.210972] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.211044] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.211046] RSP: 0000:ffffc90001627ca0 EFLAGS: 00010246
<4> [55.211048] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.211049] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.211051] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.211052] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.211053] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.211054] FS: 0000000000000000(0000) GS:ffff8888dae03000(0000) knlGS:0000000000000000
<4> [55.211056] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.211057] CR2: 000079d5212f0098 CR3: 000000000344a004 CR4: 0000000000f72ef0
<4> [55.211059] PKRU: 55555554
<4> [55.211060] Call Trace:
<4> [55.211061] <TASK>
<4> [55.211065] ? lock_acquire+0xb0/0x300
<4> [55.211070] ? lock_release+0xd0/0x2b0
<4> [55.211075] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.211081] process_one_work+0x239/0x740
<4> [55.211088] worker_thread+0x200/0x3f0
<4> [55.211091] ? __pfx_worker_thread+0x10/0x10
<4> [55.211094] kthread+0x10d/0x150
<4> [55.211096] ? __pfx_kthread+0x10/0x10
<4> [55.211099] ret_from_fork+0x3bd/0x470
<4> [55.211101] ? __pfx_kthread+0x10/0x10
<4> [55.211104] ret_from_fork_asm+0x1a/0x30
<4> [55.211111] </TASK>
<4> [55.211112] irq event stamp: 104911
<4> [55.211113] hardirqs last enabled at (104917): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.211116] hardirqs last disabled at (104922): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.211117] softirqs last enabled at (103996): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.211120] softirqs last disabled at (103985): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.211122] ---[ end trace 0000000000000000 ]---
<6> [55.211124] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.211198] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.211204] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.212446] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.212567] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.212673] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.212902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.213000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.213098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.213189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.213277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.213363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.213463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.213555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.213639] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.213735] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.213828] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.214861] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.225128] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.225380] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.226432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.226514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.226593] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.226672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.226752] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.226829] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.226905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.226980] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.227055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.227147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.227221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.227294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.227368] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.227442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.227517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.227592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.227664] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.227737] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.227811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.227893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.227974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.228057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.228136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.228215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.228295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.228374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.228450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.228525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.228599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.228676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.228752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.228827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.228903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.228983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.229080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.229162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.229243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.229322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.229401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.229477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.229556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.229634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.229714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.229794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.229875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.229954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.230050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.230129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.230204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.230282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.230362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.230438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.230512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.230587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.230661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.230735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.230808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.230880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.230954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.231049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.231128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.231206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.231281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.231355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.231431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.231507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.231581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.231655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.231731] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.231881] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.231885] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1318, lrc_seqno=1318, guc_id=0, flags=0x73 in no process [-1]
<7> [55.231887] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.231958] ------------[ cut here ]------------
<4> [55.231959] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.231961] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:0/12
<4> [55.232038] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.232104]
<4> [55.232107] CPU: 1 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.232110] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.232111] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.232112] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.232117] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.232191] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.232193] RSP: 0000:ffffc900000b7ca0 EFLAGS: 00010246
<4> [55.232195] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.232197] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.232198] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.232199] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.232200] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.232202] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000
<4> [55.232203] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.232204] CR2: 000079d50a1ec000 CR3: 000000000344a003 CR4: 0000000000f72ef0
<4> [55.232206] PKRU: 55555554
<4> [55.232207] Call Trace:
<4> [55.232208] <TASK>
<4> [55.232212] ? lock_acquire+0xb0/0x300
<4> [55.232217] ? lock_release+0xd0/0x2b0
<4> [55.232222] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.232228] process_one_work+0x239/0x740
<4> [55.232235] worker_thread+0x200/0x3f0
<4> [55.232238] ? __pfx_worker_thread+0x10/0x10
<4> [55.232241] kthread+0x10d/0x150
<4> [55.232243] ? __pfx_kthread+0x10/0x10
<4> [55.232246] ret_from_fork+0x3bd/0x470
<4> [55.232248] ? __pfx_kthread+0x10/0x10
<4> [55.232251] ret_from_fork_asm+0x1a/0x30
<4> [55.232258] </TASK>
<4> [55.232259] irq event stamp: 263273
<4> [55.232260] hardirqs last enabled at (263279): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.232263] hardirqs last disabled at (263284): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.232264] softirqs last enabled at (262030): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.232267] softirqs last disabled at (262023): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.232270] ---[ end trace 0000000000000000 ]---
<5> [55.232824] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1319, lrc_seqno=1319, guc_id=0, flags=0x73 in no process [-1]
<7> [55.232833] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.233041] ------------[ cut here ]------------
<4> [55.233043] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.233045] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:9/992
<4> [55.233186] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.233261]
<4> [55.233265] CPU: 8 UID: 0 PID: 992 Comm: kworker/u64:9 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.233269] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.233270] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.233272] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.233280] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.233361] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.233362] RSP: 0000:ffffc90003203ca0 EFLAGS: 00010246
<4> [55.233365] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.233366] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.233368] RBP: ffffc90003203db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.233369] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.233370] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.233372] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000
<4> [55.233374] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.233375] CR2: 000079d508de0000 CR3: 000000012441f001 CR4: 0000000000f72ef0
<4> [55.233377] PKRU: 55555554
<4> [55.233378] Call Trace:
<4> [55.233379] <TASK>
<4> [55.233383] ? lock_acquire+0xb0/0x300
<4> [55.233389] ? lock_release+0xd0/0x2b0
<4> [55.233394] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.233400] process_one_work+0x239/0x740
<4> [55.233407] worker_thread+0x200/0x3f0
<4> [55.233410] ? __pfx_worker_thread+0x10/0x10
<4> [55.233413] kthread+0x10d/0x150
<4> [55.233416] ? __pfx_kthread+0x10/0x10
<4> [55.233419] ret_from_fork+0x3bd/0x470
<4> [55.233421] ? __pfx_kthread+0x10/0x10
<4> [55.233424] ret_from_fork_asm+0x1a/0x30
<4> [55.233432] </TASK>
<4> [55.233433] irq event stamp: 560735
<4> [55.233434] hardirqs last enabled at (560741): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.233437] hardirqs last disabled at (560746): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.233439] softirqs last enabled at (557576): [<ffffffff8133ad83>] kernel_fpu_end+0x53/0x70
<4> [55.233441] softirqs last disabled at (557574): [<ffffffff8133b494>] kernel_fpu_begin_mask+0xc4/0x120
<4> [55.233444] ---[ end trace 0000000000000000 ]---
<6> [55.233446] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.233523] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<7> [55.233528] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.233633] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<6> [55.233731] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.233907] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.234128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.234223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.234320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.234410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.234497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.234582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.234668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.234757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.234841] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.234954] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.235049] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.236081] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.245595] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.245846] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.246868] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.246952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.247032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.247110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.247185] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.247260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.247334] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.247410] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.247483] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.247563] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.247636] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.247710] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.247786] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.247861] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.247935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.248008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.248081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.248154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.248225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.248308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.248388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.248467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.248555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.248632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.248708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.248782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.248856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.248929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.249001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.249079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.249155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.249232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.249308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.249385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.249468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.249565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.249647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.249725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.249803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.249879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.249954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.250029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.250102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.250176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.250251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.250324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.250398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.250478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.250556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.250632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.250709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.250783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.250859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.250934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.251008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.251084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.251158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.251231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.251303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.251378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.251459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.251538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.251615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.251690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.251766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.251840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.251912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.251985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.252061] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.252209] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.252213] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1319, lrc_seqno=1319, guc_id=0, flags=0x73 in no process [-1]
<7> [55.252215] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.252281] ------------[ cut here ]------------
<4> [55.252282] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.252283] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:9/992
<4> [55.252358] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.252428]
<4> [55.252430] CPU: 8 UID: 0 PID: 992 Comm: kworker/u64:9 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.252433] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.252434] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.252435] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.252441] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.252515] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.252517] RSP: 0000:ffffc90003203ca0 EFLAGS: 00010246
<4> [55.252519] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.252521] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.252522] RBP: ffffc90003203db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.252523] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.252524] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.252526] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000
<4> [55.252527] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.252529] CR2: 000079d508de0000 CR3: 000000012441f001 CR4: 0000000000f72ef0
<4> [55.252530] PKRU: 55555554
<4> [55.252531] Call Trace:
<4> [55.252532] <TASK>
<4> [55.252536] ? lock_acquire+0xb0/0x300
<4> [55.252541] ? lock_release+0xd0/0x2b0
<4> [55.252546] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.252552] process_one_work+0x239/0x740
<4> [55.252559] worker_thread+0x200/0x3f0
<4> [55.252562] ? __pfx_worker_thread+0x10/0x10
<4> [55.252564] kthread+0x10d/0x150
<4> [55.252566] ? __pfx_kthread+0x10/0x10
<4> [55.252569] ret_from_fork+0x3bd/0x470
<4> [55.252572] ? __pfx_kthread+0x10/0x10
<4> [55.252574] ret_from_fork_asm+0x1a/0x30
<4> [55.252582] </TASK>
<4> [55.252583] irq event stamp: 564129
<4> [55.252584] hardirqs last enabled at (564135): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.252586] hardirqs last disabled at (564140): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.252588] softirqs last enabled at (563076): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.252591] softirqs last disabled at (563069): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.252593] ---[ end trace 0000000000000000 ]---
<6> [55.252595] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.252667] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.252673] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.253902] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.254008] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.254117] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.254350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.254464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.254567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.254659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.254746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.254830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.254915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.254999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.255080] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.255178] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.255270] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.256313] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.266772] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.267017] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.268084] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.268161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.268234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.268305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.268374] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.268443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.268509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.268576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.268641] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.268707] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.268774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.268839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.268905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.268971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.269059] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.269133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.269204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.269277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.269349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.269432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.269514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.269594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.269672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.269751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.269826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.269901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.269985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.270063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.270141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.270221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.270299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.270376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.270452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.270528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.270610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.270692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.270776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.270855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.270944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.271023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.271099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.271176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.271250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.271324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.271402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.271477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.271553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.271628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.271701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.271776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.271854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.271937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.272013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.272086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.272162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.272238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.272313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.272388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.272461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.272538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.272611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.272685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.272758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.272830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.272915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.272989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.273061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.273135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.273210] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.273361] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.273366] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1319, lrc_seqno=1319, guc_id=0, flags=0x73 in no process [-1]
<7> [55.273368] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.273434] ------------[ cut here ]------------
<4> [55.273435] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.273437] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:7/709
<4> [55.273512] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.273577]
<4> [55.273579] CPU: 5 UID: 0 PID: 709 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.273582] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.273584] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.273585] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.273591] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.273662] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.273665] RSP: 0018:ffffc90001fdfca0 EFLAGS: 00010246
<4> [55.273670] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.273673] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.273676] RBP: ffffc90001fdfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.273678] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.273681] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.273684] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000
<4> [55.273687] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.273690] CR2: 000079d50a742098 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [55.273693] PKRU: 55555554
<4> [55.273696] Call Trace:
<4> [55.273698] <TASK>
<4> [55.273706] ? lock_acquire+0xb0/0x300
<4> [55.273717] ? lock_release+0xd0/0x2b0
<4> [55.273730] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.273743] process_one_work+0x239/0x740
<4> [55.273757] worker_thread+0x200/0x3f0
<4> [55.273763] ? __pfx_worker_thread+0x10/0x10
<4> [55.273768] kthread+0x10d/0x150
<4> [55.273772] ? __pfx_kthread+0x10/0x10
<4> [55.273779] ret_from_fork+0x3bd/0x470
<4> [55.273782] ? __pfx_kthread+0x10/0x10
<4> [55.273787] ret_from_fork_asm+0x1a/0x30
<4> [55.273800] </TASK>
<4> [55.273802] irq event stamp: 432745
<4> [55.273804] hardirqs last enabled at (432751): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.273808] hardirqs last disabled at (432756): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.273811] softirqs last enabled at (431626): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.273815] softirqs last disabled at (431619): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.273819] ---[ end trace 0000000000000000 ]---
<5> [55.274386] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1320, lrc_seqno=1320, guc_id=0, flags=0x73 in no process [-1]
<7> [55.274391] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.274534] ------------[ cut here ]------------
<4> [55.274536] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.274538] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:0/12
<4> [55.274622] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.274696]
<4> [55.274699] CPU: 1 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.274703] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.274704] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.274706] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.274715] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.274795] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.274797] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [55.274799] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.274800] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.274802] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.274803] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.274804] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.274806] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000
<4> [55.274807] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.274809] CR2: 0000732eb25a3000 CR3: 000000012441f001 CR4: 0000000000f72ef0
<4> [55.274810] PKRU: 55555554
<4> [55.274811] Call Trace:
<4> [55.274813] <TASK>
<4> [55.274817] ? lock_acquire+0xb0/0x300
<4> [55.274823] ? lock_release+0xd0/0x2b0
<4> [55.274835] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.274843] process_one_work+0x239/0x740
<4> [55.274851] worker_thread+0x200/0x3f0
<4> [55.274855] ? __pfx_worker_thread+0x10/0x10
<4> [55.274857] kthread+0x10d/0x150
<4> [55.274859] ? __pfx_kthread+0x10/0x10
<4> [55.274862] ret_from_fork+0x3bd/0x470
<4> [55.274864] ? __pfx_kthread+0x10/0x10
<4> [55.274867] ret_from_fork_asm+0x1a/0x30
<4> [55.274876] </TASK>
<4> [55.274877] irq event stamp: 264683
<4> [55.274879] hardirqs last enabled at (264689): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.274882] hardirqs last disabled at (264694): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.274884] softirqs last enabled at (264618): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.274888] softirqs last disabled at (264613): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.274890] ---[ end trace 0000000000000000 ]---
<6> [55.274908] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.275001] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.275013] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.275141] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.275250] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.275357] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.275577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.275672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.275768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.275874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.275961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.276045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.276128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.276217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.276299] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.276396] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.276489] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.277541] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.287501] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.287755] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.288763] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.288845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.288922] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.288998] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.289072] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.289144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.289216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.289286] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.289357] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.289429] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.289519] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.289594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.289668] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.289743] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.289816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.289889] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.289962] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.290036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.290110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.290192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.290273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.290352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.290435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.290515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.290592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.290668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.290746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.290823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.290898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.290975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.291052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.291126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.291202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.291277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.291358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.291459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.291540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.291618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.291694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.291767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.291842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.291916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.291989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.292061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.292136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.292211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.292285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.292357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.292451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.292530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.292608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.292681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.292756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.292831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.292904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.292980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.293054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.293125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.293198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.293272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.293348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.293428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.293505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.293580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.293655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.293731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.293806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.293880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.293957] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.294110] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.294114] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1320, lrc_seqno=1320, guc_id=0, flags=0x73 in no process [-1]
<7> [55.294116] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.294182] ------------[ cut here ]------------
<4> [55.294183] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.294184] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:0/12
<4> [55.294259] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.294328]
<4> [55.294330] CPU: 1 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.294333] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.294335] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.294336] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.294341] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.294422] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.294423] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [55.294426] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.294427] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.294428] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.294429] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.294431] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.294432] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000
<4> [55.294434] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.294435] CR2: 0000732eb25a3000 CR3: 000000012441f001 CR4: 0000000000f72ef0
<4> [55.294436] PKRU: 55555554
<4> [55.294438] Call Trace:
<4> [55.294439] <TASK>
<4> [55.294442] ? lock_acquire+0xb0/0x300
<4> [55.294448] ? lock_release+0xd0/0x2b0
<4> [55.294452] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.294458] process_one_work+0x239/0x740
<4> [55.294464] worker_thread+0x200/0x3f0
<4> [55.294467] ? __pfx_worker_thread+0x10/0x10
<4> [55.294470] kthread+0x10d/0x150
<4> [55.294472] ? __pfx_kthread+0x10/0x10
<4> [55.294475] ret_from_fork+0x3bd/0x470
<4> [55.294477] ? __pfx_kthread+0x10/0x10
<4> [55.294480] ret_from_fork_asm+0x1a/0x30
<4> [55.294487] </TASK>
<4> [55.294489] irq event stamp: 268025
<4> [55.294490] hardirqs last enabled at (268031): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.294492] hardirqs last disabled at (268036): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.294494] softirqs last enabled at (266694): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.294496] softirqs last disabled at (266685): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.294499] ---[ end trace 0000000000000000 ]---
<6> [55.294501] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.294576] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.294583] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.295844] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.295952] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.296062] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.296327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.296520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.296682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.296826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.296965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.297103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.297255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.297399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.297535] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.297684] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.297829] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.299173] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.308946] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.309260] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.310440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.310568] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.310695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.310822] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.310978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.311070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.311152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.311230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.311307] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.311382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.311455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.311527] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.311600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.311673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.311746] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.311819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.311903] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.311974] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.312046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.312129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.312213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.312294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.312372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.312453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.312530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.312609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.312684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.312760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.312842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.312923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.313002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.313078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.313156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.313234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.313319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.313398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.313479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.313562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.313645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.313723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.313802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.313893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.313969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.314046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.314126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.314204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.314281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.314355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.314428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.314503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.314582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.314659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.314738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.314831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.314909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.314986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.315062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.315137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.315212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.315288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.315365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.315441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.315515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.315589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.315663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.315739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.315826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.315900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.315982] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.316311] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.316316] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1320, lrc_seqno=1320, guc_id=0, flags=0x73 in no process [-1]
<7> [55.316319] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.316386] ------------[ cut here ]------------
<4> [55.316388] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.316389] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:5/204
<4> [55.316469] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.316536]
<4> [55.316538] CPU: 4 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.316542] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.316543] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.316544] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.316550] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.316623] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.316625] RSP: 0000:ffffc90001627ca0 EFLAGS: 00010246
<4> [55.316628] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.316629] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.316631] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.316632] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.316633] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.316634] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000
<4> [55.316636] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.316638] CR2: 0000732eb25a2000 CR3: 000000011e8d6004 CR4: 0000000000f72ef0
<4> [55.316639] PKRU: 55555554
<4> [55.316640] Call Trace:
<4> [55.316642] <TASK>
<4> [55.316646] ? lock_acquire+0xb0/0x300
<4> [55.316651] ? lock_release+0xd0/0x2b0
<4> [55.316656] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.316662] process_one_work+0x239/0x740
<4> [55.316668] worker_thread+0x200/0x3f0
<4> [55.316672] ? __pfx_worker_thread+0x10/0x10
<4> [55.316674] kthread+0x10d/0x150
<4> [55.316677] ? __pfx_kthread+0x10/0x10
<4> [55.316680] ret_from_fork+0x3bd/0x470
<4> [55.316682] ? __pfx_kthread+0x10/0x10
<4> [55.316685] ret_from_fork_asm+0x1a/0x30
<4> [55.316692] </TASK>
<4> [55.316694] irq event stamp: 108849
<4> [55.316695] hardirqs last enabled at (108855): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.316697] hardirqs last disabled at (108860): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.316699] softirqs last enabled at (107922): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.316702] softirqs last disabled at (107915): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.316704] ---[ end trace 0000000000000000 ]---
<7> [55.317984] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<5> [55.318066] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1321, lrc_seqno=1321, guc_id=0, flags=0x73 in no process [-1]
<7> [55.318070] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<7> [55.318100] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<4> [55.318152] ------------[ cut here ]------------
<4> [55.318153] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.318155] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:5/204
<4> [55.318244] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.318310]
<4> [55.318312] CPU: 6 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.318315] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.318316] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.318318] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.318324] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.318405] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.318407] RSP: 0018:ffffc90001627ca0 EFLAGS: 00010246
<4> [55.318409] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.318410] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.318412] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.318413] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.318414] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.318415] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000
<4> [55.318417] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.318418] CR2: 0000732eb25a1000 CR3: 000000011e8d6004 CR4: 0000000000f72ef0
<4> [55.318420] PKRU: 55555554
<4> [55.318421] Call Trace:
<4> [55.318422] <TASK>
<4> [55.318426] ? lock_acquire+0xb0/0x300
<4> [55.318431] ? lock_release+0xd0/0x2b0
<4> [55.318435] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.318441] process_one_work+0x239/0x740
<4> [55.318448] worker_thread+0x200/0x3f0
<4> [55.318451] ? __pfx_worker_thread+0x10/0x10
<4> [55.318454] kthread+0x10d/0x150
<4> [55.318456] ? __pfx_kthread+0x10/0x10
<4> [55.318459] ret_from_fork+0x3bd/0x470
<4> [55.318461] ? __pfx_kthread+0x10/0x10
<4> [55.318464] ret_from_fork_asm+0x1a/0x30
<4> [55.318472] </TASK>
<4> [55.318473] irq event stamp: 109697
<4> [55.318474] hardirqs last enabled at (109703): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.318476] hardirqs last disabled at (109708): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.318478] softirqs last enabled at (107922): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.318481] softirqs last disabled at (107915): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.318483] ---[ end trace 0000000000000000 ]---
<6> [55.318485] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.318567] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.318573] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.318984] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.319210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.319313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.319415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.319508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.319599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.319697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.319788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.319882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.319967] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.320073] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.320172] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.321222] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.331358] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.331626] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.332610] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.332701] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.332786] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.332869] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.332952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.333032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.333113] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.333196] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.333278] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.333364] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.333444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.333522] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.333598] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.333675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.333751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.333828] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.333904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.333982] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.334058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.334146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.334235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.334334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.334416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.334499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.334580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.334660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.334741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.334822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.334905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.334988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.335071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.335153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.335240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.335336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.335423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.335511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.335599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.335683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.335763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.335842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.335921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.336001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.336081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.336163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.336249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.336329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.336410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.336489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.336568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.336647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.336728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.336808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.336889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.336967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.337044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.337123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.337204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.337282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.337359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.337437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.337517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.337596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.337675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.337755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.337834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.337913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.337990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.338066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.338145] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.338313] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.338318] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1321, lrc_seqno=1321, guc_id=0, flags=0x73 in no process [-1]
<7> [55.338320] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.338386] ------------[ cut here ]------------
<4> [55.338387] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.338388] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:5/204
<4> [55.338464] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.338529]
<4> [55.338531] CPU: 6 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.338534] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.338535] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.338536] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.338541] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.338616] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.338618] RSP: 0018:ffffc90001627ca0 EFLAGS: 00010246
<4> [55.338620] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.338622] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.338623] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.338624] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.338625] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.338627] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000
<4> [55.338628] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.338630] CR2: 0000732eb25a1000 CR3: 000000011e8d6004 CR4: 0000000000f72ef0
<4> [55.338631] PKRU: 55555554
<4> [55.338632] Call Trace:
<4> [55.338633] <TASK>
<4> [55.338637] ? lock_acquire+0xb0/0x300
<4> [55.338642] ? lock_release+0xd0/0x2b0
<4> [55.338647] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.338653] process_one_work+0x239/0x740
<4> [55.338660] worker_thread+0x200/0x3f0
<4> [55.338663] ? __pfx_worker_thread+0x10/0x10
<4> [55.338665] kthread+0x10d/0x150
<4> [55.338667] ? __pfx_kthread+0x10/0x10
<4> [55.338670] ret_from_fork+0x3bd/0x470
<4> [55.338673] ? __pfx_kthread+0x10/0x10
<4> [55.338675] ret_from_fork_asm+0x1a/0x30
<4> [55.338683] </TASK>
<4> [55.338684] irq event stamp: 113077
<4> [55.338685] hardirqs last enabled at (113083): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.338687] hardirqs last disabled at (113088): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.338689] softirqs last enabled at (111914): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.338691] softirqs last disabled at (111907): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.338694] ---[ end trace 0000000000000000 ]---
<6> [55.338696] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.338769] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.338775] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.340104] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.340221] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.340329] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.340555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.340650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.340749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.340844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.340931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.341016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.341107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.341194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.341275] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.341374] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.341465] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.342495] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.352799] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.353052] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.354070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.354154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.354233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.354311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.354386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.354460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.354534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.354609] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.354682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.354776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.354853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.354928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.355000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.355075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.355147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.355219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.355290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.355361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.355435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.355518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.355602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.355680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.355769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.355850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.355927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.356003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.356077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.356152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.356226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.356304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.356380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.356455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.356530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.356606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.356837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.356937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.357020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.357097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.357173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.357249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.357324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.357398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.357471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.357545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.357622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.357711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.357788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.357863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.357937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.358014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.358092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.358168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.358243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.358318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.358391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.358465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.358539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.358611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.358691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.358768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.358842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.358917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.358991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.359064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.359137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.359210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.359282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.359353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.359426] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.359589] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.359594] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1321, lrc_seqno=1321, guc_id=0, flags=0x73 in no process [-1]
<7> [55.359596] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.359678] ------------[ cut here ]------------
<4> [55.359680] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.359681] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:5/204
<4> [55.359757] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.359822]
<4> [55.359825] CPU: 2 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.359828] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.359829] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.359830] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.359836] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.359911] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.359912] RSP: 0018:ffffc90001627ca0 EFLAGS: 00010246
<4> [55.359915] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.359916] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.359917] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.359919] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.359920] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.359921] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000
<4> [55.359923] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.359924] CR2: 0000732eb25a0000 CR3: 000000012441f006 CR4: 0000000000f72ef0
<4> [55.359926] PKRU: 55555554
<4> [55.359927] Call Trace:
<4> [55.359928] <TASK>
<4> [55.359932] ? lock_acquire+0xb0/0x300
<4> [55.359937] ? lock_release+0xd0/0x2b0
<4> [55.359942] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.359947] process_one_work+0x239/0x740
<4> [55.359954] worker_thread+0x200/0x3f0
<4> [55.359957] ? __pfx_worker_thread+0x10/0x10
<4> [55.359960] kthread+0x10d/0x150
<4> [55.359962] ? __pfx_kthread+0x10/0x10
<4> [55.359965] ret_from_fork+0x3bd/0x470
<4> [55.359967] ? __pfx_kthread+0x10/0x10
<4> [55.359969] ret_from_fork_asm+0x1a/0x30
<4> [55.359977] </TASK>
<4> [55.359978] irq event stamp: 116545
<4> [55.359979] hardirqs last enabled at (116551): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.359981] hardirqs last disabled at (116556): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.359983] softirqs last enabled at (115784): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.359986] softirqs last disabled at (115777): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.359988] ---[ end trace 0000000000000000 ]---
<5> [55.360496] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1322, lrc_seqno=1322, guc_id=0, flags=0x73 in no process [-1]
<7> [55.360504] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.360650] ------------[ cut here ]------------
<4> [55.360652] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.360655] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:0/12
<4> [55.360749] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.360827]
<4> [55.360831] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.360836] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.360837] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.360839] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.360847] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.360933] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.360936] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [55.360938] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.360940] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.360941] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.360942] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.360943] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.360945] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000
<4> [55.360946] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.360948] CR2: 0000732eb25a2000 CR3: 000000011e8d6004 CR4: 0000000000f72ef0
<4> [55.360950] PKRU: 55555554
<4> [55.360951] Call Trace:
<4> [55.360952] <TASK>
<4> [55.360957] ? lock_acquire+0xb0/0x300
<4> [55.360963] ? lock_release+0xd0/0x2b0
<4> [55.360968] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.360974] process_one_work+0x239/0x740
<4> [55.360981] worker_thread+0x200/0x3f0
<4> [55.360984] ? __pfx_worker_thread+0x10/0x10
<4> [55.360987] kthread+0x10d/0x150
<4> [55.360989] ? __pfx_kthread+0x10/0x10
<4> [55.360992] ret_from_fork+0x3bd/0x470
<4> [55.360994] ? __pfx_kthread+0x10/0x10
<4> [55.360997] ret_from_fork_asm+0x1a/0x30
<4> [55.361004] </TASK>
<4> [55.361006] irq event stamp: 269947
<4> [55.361007] hardirqs last enabled at (269953): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.361010] hardirqs last disabled at (269958): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.361012] softirqs last enabled at (269186): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.361014] softirqs last disabled at (269179): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.361017] ---[ end trace 0000000000000000 ]---
<6> [55.361020] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.361106] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.361116] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.361245] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.361354] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.361462] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.361681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.361778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.361874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.361964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.362053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.362139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.362224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.362310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.362391] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.362491] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.362610] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.363648] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.373266] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.373516] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.374513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.374596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.374673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.374752] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.374830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.374905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.374978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.375053] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.375124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.375196] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.375282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.375354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.375428] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.375500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.375570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.375641] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.375712] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.375781] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.375852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.375934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.376015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.376095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.376174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.376267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.376344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.376421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.376497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.376572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.376647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.376724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.376806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.376884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.376961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.377036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.377117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.377207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.377288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.377366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.377443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.377518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.377592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.377666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.377738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.377812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.377886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.377962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.378035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.378107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.378199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.378278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.378357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.378431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.378505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.378579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.378650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.378724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.378798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.378871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.378943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.379020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.379093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.379179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.379254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.379327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.379402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.379475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.379547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.379626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.379706] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.379841] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.379845] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1322, lrc_seqno=1322, guc_id=0, flags=0x73 in no process [-1]
<7> [55.379848] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.379913] ------------[ cut here ]------------
<4> [55.379914] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.379915] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:0/12
<4> [55.379989] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.380053]
<4> [55.380055] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.380058] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.380059] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.380061] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.380066] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.380150] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.380152] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [55.380155] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.380156] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.380158] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.380159] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.380160] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.380162] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000
<4> [55.380164] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.380165] CR2: 0000732eb25a2000 CR3: 000000011e8d6004 CR4: 0000000000f72ef0
<4> [55.380167] PKRU: 55555554
<4> [55.380168] Call Trace:
<4> [55.380169] <TASK>
<4> [55.380173] ? lock_acquire+0xb0/0x300
<4> [55.380178] ? lock_release+0xd0/0x2b0
<4> [55.380182] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.380188] process_one_work+0x239/0x740
<4> [55.380195] worker_thread+0x200/0x3f0
<4> [55.380198] ? __pfx_worker_thread+0x10/0x10
<4> [55.380200] kthread+0x10d/0x150
<4> [55.380203] ? __pfx_kthread+0x10/0x10
<4> [55.380206] ret_from_fork+0x3bd/0x470
<4> [55.380208] ? __pfx_kthread+0x10/0x10
<4> [55.380211] ret_from_fork_asm+0x1a/0x30
<4> [55.380218] </TASK>
<4> [55.380219] irq event stamp: 273355
<4> [55.380220] hardirqs last enabled at (273361): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.380223] hardirqs last disabled at (273366): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.380224] softirqs last enabled at (272396): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.380227] softirqs last disabled at (272389): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.380230] ---[ end trace 0000000000000000 ]---
<6> [55.380232] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.380303] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.380309] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.380717] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.380932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.381021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.381121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.381205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.381288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.381373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.381457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.381542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.381622] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.381719] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.381811] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.382866] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.392756] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.393012] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.394269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.394359] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.394441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.394521] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.394598] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.394673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.394762] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.394837] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.394909] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.394982] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.395054] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.395126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.395197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.395268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.395341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.395414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.395485] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.395557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.395629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.395722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.395804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.395884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.395963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.396046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.396124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.396199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.396272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.396345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.396420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.396497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.396575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.396657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.396739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.396816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.396900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.396981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.397064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.397142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.397220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.397294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.397368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.397442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.397515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.397588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.397672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.397747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.397822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.397896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.397969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.398044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.398121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.398194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.398268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.398340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.398411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.398485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.398559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.398640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.398713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.398788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.398861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.398934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.399006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.399078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.399150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.399222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.399297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.399368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.399444] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.399774] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.399778] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1322, lrc_seqno=1322, guc_id=0, flags=0x73 in no process [-1]
<7> [55.399781] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.399847] ------------[ cut here ]------------
<4> [55.399848] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.399849] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:0/12
<4> [55.399925] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.399990]
<4> [55.399992] CPU: 8 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.399995] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.399996] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.399998] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.400003] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.400076] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.400077] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [55.400080] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.400081] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.400083] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.400084] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.400085] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.400086] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000
<4> [55.400088] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.400089] CR2: 0000732eb25a4000 CR3: 000000012441f001 CR4: 0000000000f72ef0
<4> [55.400091] PKRU: 55555554
<4> [55.400092] Call Trace:
<4> [55.400093] <TASK>
<4> [55.400097] ? lock_acquire+0xb0/0x300
<4> [55.400102] ? lock_release+0xd0/0x2b0
<4> [55.400106] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.400112] process_one_work+0x239/0x740
<4> [55.400119] worker_thread+0x200/0x3f0
<4> [55.400122] ? __pfx_worker_thread+0x10/0x10
<4> [55.400125] kthread+0x10d/0x150
<4> [55.400127] ? __pfx_kthread+0x10/0x10
<4> [55.400130] ret_from_fork+0x3bd/0x470
<4> [55.400132] ? __pfx_kthread+0x10/0x10
<4> [55.400134] ret_from_fork_asm+0x1a/0x30
<4> [55.400142] </TASK>
<4> [55.400143] irq event stamp: 276721
<4> [55.400144] hardirqs last enabled at (276727): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.400146] hardirqs last disabled at (276732): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.400148] softirqs last enabled at (275464): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.400151] softirqs last disabled at (275457): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.400153] ---[ end trace 0000000000000000 ]---
<5> [55.400481] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1323, lrc_seqno=1323, guc_id=0, flags=0x73 in no process [-1]
<7> [55.400490] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.400679] ------------[ cut here ]------------
<4> [55.400681] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.400684] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#14: kworker/u64:7/709
<4> [55.400813] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.400917]
<4> [55.400921] CPU: 14 UID: 0 PID: 709 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.400925] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.400927] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.400929] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.400938] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.401060] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.401063] RSP: 0018:ffffc90001fdfca0 EFLAGS: 00010246
<4> [55.401066] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.401068] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.401071] RBP: ffffc90001fdfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.401073] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.401074] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.401076] FS: 0000000000000000(0000) GS:ffff8888db383000(0000) knlGS:0000000000000000
<4> [55.401079] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.401081] CR2: 000079d50bb8f000 CR3: 000000000344a001 CR4: 0000000000f72ef0
<4> [55.401083] PKRU: 55555554
<4> [55.401085] Call Trace:
<4> [55.401087] <TASK>
<4> [55.401093] ? lock_acquire+0xb0/0x300
<4> [55.401101] ? lock_release+0xd0/0x2b0
<4> [55.401109] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.401118] process_one_work+0x239/0x740
<4> [55.401129] worker_thread+0x200/0x3f0
<4> [55.401133] ? __pfx_worker_thread+0x10/0x10
<4> [55.401137] kthread+0x10d/0x150
<4> [55.401140] ? __pfx_kthread+0x10/0x10
<4> [55.401144] ret_from_fork+0x3bd/0x470
<4> [55.401147] ? __pfx_kthread+0x10/0x10
<4> [55.401151] ret_from_fork_asm+0x1a/0x30
<4> [55.401163] </TASK>
<4> [55.401165] irq event stamp: 434177
<4> [55.401167] hardirqs last enabled at (434183): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.401170] hardirqs last disabled at (434188): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.401172] softirqs last enabled at (433414): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.401176] softirqs last disabled at (433409): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.401179] ---[ end trace 0000000000000000 ]---
<6> [55.401190] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<7> [55.401196] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<6> [55.401269] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.401277] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.401305] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.401775] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.402018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.402124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.402225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.402319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.402409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.402507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.402597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.402686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.402775] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.402878] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.402974] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.404011] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.414200] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.414452] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.415485] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.415571] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.415650] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.415730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.415807] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.415884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.415960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.416036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.416111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.416197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.416274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.416351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.416425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.416499] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.416575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.416649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.416723] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.416796] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.416869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.416953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.417037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.417118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.417198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.417274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.417349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.417424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.417497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.417571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.417647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.417724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.417800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.417875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.417953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.418033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.418121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.418206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.418289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.418367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.418448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.418525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.418600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.418675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.418751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.418827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.418901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.418975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.419050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.419133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.419206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.419280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.419354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.419427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.419500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.419574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.419645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.419718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.419791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.419862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.419931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.420007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.420090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.420164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.420237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.420310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.420384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.420457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.420527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.420602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.420675] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.420834] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.420838] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1323, lrc_seqno=1323, guc_id=0, flags=0x73 in no process [-1]
<7> [55.420841] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.420908] ------------[ cut here ]------------
<4> [55.420909] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.420911] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:7/709
<4> [55.420985] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.421193]
<4> [55.421196] CPU: 4 UID: 0 PID: 709 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.421199] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.421201] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.421202] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.421208] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.421288] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.421290] RSP: 0018:ffffc90001fdfca0 EFLAGS: 00010246
<4> [55.421292] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.421293] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.421295] RBP: ffffc90001fdfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.421296] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.421297] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.421298] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000
<4> [55.421300] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.421301] CR2: 0000732eb25a2000 CR3: 000000012441f003 CR4: 0000000000f72ef0
<4> [55.421303] PKRU: 55555554
<4> [55.421304] Call Trace:
<4> [55.421305] <TASK>
<4> [55.421309] ? lock_acquire+0xb0/0x300
<4> [55.421315] ? lock_release+0xd0/0x2b0
<4> [55.421319] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.421325] process_one_work+0x239/0x740
<4> [55.421332] worker_thread+0x200/0x3f0
<4> [55.421335] ? __pfx_worker_thread+0x10/0x10
<4> [55.421338] kthread+0x10d/0x150
<4> [55.421340] ? __pfx_kthread+0x10/0x10
<4> [55.421343] ret_from_fork+0x3bd/0x470
<4> [55.421345] ? __pfx_kthread+0x10/0x10
<4> [55.421348] ret_from_fork_asm+0x1a/0x30
<4> [55.421355] </TASK>
<4> [55.421356] irq event stamp: 437545
<4> [55.421358] hardirqs last enabled at (437551): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.421360] hardirqs last disabled at (437556): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.421361] softirqs last enabled at (436206): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.421364] softirqs last disabled at (436197): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.421367] ---[ end trace 0000000000000000 ]---
<6> [55.422000] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.422128] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.422140] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.422608] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.422717] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.422827] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.423120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.423267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.423414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.423554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.423693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.423831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.423977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.424119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.424255] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.424404] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.424550] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.426143] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.436615] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.436872] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.437867] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.438004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.438097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.438181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.438260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.438337] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.438413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.438487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.438572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.438646] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.438718] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.438791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.438863] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.438935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.439008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.439079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.439149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.439222] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.439294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.439378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.439461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.439548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.439628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.439707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.439785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.439863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.439942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.440021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.440096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.440174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.440253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.440331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.440410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.440488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.440587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.440671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.440754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.440833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.440913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.440988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.441064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.441140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.441215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.441289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.441366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.441444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.441532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.441607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.441681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.441758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.441837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.441912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.441987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.442063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.442140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.442217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.442294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.442370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.442446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.442541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.442615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.442690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.442764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.442836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.442910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.442984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.443059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.443135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.443212] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.443375] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.443380] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1323, lrc_seqno=1323, guc_id=0, flags=0x73 in no process [-1]
<7> [55.443383] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.443466] ------------[ cut here ]------------
<4> [55.443468] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.443470] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:2/121
<4> [55.443546] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.443612]
<4> [55.443615] CPU: 0 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.443618] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.443619] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.443620] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.443626] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.443700] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.443702] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246
<4> [55.443704] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.443706] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.443707] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.443708] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.443709] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.443711] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000
<4> [55.443712] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.443713] CR2: 000079d50b68a000 CR3: 000000000344a004 CR4: 0000000000f72ef0
<4> [55.443715] PKRU: 55555554
<4> [55.443716] Call Trace:
<4> [55.443717] <TASK>
<4> [55.443721] ? lock_acquire+0xb0/0x300
<4> [55.443727] ? lock_release+0xd0/0x2b0
<4> [55.443731] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.443737] process_one_work+0x239/0x740
<4> [55.443744] worker_thread+0x200/0x3f0
<4> [55.443747] ? __pfx_worker_thread+0x10/0x10
<4> [55.443750] kthread+0x10d/0x150
<4> [55.443752] ? __pfx_kthread+0x10/0x10
<4> [55.443755] ret_from_fork+0x3bd/0x470
<4> [55.443757] ? __pfx_kthread+0x10/0x10
<4> [55.443759] ret_from_fork_asm+0x1a/0x30
<4> [55.443767] </TASK>
<4> [55.443768] irq event stamp: 69839
<4> [55.443769] hardirqs last enabled at (69845): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.443771] hardirqs last disabled at (69850): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.443773] softirqs last enabled at (69078): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.443776] softirqs last disabled at (69071): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.443779] ---[ end trace 0000000000000000 ]---
<5> [55.444379] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1324, lrc_seqno=1324, guc_id=0, flags=0x73 in no process [-1]
<7> [55.444385] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.444538] ------------[ cut here ]------------
<4> [55.444541] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.444542] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:7/709
<4> [55.444630] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.444704]
<4> [55.444708] CPU: 8 UID: 0 PID: 709 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.444711] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.444712] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.444713] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.444720] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.444806] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.444808] RSP: 0018:ffffc90001fdfca0 EFLAGS: 00010246
<4> [55.444811] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.444812] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.444813] RBP: ffffc90001fdfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.444815] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.444816] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.444817] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000
<4> [55.444819] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.444820] CR2: 0000732eb25a4000 CR3: 000000012441f001 CR4: 0000000000f72ef0
<4> [55.444821] PKRU: 55555554
<4> [55.444823] Call Trace:
<4> [55.444824] <TASK>
<4> [55.444828] ? lock_acquire+0xb0/0x300
<4> [55.444834] ? lock_release+0xd0/0x2b0
<4> [55.444839] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.444846] process_one_work+0x239/0x740
<4> [55.444854] worker_thread+0x200/0x3f0
<4> [55.444857] ? __pfx_worker_thread+0x10/0x10
<4> [55.444860] kthread+0x10d/0x150
<4> [55.444862] ? __pfx_kthread+0x10/0x10
<4> [55.444865] ret_from_fork+0x3bd/0x470
<4> [55.444868] ? __pfx_kthread+0x10/0x10
<4> [55.444870] ret_from_fork_asm+0x1a/0x30
<4> [55.444878] </TASK>
<4> [55.444879] irq event stamp: 438963
<4> [55.444880] hardirqs last enabled at (438969): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.444883] hardirqs last disabled at (438974): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.444884] softirqs last enabled at (438202): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.444888] softirqs last disabled at (438099): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.444890] ---[ end trace 0000000000000000 ]---
<6> [55.444892] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.444975] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.444981] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.445050] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.445160] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.445267] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.445485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.445584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.445678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.445766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.445853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.445936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.446020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.446105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.446187] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.446286] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.446384] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.447416] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.457079] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.457330] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.458298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.458382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.458460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.458539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.458616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.458692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.458766] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.458840] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.458915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.458987] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.459080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.459154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.459229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.459302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.459374] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.459447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.459520] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.459593] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.459670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.459754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.459837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.459917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.460001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.460080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.460161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.460234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.460305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.460377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.460449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.460524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.460600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.460676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.460751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.460826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.460905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.460989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.461070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.461146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.461223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.461300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.461378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.461454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.461529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.461604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.461680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.461755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.461828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.461899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.461978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.462052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.462128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.462199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.462272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.462344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.462417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.462489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.462562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.462633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.462703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.462776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.462848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.462925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.462997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.463070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.463143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.463216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.463286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.463355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.463430] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.463565] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.463569] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1324, lrc_seqno=1324, guc_id=0, flags=0x73 in no process [-1]
<7> [55.463571] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.463637] ------------[ cut here ]------------
<4> [55.463638] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.463639] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:7/709
<4> [55.463715] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.463779]
<4> [55.463781] CPU: 8 UID: 0 PID: 709 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.463784] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.463785] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.463786] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.463791] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.463865] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.463867] RSP: 0018:ffffc90001fdfca0 EFLAGS: 00010246
<4> [55.463869] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.463870] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.463871] RBP: ffffc90001fdfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.463873] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.463874] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.463875] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000
<4> [55.463877] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.463878] CR2: 0000732eb25a4000 CR3: 000000012441f001 CR4: 0000000000f72ef0
<4> [55.463879] PKRU: 55555554
<4> [55.463881] Call Trace:
<4> [55.463882] <TASK>
<4> [55.463885] ? lock_acquire+0xb0/0x300
<4> [55.463890] ? lock_release+0xd0/0x2b0
<4> [55.464106] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.464113] process_one_work+0x239/0x740
<4> [55.464119] worker_thread+0x200/0x3f0
<4> [55.464122] ? __pfx_worker_thread+0x10/0x10
<4> [55.464125] kthread+0x10d/0x150
<4> [55.464127] ? __pfx_kthread+0x10/0x10
<4> [55.464130] ret_from_fork+0x3bd/0x470
<4> [55.464132] ? __pfx_kthread+0x10/0x10
<4> [55.464135] ret_from_fork_asm+0x1a/0x30
<4> [55.464143] </TASK>
<4> [55.464144] irq event stamp: 442363
<4> [55.464145] hardirqs last enabled at (442369): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.464147] hardirqs last disabled at (442374): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.464149] softirqs last enabled at (441404): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.464152] softirqs last disabled at (441399): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.464154] ---[ end trace 0000000000000000 ]---
<6> [55.464156] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.464229] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.464235] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.465722] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.465830] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.465953] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.466182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.466280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.466378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.466466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.466554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.466639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.466725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.466810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.466926] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.467026] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.467118] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.468150] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.478522] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.478780] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.479786] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.479871] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.479955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.480036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.480113] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.480187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.480262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.480336] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.480409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.480493] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.480568] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.480642] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.480714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.480789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.480862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.480934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.481007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.481079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.481149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.481233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.481319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.481399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.481495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.481576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.481655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.481731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.481806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.481881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.481956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.482032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.482112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.482190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.482266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.482341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.482426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.482510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.482591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.482673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.482754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.482831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.482909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.482990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.483067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.483144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.483222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.483299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.483376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.483474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.483549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.483625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.483701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.483775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.483848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.483922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.483995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.484070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.484144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.484220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.484296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.484382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.484463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.484539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.484614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.484688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.484763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.484838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.484914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.484986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.485061] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.485218] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.485222] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1324, lrc_seqno=1324, guc_id=0, flags=0x73 in no process [-1]
<7> [55.485225] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.485291] ------------[ cut here ]------------
<4> [55.485292] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.485293] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:7/709
<4> [55.485382] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.485449]
<4> [55.485452] CPU: 1 UID: 0 PID: 709 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.485455] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.485456] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.485457] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.485463] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.485535] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.485537] RSP: 0018:ffffc90001fdfca0 EFLAGS: 00010246
<4> [55.485539] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.485540] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.485542] RBP: ffffc90001fdfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.485543] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.485544] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.485545] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000
<4> [55.485547] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.485548] CR2: 0000732eb25a5000 CR3: 000000000344a003 CR4: 0000000000f72ef0
<4> [55.485550] PKRU: 55555554
<4> [55.485551] Call Trace:
<4> [55.485552] <TASK>
<4> [55.485556] ? lock_acquire+0xb0/0x300
<4> [55.485561] ? lock_release+0xd0/0x2b0
<4> [55.485566] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.485572] process_one_work+0x239/0x740
<4> [55.485579] worker_thread+0x200/0x3f0
<4> [55.485582] ? __pfx_worker_thread+0x10/0x10
<4> [55.485585] kthread+0x10d/0x150
<4> [55.485587] ? __pfx_kthread+0x10/0x10
<4> [55.485590] ret_from_fork+0x3bd/0x470
<4> [55.485592] ? __pfx_kthread+0x10/0x10
<4> [55.485595] ret_from_fork_asm+0x1a/0x30
<4> [55.485602] </TASK>
<4> [55.485603] irq event stamp: 445815
<4> [55.485605] hardirqs last enabled at (445821): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.485607] hardirqs last disabled at (445826): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.485609] softirqs last enabled at (444840): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.485611] softirqs last disabled at (444833): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.485614] ---[ end trace 0000000000000000 ]---
<5> [55.486710] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1325, lrc_seqno=1325, guc_id=0, flags=0x73 in no process [-1]
<7> [55.486662] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.486716] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.486790] ------------[ cut here ]------------
<4> [55.486791] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<7> [55.486770] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<4> [55.486792] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:7/709
<4> [55.486876] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.486941]
<4> [55.486943] CPU: 5 UID: 0 PID: 709 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.486946] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.486947] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.486949] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.486954] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.487030] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.487031] RSP: 0018:ffffc90001fdfca0 EFLAGS: 00010246
<4> [55.487034] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.487035] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.487036] RBP: ffffc90001fdfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.487038] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.487039] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.487040] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000
<4> [55.487042] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.487043] CR2: 000079d50a742098 CR3: 000000012441f001 CR4: 0000000000f72ef0
<4> [55.487044] PKRU: 55555554
<4> [55.487046] Call Trace:
<4> [55.487047] <TASK>
<4> [55.487050] ? lock_acquire+0xb0/0x300
<4> [55.487056] ? lock_release+0xd0/0x2b0
<4> [55.487060] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.487066] process_one_work+0x239/0x740
<4> [55.487072] worker_thread+0x200/0x3f0
<4> [55.487076] ? __pfx_worker_thread+0x10/0x10
<4> [55.487078] kthread+0x10d/0x150
<4> [55.487080] ? __pfx_kthread+0x10/0x10
<4> [55.487083] ret_from_fork+0x3bd/0x470
<4> [55.487085] ? __pfx_kthread+0x10/0x10
<4> [55.487088] ret_from_fork_asm+0x1a/0x30
<4> [55.487095] </TASK>
<4> [55.487097] irq event stamp: 446675
<4> [55.487098] hardirqs last enabled at (446681): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.487100] hardirqs last disabled at (446686): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.487102] softirqs last enabled at (444840): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.487105] softirqs last disabled at (444833): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.487107] ---[ end trace 0000000000000000 ]---
<6> [55.487109] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.487183] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.487189] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.487604] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.487837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.487934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.488049] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [55.488029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.488122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.488210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.488308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.488397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.488485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.488567] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.488666] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.488759] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.489817] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.499962] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.500244] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.501224] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.501309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.501388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.501468] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.501546] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.501623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.501700] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.501775] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.501849] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.501951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.502026] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.502101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.502175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.502249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.502322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.502393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.502465] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.502537] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.502608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.502694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.502775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.502854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.502944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.503021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.503101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.503179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.503255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.503329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.503404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.503480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.503556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.503632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.503710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.503787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.503878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.503960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.504042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.504119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.504196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.504271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.504348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.504422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.504497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.504573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.504649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.504724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.504799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.504886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.504963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.505039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.505117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.505192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.505266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.505339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.505413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.505488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.505563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.505636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.505709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.505785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.505869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.505942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.506015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.506086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.506160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.506233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.506305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.506375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.506450] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.506630] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.506634] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1325, lrc_seqno=1325, guc_id=0, flags=0x73 in no process [-1]
<7> [55.506637] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.506705] ------------[ cut here ]------------
<4> [55.506706] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.506707] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:7/709
<4> [55.506786] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.506853]
<4> [55.506855] CPU: 5 UID: 0 PID: 709 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.506858] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.506859] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.506860] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.506866] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.506938] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.506940] RSP: 0018:ffffc90001fdfca0 EFLAGS: 00010246
<4> [55.506942] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.506944] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.506945] RBP: ffffc90001fdfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.506946] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.506947] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.506949] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000
<4> [55.506950] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.506952] CR2: 000079d50a742098 CR3: 000000012441f001 CR4: 0000000000f72ef0
<4> [55.506953] PKRU: 55555554
<4> [55.506954] Call Trace:
<4> [55.506955] <TASK>
<4> [55.506959] ? lock_acquire+0xb0/0x300
<4> [55.506964] ? lock_release+0xd0/0x2b0
<4> [55.506969] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.506975] process_one_work+0x239/0x740
<4> [55.506981] worker_thread+0x200/0x3f0
<4> [55.506984] ? __pfx_worker_thread+0x10/0x10
<4> [55.506987] kthread+0x10d/0x150
<4> [55.506989] ? __pfx_kthread+0x10/0x10
<4> [55.506992] ret_from_fork+0x3bd/0x470
<4> [55.506994] ? __pfx_kthread+0x10/0x10
<4> [55.506997] ret_from_fork_asm+0x1a/0x30
<4> [55.507005] </TASK>
<4> [55.507006] irq event stamp: 450059
<4> [55.507007] hardirqs last enabled at (450065): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.507009] hardirqs last disabled at (450070): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.507011] softirqs last enabled at (448904): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.507014] softirqs last disabled at (448897): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.507016] ---[ end trace 0000000000000000 ]---
<6> [55.507018] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.507090] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.507096] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.507504] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.507719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.507819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.507912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.507997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.508084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.508166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.508248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.508334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.508413] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.508508] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.508598] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.509629] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.520087] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.520346] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.521634] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.521715] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.521793] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.521872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.521951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.522027] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.522101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.522175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.522247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.522319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.522398] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.522471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.522545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.522619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.522692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.522767] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.522840] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.522914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.522990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.523073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.523156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.523236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.523312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.523401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.523477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.523552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.523626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.523699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.523776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.523854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.523930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.524006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.524082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.524156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.524236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.524321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.524404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.524482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.524558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.524633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.524708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.524783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.524856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.524929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.525004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.525080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.525154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.525227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.525303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.525377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.525455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.525528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.525602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.525676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.525748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.525822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.525895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.525967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.526038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.526114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.526187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.526262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.526349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.526423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.526499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.526574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.526647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.526719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.526796] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.526958] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.526963] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1325, lrc_seqno=1325, guc_id=0, flags=0x73 in no process [-1]
<7> [55.526965] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.527031] ------------[ cut here ]------------
<4> [55.527032] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.527034] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:7/709
<4> [55.527112] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.527176]
<4> [55.527178] CPU: 5 UID: 0 PID: 709 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.527181] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.527182] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.527183] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.527188] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.527267] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.527269] RSP: 0018:ffffc90001fdfca0 EFLAGS: 00010246
<4> [55.527272] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.527273] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.527275] RBP: ffffc90001fdfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.527276] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.527277] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.527279] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000
<4> [55.527281] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.527282] CR2: 000079d50a742098 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [55.527284] PKRU: 55555554
<4> [55.527285] Call Trace:
<4> [55.527286] <TASK>
<4> [55.527290] ? lock_acquire+0xb0/0x300
<4> [55.527294] ? lock_release+0xd0/0x2b0
<4> [55.527299] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.527305] process_one_work+0x239/0x740
<4> [55.527312] worker_thread+0x200/0x3f0
<4> [55.527315] ? __pfx_worker_thread+0x10/0x10
<4> [55.527317] kthread+0x10d/0x150
<4> [55.527320] ? __pfx_kthread+0x10/0x10
<4> [55.527323] ret_from_fork+0x3bd/0x470
<4> [55.527325] ? __pfx_kthread+0x10/0x10
<4> [55.527328] ret_from_fork_asm+0x1a/0x30
<4> [55.527336] </TASK>
<4> [55.527337] irq event stamp: 453411
<4> [55.527338] hardirqs last enabled at (453417): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.527340] hardirqs last disabled at (453422): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.527342] softirqs last enabled at (452458): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.527345] softirqs last disabled at (452453): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.527348] ---[ end trace 0000000000000000 ]---
<7> [55.528387] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.528504] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [55.528806] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1328, lrc_seqno=1328, guc_id=0, flags=0x73 in no process [-1]
<7> [55.528812] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.528901] ------------[ cut here ]------------
<4> [55.528902] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<7> [55.528924] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [55.528924] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<4> [55.528904] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:11/1198
<4> [55.529022] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.529121]
<4> [55.529124] CPU: 3 UID: 0 PID: 1198 Comm: kworker/u64:11 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.529127] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.529128] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<7> [55.529127] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [55.529127] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<4> [55.529130] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<7> [55.529163] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<4> [55.529137] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.529230] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.529231] RSP: 0000:ffffc90001903ca0 EFLAGS: 00010246
<4> [55.529234] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.529235] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.529237] RBP: ffffc90001903db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.529238] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.529240] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.529241] FS: 0000000000000000(0000) GS:ffff8888dae03000(0000) knlGS:0000000000000000
<4> [55.529243] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.529244] CR2: 000079d5212f0098 CR3: 000000000344a004 CR4: 0000000000f72ef0
<4> [55.529246] PKRU: 55555554
<4> [55.529247] Call Trace:
<4> [55.529248] <TASK>
<4> [55.529252] ? lock_acquire+0xb0/0x300
<4> [55.529258] ? lock_release+0xd0/0x2b0
<4> [55.529262] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.529269] process_one_work+0x239/0x740
<4> [55.529275] worker_thread+0x200/0x3f0
<4> [55.529278] ? __pfx_worker_thread+0x10/0x10
<4> [55.529281] kthread+0x10d/0x150
<4> [55.529283] ? __pfx_kthread+0x10/0x10
<4> [55.529286] ret_from_fork+0x3bd/0x470
<4> [55.529289] ? __pfx_kthread+0x10/0x10
<4> [55.529292] ret_from_fork_asm+0x1a/0x30
<4> [55.529299] </TASK>
<4> [55.529301] irq event stamp: 6053
<4> [55.529302] hardirqs last enabled at (6059): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.529304] hardirqs last disabled at (6064): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.529306] softirqs last enabled at (4928): [<ffffffff8133ad83>] kernel_fpu_end+0x53/0x70
<4> [55.529308] softirqs last disabled at (4926): [<ffffffff8133b494>] kernel_fpu_begin_mask+0xc4/0x120
<7> [55.529308] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 16.
<4> [55.529311] ---[ end trace 0000000000000000 ]---
<7> [55.529313] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Migration wasn't necessary.
<6> [55.529316] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.529400] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.529409] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.529460] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.529684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.529832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.529978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.530105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.530243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.530352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.530462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.530578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.530641] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [55.530664] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.530764] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.530856] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.531889] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.541869] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.542120] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.543108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.543193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.543273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.543352] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.543473] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.543580] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.543658] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.543733] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.543814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.543890] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.543965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.544039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.544113] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.544187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.544260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.544332] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.544404] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.544478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.544552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.544634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.544718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.544805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.544882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.544961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.545039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.545114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.545196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.545270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.545344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.545425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.545504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.545583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.545662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.545739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.545844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.545928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.546009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.546089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.546167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.546242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.546316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.546389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.546460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.546535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.546610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.546684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.546768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.546842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.546916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.546990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.547067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.547140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.547215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.547287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.547359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.547435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.547509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.547582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.547654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.547737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.547810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.547887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.547962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.548035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.548110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.548183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.548257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.548327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.548402] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.548560] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.548565] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1328, lrc_seqno=1328, guc_id=0, flags=0x73 in no process [-1]
<7> [55.548567] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.548633] ------------[ cut here ]------------
<4> [55.548634] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.548635] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:11/1198
<4> [55.548721] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.548787]
<4> [55.548790] CPU: 3 UID: 0 PID: 1198 Comm: kworker/u64:11 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.548792] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.548794] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.548795] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.548800] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.548872] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.548874] RSP: 0000:ffffc90001903ca0 EFLAGS: 00010246
<4> [55.548876] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.548878] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.548879] RBP: ffffc90001903db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.548880] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.548882] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.548883] FS: 0000000000000000(0000) GS:ffff8888dae03000(0000) knlGS:0000000000000000
<4> [55.548885] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.548886] CR2: 000079d5212f0098 CR3: 000000000344a004 CR4: 0000000000f72ef0
<4> [55.548887] PKRU: 55555554
<4> [55.548888] Call Trace:
<4> [55.548889] <TASK>
<4> [55.548894] ? lock_acquire+0xb0/0x300
<4> [55.548898] ? lock_release+0xd0/0x2b0
<4> [55.548903] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.548909] process_one_work+0x239/0x740
<4> [55.548915] worker_thread+0x200/0x3f0
<4> [55.548918] ? __pfx_worker_thread+0x10/0x10
<4> [55.548921] kthread+0x10d/0x150
<4> [55.548923] ? __pfx_kthread+0x10/0x10
<4> [55.548926] ret_from_fork+0x3bd/0x470
<4> [55.548928] ? __pfx_kthread+0x10/0x10
<4> [55.548931] ret_from_fork_asm+0x1a/0x30
<4> [55.548939] </TASK>
<4> [55.548940] irq event stamp: 9429
<4> [55.548941] hardirqs last enabled at (9435): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.548943] hardirqs last disabled at (9440): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.548945] softirqs last enabled at (8370): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.548948] softirqs last disabled at (8363): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.548950] ---[ end trace 0000000000000000 ]---
<6> [55.548952] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.549024] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.549031] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.550269] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.550374] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.550481] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.550722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.550820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.550918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.551008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.551094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.551178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.551261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.551347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.551431] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.551529] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.551629] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.552685] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.562335] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.562586] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.563641] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.563727] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.563807] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.563886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.563962] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.564036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.564109] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.564182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.564256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.564347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.564433] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.564508] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.564583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.564659] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.564733] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.564807] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.564881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.564954] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.565029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.565113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.565198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.565293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.565382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.565460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.565537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.565611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.565685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.565761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.565837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.565914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.565991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.566065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.566140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.566215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.566315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.566408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.566489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.566570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.566647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.566721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.566795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.566868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.566941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.567018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.567097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.567173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.567264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.567351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.567429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.567506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.567585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.567659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.567733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.567807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.567879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.567953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.568026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.568096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.568169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.568268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.568354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.568432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.568506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.568580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.568656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.568729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.568800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.568872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.568947] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.569107] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.569112] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1328, lrc_seqno=1328, guc_id=0, flags=0x73 in no process [-1]
<7> [55.569115] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.569197] ------------[ cut here ]------------
<4> [55.569199] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.569202] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:2/121
<4> [55.569290] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.569356]
<4> [55.569358] CPU: 0 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.569361] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.569362] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.569364] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.569369] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.569442] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.569444] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246
<4> [55.569446] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.569448] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.569449] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.569450] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.569451] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.569453] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000
<4> [55.569454] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.569456] CR2: 000079d50b68a000 CR3: 000000000344a004 CR4: 0000000000f72ef0
<4> [55.569457] PKRU: 55555554
<4> [55.569458] Call Trace:
<4> [55.569459] <TASK>
<4> [55.569463] ? lock_acquire+0xb0/0x300
<4> [55.569469] ? lock_release+0xd0/0x2b0
<4> [55.569473] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.569479] process_one_work+0x239/0x740
<4> [55.569486] worker_thread+0x200/0x3f0
<4> [55.569489] ? __pfx_worker_thread+0x10/0x10
<4> [55.569492] kthread+0x10d/0x150
<4> [55.569494] ? __pfx_kthread+0x10/0x10
<4> [55.569497] ret_from_fork+0x3bd/0x470
<4> [55.569499] ? __pfx_kthread+0x10/0x10
<4> [55.569502] ret_from_fork_asm+0x1a/0x30
<4> [55.569509] </TASK>
<4> [55.569510] irq event stamp: 73801
<4> [55.569511] hardirqs last enabled at (73807): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.569514] hardirqs last disabled at (73812): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.569516] softirqs last enabled at (72826): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.569518] softirqs last disabled at (72819): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.569521] ---[ end trace 0000000000000000 ]---
<5> [55.570100] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1342, lrc_seqno=1342, guc_id=0, flags=0x73 in no process [-1]
<7> [55.570110] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<7> [55.570317] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [55.570318] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [55.570317] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [55.570317] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [55.570407] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<4> [55.570529] ------------[ cut here ]------------
<4> [55.570532] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.570534] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:11/1198
<4> [55.570662] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.570740]
<4> [55.570744] CPU: 5 UID: 0 PID: 1198 Comm: kworker/u64:11 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.570747] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.570748] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.570750] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.570758] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.570838] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.570840] RSP: 0018:ffffc90001903ca0 EFLAGS: 00010246
<4> [55.570842] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.570844] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.570845] RBP: ffffc90001903db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.570846] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.570847] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.570849] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000
<4> [55.570850] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.570852] CR2: 000079d50a742098 CR3: 0000000123785006 CR4: 0000000000f72ef0
<4> [55.570853] PKRU: 55555554
<4> [55.570854] Call Trace:
<4> [55.570855] <TASK>
<4> [55.570859] ? lock_acquire+0xb0/0x300
<4> [55.570864] ? lock_release+0xd0/0x2b0
<4> [55.570869] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.570875] process_one_work+0x239/0x740
<4> [55.570881] worker_thread+0x200/0x3f0
<4> [55.570884] ? __pfx_worker_thread+0x10/0x10
<4> [55.570887] kthread+0x10d/0x150
<4> [55.570889] ? __pfx_kthread+0x10/0x10
<4> [55.570892] ret_from_fork+0x3bd/0x470
<4> [55.570894] ? __pfx_kthread+0x10/0x10
<4> [55.570897] ret_from_fork_asm+0x1a/0x30
<4> [55.570905] </TASK>
<4> [55.570906] irq event stamp: 10963
<4> [55.570907] hardirqs last enabled at (10969): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.570909] hardirqs last disabled at (10974): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.570911] softirqs last enabled at (10198): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.570914] softirqs last disabled at (10191): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.570916] ---[ end trace 0000000000000000 ]---
<6> [55.570918] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.570996] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.571004] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.570962] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.571069] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.571231] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.571461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.571559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.571657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.571747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.571836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.571921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.572007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.572110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.572197] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.572308] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.572402] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.573437] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.583775] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.584027] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.585010] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.585091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.585171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.585250] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.585328] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.585405] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.585481] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.585557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.585635] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.585712] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.585804] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.585877] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.585951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.586024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.586096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.586169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.586242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.586312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.586383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.586465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.586546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.586625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.586714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.586792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.586869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.586943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.587018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.587092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.587168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.587245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.587324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.587401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.587478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.587554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.587634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.587731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.587819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.587901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.587981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.588056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.588130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.588205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.588277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.588353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.588429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.588504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.588580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.588657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.588730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.588805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.588883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.588958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.589032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.589105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.589181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.589260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.589338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.589413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.589486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.589562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.589640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.589715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.589789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.589862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.589937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.590012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.590085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.590157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.590231] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.590393] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.590397] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1342, lrc_seqno=1342, guc_id=0, flags=0x73 in no process [-1]
<7> [55.590400] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.590466] ------------[ cut here ]------------
<4> [55.590467] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.590469] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:2/121
<4> [55.590545] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.590630]
<4> [55.590632] CPU: 6 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.590635] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.590637] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.590638] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.590644] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.590717] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.590718] RSP: 0000:ffffc90000563ca0 EFLAGS: 00010246
<4> [55.590721] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.590722] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.590723] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.590725] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.590726] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.590727] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000
<4> [55.590729] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.590730] CR2: 000079d503ffe000 CR3: 0000000123785002 CR4: 0000000000f72ef0
<4> [55.590732] PKRU: 55555554
<4> [55.590733] Call Trace:
<4> [55.590734] <TASK>
<4> [55.590738] ? lock_acquire+0xb0/0x300
<4> [55.590744] ? lock_release+0xd0/0x2b0
<4> [55.590748] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.590754] process_one_work+0x239/0x740
<4> [55.590761] worker_thread+0x200/0x3f0
<4> [55.590764] ? __pfx_worker_thread+0x10/0x10
<4> [55.590767] kthread+0x10d/0x150
<4> [55.590769] ? __pfx_kthread+0x10/0x10
<4> [55.590772] ret_from_fork+0x3bd/0x470
<4> [55.590774] ? __pfx_kthread+0x10/0x10
<4> [55.590777] ret_from_fork_asm+0x1a/0x30
<4> [55.590784] </TASK>
<4> [55.590785] irq event stamp: 77561
<4> [55.590786] hardirqs last enabled at (77567): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.590788] hardirqs last disabled at (77572): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.590790] softirqs last enabled at (76416): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.590793] softirqs last disabled at (76409): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.590795] ---[ end trace 0000000000000000 ]---
<6> [55.590797] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.590869] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.590875] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.592118] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.592229] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.592336] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.592569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.592668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.592767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.592859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.592947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.593032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.593116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.593202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.593284] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.593383] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.593475] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.594524] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.604250] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.604504] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.605725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.605822] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.605908] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.605992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.606074] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.606153] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.606246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.606324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.606401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.606480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.606555] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.606632] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.606705] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.606779] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.606853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.606926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.606998] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.607069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.607141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.607236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.607321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.607401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.607481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.607562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.607641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.607719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.607793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.607868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.607942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.608019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.608097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.608182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.608260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.608338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.608421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.608502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.608582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.608660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.608736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.608810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.608885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.608960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.609032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.609110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.609185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.609260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.609335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.609410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.609485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.609560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.609637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.609709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.609783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.609855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.609927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.610001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.610074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.610159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.610230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.610305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.610377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.610449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.610523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.610595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.610669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.610742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.610814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.610885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.610961] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.611293] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.611299] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1342, lrc_seqno=1342, guc_id=0, flags=0x73 in no process [-1]
<7> [55.611301] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.611368] ------------[ cut here ]------------
<4> [55.611370] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.611371] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:7/709
<4> [55.611448] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.611514]
<4> [55.611517] CPU: 2 UID: 0 PID: 709 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.611520] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.611521] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.611522] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.611528] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.611601] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.611602] RSP: 0018:ffffc90001fdfca0 EFLAGS: 00010246
<4> [55.611605] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.611606] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.611608] RBP: ffffc90001fdfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.611609] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.611610] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.611611] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000
<4> [55.611613] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.611614] CR2: 00007a422fb34640 CR3: 000000012441f001 CR4: 0000000000f72ef0
<4> [55.611616] PKRU: 55555554
<4> [55.611617] Call Trace:
<4> [55.611618] <TASK>
<4> [55.611622] ? lock_acquire+0xb0/0x300
<4> [55.611627] ? lock_release+0xd0/0x2b0
<4> [55.611632] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.611638] process_one_work+0x239/0x740
<4> [55.611645] worker_thread+0x200/0x3f0
<4> [55.611648] ? __pfx_worker_thread+0x10/0x10
<4> [55.611651] kthread+0x10d/0x150
<4> [55.611653] ? __pfx_kthread+0x10/0x10
<4> [55.611656] ret_from_fork+0x3bd/0x470
<4> [55.611658] ? __pfx_kthread+0x10/0x10
<4> [55.611661] ret_from_fork_asm+0x1a/0x30
<4> [55.611668] </TASK>
<4> [55.611670] irq event stamp: 457413
<4> [55.611671] hardirqs last enabled at (457419): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.611673] hardirqs last disabled at (457424): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.611675] softirqs last enabled at (456050): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.611678] softirqs last disabled at (456041): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.611680] ---[ end trace 0000000000000000 ]---
<5> [55.612408] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1352, lrc_seqno=1352, guc_id=0, flags=0x73 in no process [-1]
<7> [55.612416] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.612602] ------------[ cut here ]------------
<4> [55.612603] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<7> [55.612614] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [55.612621] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [55.612624] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [55.612630] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [55.612655] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<4> [55.612606] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#13: kworker/u64:9/992
<4> [55.612740] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.612842]
<4> [55.612847] CPU: 13 UID: 0 PID: 992 Comm: kworker/u64:9 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.612851] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.612853] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.612855] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<7> [55.612797] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<4> [55.612865] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.612989] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.612992] RSP: 0018:ffffc90003203ca0 EFLAGS: 00010246
<7> [55.612945] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<4> [55.612996] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.612998] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.612999] RBP: ffffc90003203db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.613001] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.613013] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.613015] FS: 0000000000000000(0000) GS:ffff8888db303000(0000) knlGS:0000000000000000
<4> [55.613017] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.613019] CR2: 0000732e9c062058 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [55.613021] PKRU: 55555554
<4> [55.613023] Call Trace:
<4> [55.613024] <TASK>
<4> [55.613030] ? lock_acquire+0xb0/0x300
<4> [55.613038] ? lock_release+0xd0/0x2b0
<4> [55.613045] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.613055] process_one_work+0x239/0x740
<4> [55.613070] worker_thread+0x200/0x3f0
<4> [55.613075] ? __pfx_worker_thread+0x10/0x10
<4> [55.613234] kthread+0x10d/0x150
<4> [55.613237] ? __pfx_kthread+0x10/0x10
<4> [55.613242] ret_from_fork+0x3bd/0x470
<4> [55.613246] ? __pfx_kthread+0x10/0x10
<4> [55.613250] ret_from_fork_asm+0x1a/0x30
<4> [55.613263] </TASK>
<4> [55.613264] irq event stamp: 566365
<4> [55.613266] hardirqs last enabled at (566371): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.613269] hardirqs last disabled at (566376): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.613272] softirqs last enabled at (566246): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.613276] softirqs last disabled at (566239): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.613279] ---[ end trace 0000000000000000 ]---
<7> [55.613068] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<6> [55.613291] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.613377] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.613385] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.613338] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.613388] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.613451] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.613543] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.613547] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.613630] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.613715] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.613719] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.613798] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.613881] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.613948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.613963] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.614059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.614091] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.614157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.614182] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.614247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.614266] xe 0000:03:00.0: [drm:xe_svm_range_needs_migrate_to_vram [xe]] Range is already in VRAM
<7> [55.614338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.614430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.614519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.614606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.614688] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.614787] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.614880] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.615917] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.616838] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [55.625685] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.625946] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.626923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.627024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.627107] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.627189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.627268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.627346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.627423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.627499] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.627571] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.627655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.627731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.627804] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.627878] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.627951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.628024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.628097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.628170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.628244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.628315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.628399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.628480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.628563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.628656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.628735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.628813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.628887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.628962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.629037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.629112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.629189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.629265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.629340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.629416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.629490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.629579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.629659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.629741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.629819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.629897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.629971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.630045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.630119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.630191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.630267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.630343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.630417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.630492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.630574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.630649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.630724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.630800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.630874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.630948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.631022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.631093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.631168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.631240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.631312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.631384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.631459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.631540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.631618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.631691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.631763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.631843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.631920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.631994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.632066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.632141] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.632318] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.632323] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1352, lrc_seqno=1352, guc_id=0, flags=0x73 in no process [-1]
<7> [55.632325] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.632391] ------------[ cut here ]------------
<4> [55.632392] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.632393] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:7/709
<4> [55.632470] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.632551]
<4> [55.632554] CPU: 4 UID: 0 PID: 709 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.632557] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.632558] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.632559] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.632565] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.632639] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.632641] RSP: 0018:ffffc90001fdfca0 EFLAGS: 00010246
<4> [55.632643] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.632645] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.632646] RBP: ffffc90001fdfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.632647] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.632648] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.632650] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000
<4> [55.632651] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.632653] CR2: 0000732eb25a8000 CR3: 000000012441f003 CR4: 0000000000f72ef0
<4> [55.632654] PKRU: 55555554
<4> [55.632655] Call Trace:
<4> [55.632656] <TASK>
<4> [55.632660] ? lock_acquire+0xb0/0x300
<4> [55.632666] ? lock_release+0xd0/0x2b0
<4> [55.632670] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.632676] process_one_work+0x239/0x740
<4> [55.632683] worker_thread+0x200/0x3f0
<4> [55.632686] ? __pfx_worker_thread+0x10/0x10
<4> [55.632689] kthread+0x10d/0x150
<4> [55.632691] ? __pfx_kthread+0x10/0x10
<4> [55.632694] ret_from_fork+0x3bd/0x470
<4> [55.632696] ? __pfx_kthread+0x10/0x10
<4> [55.632699] ret_from_fork_asm+0x1a/0x30
<4> [55.632707] </TASK>
<4> [55.632708] irq event stamp: 461077
<4> [55.632709] hardirqs last enabled at (461083): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.632711] hardirqs last disabled at (461088): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.632713] softirqs last enabled at (459930): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.632716] softirqs last disabled at (459925): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.632719] ---[ end trace 0000000000000000 ]---
<6> [55.632721] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.632793] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.632799] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.633821] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.633930] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.634037] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.634257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.634346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.634437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.634539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.634625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.634711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.634796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.634884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.634965] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.635063] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.635155] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.636198] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.646148] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.646400] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.647361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.647444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.647522] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.647601] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.647679] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.647755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.647829] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.647904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.647978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.648051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.648142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.648218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.648290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.648362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.648433] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.648506] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.648579] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.648651] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.648725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.648807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.648890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.648972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.649048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.649143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.649221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.649294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.649367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.649441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.649513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.649588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.649669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.649749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.649825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.649901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.649982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.650069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.650151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.650231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.650307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.650382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.650456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.650530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.650603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.650677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.650752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.650827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.650902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.650975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.651062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.651138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.651217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.651291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.651363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.651437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.651507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.651579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.651650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.651722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.651792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.651866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.651936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.652021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.652102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.652181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.652259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.652335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.652409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.652482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.652559] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.652728] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.652732] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1352, lrc_seqno=1352, guc_id=0, flags=0x73 in no process [-1]
<7> [55.652735] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.652801] ------------[ cut here ]------------
<4> [55.652803] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.652804] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:0/12
<4> [55.652878] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.652943]
<4> [55.652945] CPU: 1 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.652948] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.652949] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.652951] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.652956] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.653049] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.653051] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [55.653054] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.653055] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.653057] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.653058] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.653060] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.653061] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000
<4> [55.653063] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.653065] CR2: 0000573dd7f36020 CR3: 000000000344a003 CR4: 0000000000f72ef0
<4> [55.653066] PKRU: 55555554
<4> [55.653067] Call Trace:
<4> [55.653068] <TASK>
<4> [55.653073] ? lock_acquire+0xb0/0x300
<4> [55.653078] ? lock_release+0xd0/0x2b0
<4> [55.653083] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.653088] process_one_work+0x239/0x740
<4> [55.653095] worker_thread+0x200/0x3f0
<4> [55.653098] ? __pfx_worker_thread+0x10/0x10
<4> [55.653101] kthread+0x10d/0x150
<4> [55.653103] ? __pfx_kthread+0x10/0x10
<4> [55.653107] ret_from_fork+0x3bd/0x470
<4> [55.653109] ? __pfx_kthread+0x10/0x10
<4> [55.653112] ret_from_fork_asm+0x1a/0x30
<4> [55.653119] </TASK>
<4> [55.653121] irq event stamp: 281211
<4> [55.653122] hardirqs last enabled at (281217): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.653124] hardirqs last disabled at (281222): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.653126] softirqs last enabled at (279980): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.653129] softirqs last disabled at (279973): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.653131] ---[ end trace 0000000000000000 ]---
<5> [55.653657] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1365, lrc_seqno=1365, guc_id=0, flags=0x73 in no process [-1]
<7> [55.653695] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [55.653738] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [55.653781] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [55.653828] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [55.653665] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<7> [55.653901] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [55.653907] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<4> [55.654072] ------------[ cut here ]------------
<4> [55.654074] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.654077] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#12: kworker/u64:3/194
<4> [55.654263] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.654364]
<4> [55.654368] CPU: 12 UID: 0 PID: 194 Comm: kworker/u64:3 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.654372] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.654374] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.654376] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.654385] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.654507] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.654510] RSP: 0018:ffffc900015cfca0 EFLAGS: 00010246
<4> [55.654513] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.654515] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.654517] RBP: ffffc900015cfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.654518] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.654520] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.654522] FS: 0000000000000000(0000) GS:ffff8888db283000(0000) knlGS:0000000000000000
<4> [55.654524] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.654526] CR2: 00005dbbac6bbd08 CR3: 000000000344a001 CR4: 0000000000f72ef0
<4> [55.654529] PKRU: 55555554
<4> [55.654530] Call Trace:
<4> [55.654532] <TASK>
<4> [55.654538] ? lock_acquire+0xb0/0x300
<4> [55.654546] ? lock_release+0xd0/0x2b0
<4> [55.654553] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.654563] process_one_work+0x239/0x740
<4> [55.654573] worker_thread+0x200/0x3f0
<4> [55.654578] ? __pfx_worker_thread+0x10/0x10
<4> [55.654582] kthread+0x10d/0x150
<4> [55.654585] ? __pfx_kthread+0x10/0x10
<4> [55.654589] ret_from_fork+0x3bd/0x470
<4> [55.654592] ? __pfx_kthread+0x10/0x10
<4> [55.654596] ret_from_fork_asm+0x1a/0x30
<4> [55.654608] </TASK>
<4> [55.654610] irq event stamp: 256113
<4> [55.654612] hardirqs last enabled at (256119): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.654615] hardirqs last disabled at (256124): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.654617] softirqs last enabled at (255346): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.654621] softirqs last disabled at (255337): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.654624] ---[ end trace 0000000000000000 ]---
<7> [55.654579] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.654686] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<6> [55.654856] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.654956] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.654967] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.655376] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.655599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.655695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.655789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.655877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.655981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.656066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.656151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.656238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.656318] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.656414] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.656507] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.657539] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.667598] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.667849] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.668951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.669041] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.669120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.669198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.669274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.669349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.669425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.669498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.669587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.669680] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.669756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.669830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.669904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.669976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.670053] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.670132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.670207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.670282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.670356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.670440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.670529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.670635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.670718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.670799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.670883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.670963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.671041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.671117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.671194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.671271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.671351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.671427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.671511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.671605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.671689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.671771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.671851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.671929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.672005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.672079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.672153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.672226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.672304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.672381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.672465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.672568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.672645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.672725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.672803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.672880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.672960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.673036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.673110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.673185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.673257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.673331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.673407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.673494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.673586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.673665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.673739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.673813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.673888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.673959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.674033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.674106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.674179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.674252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.674328] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.674501] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.674506] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1365, lrc_seqno=1365, guc_id=0, flags=0x73 in no process [-1]
<7> [55.674509] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.674574] ------------[ cut here ]------------
<4> [55.674575] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.674577] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:3/194
<4> [55.674652] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.674718]
<4> [55.674721] CPU: 9 UID: 0 PID: 194 Comm: kworker/u64:3 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.674724] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.674725] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.674726] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.674732] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.674806] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.674808] RSP: 0018:ffffc900015cfca0 EFLAGS: 00010246
<4> [55.674810] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.674811] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.674813] RBP: ffffc900015cfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.674814] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.674815] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.674816] FS: 0000000000000000(0000) GS:ffff8888db103000(0000) knlGS:0000000000000000
<4> [55.674818] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.674819] CR2: 000079d509d32098 CR3: 0000000123785005 CR4: 0000000000f72ef0
<4> [55.674821] PKRU: 55555554
<4> [55.674822] Call Trace:
<4> [55.674823] <TASK>
<4> [55.674827] ? lock_acquire+0xb0/0x300
<4> [55.674832] ? lock_release+0xd0/0x2b0
<4> [55.674837] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.674842] process_one_work+0x239/0x740
<4> [55.674849] worker_thread+0x200/0x3f0
<4> [55.674852] ? __pfx_worker_thread+0x10/0x10
<4> [55.674854] kthread+0x10d/0x150
<4> [55.674857] ? __pfx_kthread+0x10/0x10
<4> [55.674860] ret_from_fork+0x3bd/0x470
<4> [55.674862] ? __pfx_kthread+0x10/0x10
<4> [55.674864] ret_from_fork_asm+0x1a/0x30
<4> [55.674872] </TASK>
<4> [55.674873] irq event stamp: 259499
<4> [55.674874] hardirqs last enabled at (259505): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.674876] hardirqs last disabled at (259510): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.674878] softirqs last enabled at (258606): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.674881] softirqs last disabled at (258599): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.674883] ---[ end trace 0000000000000000 ]---
<6> [55.674885] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.674959] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.674965] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.676312] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.676432] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.676541] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.676765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.676858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.676954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.677044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.677133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.677221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.677307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.677409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.677489] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.677585] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.677675] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.678705] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.689031] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.689283] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.690406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.690488] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.690566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.690642] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.690717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.690790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.690862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.690937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.691023] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.691096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.691168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.691240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.691313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.691386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.691457] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.691528] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.691599] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.691672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.691745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.691828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.691910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.692003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.692081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.692160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.692236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.692311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.692384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.692457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.692531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.692608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.692687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.692764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.692839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.692925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.693010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.693094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.693175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.693253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.693331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.693406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.693480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.693553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.693626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.693700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.693778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.693854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.693940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.694015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.694090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.694165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.694241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.694314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.694387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.694459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.694531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.694604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.694683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.694758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.694831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.694919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.694995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.695070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.695145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.695220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.695295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.695370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.695443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.695517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.695594] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.695757] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.695761] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1365, lrc_seqno=1365, guc_id=0, flags=0x73 in no process [-1]
<7> [55.695764] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.695829] ------------[ cut here ]------------
<4> [55.695831] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.695832] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:3/194
<4> [55.695922] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.695990]
<4> [55.695992] CPU: 8 UID: 0 PID: 194 Comm: kworker/u64:3 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.695995] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.695996] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.695997] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.696003] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.696075] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.696077] RSP: 0018:ffffc900015cfca0 EFLAGS: 00010246
<4> [55.696079] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.696081] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.696082] RBP: ffffc900015cfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.696083] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.696084] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.696086] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000
<4> [55.696087] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.696088] CR2: 000079d503c55000 CR3: 000000012441f001 CR4: 0000000000f72ef0
<4> [55.696090] PKRU: 55555554
<4> [55.696091] Call Trace:
<4> [55.696092] <TASK>
<4> [55.696096] ? lock_acquire+0xb0/0x300
<4> [55.696101] ? lock_release+0xd0/0x2b0
<4> [55.696106] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.696112] process_one_work+0x239/0x740
<4> [55.696118] worker_thread+0x200/0x3f0
<4> [55.696121] ? __pfx_worker_thread+0x10/0x10
<4> [55.696124] kthread+0x10d/0x150
<4> [55.696126] ? __pfx_kthread+0x10/0x10
<4> [55.696129] ret_from_fork+0x3bd/0x470
<4> [55.696131] ? __pfx_kthread+0x10/0x10
<4> [55.696134] ret_from_fork_asm+0x1a/0x30
<4> [55.696142] </TASK>
<4> [55.696143] irq event stamp: 262853
<4> [55.696144] hardirqs last enabled at (262859): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.696146] hardirqs last disabled at (262864): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.696148] softirqs last enabled at (261878): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.696151] softirqs last disabled at (261873): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.696153] ---[ end trace 0000000000000000 ]---
<5> [55.697210] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1377, lrc_seqno=1377, guc_id=0, flags=0x73 in no process [-1]
<7> [55.697216] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<7> [55.697205] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<4> [55.697340] ------------[ cut here ]------------
<4> [55.697342] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<7> [55.697368] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [55.697370] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [55.697376] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<4> [55.697344] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#13: kworker/u64:3/194
<7> [55.697370] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.697456] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [55.697462] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<4> [55.697471] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.697572]
<4> [55.697576] CPU: 13 UID: 0 PID: 194 Comm: kworker/u64:3 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.697580] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.697581] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.697584] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.697592] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.697713] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.697716] RSP: 0018:ffffc900015cfca0 EFLAGS: 00010246
<4> [55.697719] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.697721] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.697723] RBP: ffffc900015cfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.697724] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.697726] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.697728] FS: 0000000000000000(0000) GS:ffff8888db303000(0000) knlGS:0000000000000000
<4> [55.697730] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.697732] CR2: 0000732e9c062058 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [55.697734] PKRU: 55555554
<4> [55.697736] Call Trace:
<4> [55.697738] <TASK>
<4> [55.697744] ? lock_acquire+0xb0/0x300
<4> [55.697752] ? lock_release+0xd0/0x2b0
<4> [55.697759] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.697769] process_one_work+0x239/0x740
<4> [55.697780] worker_thread+0x200/0x3f0
<4> [55.697784] ? __pfx_worker_thread+0x10/0x10
<4> [55.697788] kthread+0x10d/0x150
<4> [55.697799] ? __pfx_kthread+0x10/0x10
<4> [55.697805] ret_from_fork+0x3bd/0x470
<4> [55.697808] ? __pfx_kthread+0x10/0x10
<4> [55.697812] ret_from_fork_asm+0x1a/0x30
<4> [55.697824] </TASK>
<4> [55.697826] irq event stamp: 264019
<4> [55.697828] hardirqs last enabled at (264025): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.697831] hardirqs last disabled at (264030): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.697834] softirqs last enabled at (263988): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.697838] softirqs last disabled at (263981): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.697841] ---[ end trace 0000000000000000 ]---
<6> [55.697844] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.697966] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.697977] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.698161] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [55.698150] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.698426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.698570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.698715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.698862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.699003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.699142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.699281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.699423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.699559] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.699709] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.699863] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.701136] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [55.701232] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.711470] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.711737] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.712791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.712887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.712971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.713056] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.713138] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.713215] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.713291] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.713366] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.713450] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.713523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.713598] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.713671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.713745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.713819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.713892] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.713965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.714036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.714108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.714182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.714267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.714349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.714444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.714520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.714596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.714673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.714747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.714820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.714894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.714969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.715048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.715126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.715202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.715279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.715357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.715440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.715523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.715604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.715688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.715769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.715846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.715923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.715997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.716070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.716144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.716219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.716295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.716381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.716457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.716531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.716606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.716683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.716757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.716832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.716909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.716984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.717061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.717136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.717208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.717282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.717391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.717465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.717541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.717615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.717690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.717765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.717844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.717917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.717990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.718067] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.718232] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.718237] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1377, lrc_seqno=1377, guc_id=0, flags=0x73 in no process [-1]
<7> [55.718240] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.718322] ------------[ cut here ]------------
<4> [55.718324] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.718325] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:3/194
<4> [55.718402] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.718467]
<4> [55.718469] CPU: 6 UID: 0 PID: 194 Comm: kworker/u64:3 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.718472] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.718473] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.718475] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.718480] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.718554] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.718556] RSP: 0018:ffffc900015cfca0 EFLAGS: 00010246
<4> [55.718558] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.718559] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.718561] RBP: ffffc900015cfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.718562] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.718563] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.718564] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000
<4> [55.718566] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.718567] CR2: 000079d503ffe000 CR3: 000000011e8d6004 CR4: 0000000000f72ef0
<4> [55.718569] PKRU: 55555554
<4> [55.718570] Call Trace:
<4> [55.718571] <TASK>
<4> [55.718575] ? lock_acquire+0xb0/0x300
<4> [55.718580] ? lock_release+0xd0/0x2b0
<4> [55.718585] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.718591] process_one_work+0x239/0x740
<4> [55.718597] worker_thread+0x200/0x3f0
<4> [55.718600] ? __pfx_worker_thread+0x10/0x10
<4> [55.718603] kthread+0x10d/0x150
<4> [55.718605] ? __pfx_kthread+0x10/0x10
<4> [55.718608] ret_from_fork+0x3bd/0x470
<4> [55.718610] ? __pfx_kthread+0x10/0x10
<4> [55.718613] ret_from_fork_asm+0x1a/0x30
<4> [55.718621] </TASK>
<4> [55.718622] irq event stamp: 267511
<4> [55.718623] hardirqs last enabled at (267517): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.718625] hardirqs last disabled at (267522): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.718627] softirqs last enabled at (266750): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.718629] softirqs last disabled at (266743): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.718632] ---[ end trace 0000000000000000 ]---
<6> [55.718634] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.718706] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.718712] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.719100] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.719330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.719418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.719510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.719599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.719686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.719772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.719855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.719941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.720022] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.720121] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.720216] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.721250] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.731710] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.731958] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.733108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.733189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.733265] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.733343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.733420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.733495] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.733569] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.733643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.733717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.733789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.733868] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.733945] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.734020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.734092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.734162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.734233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.734303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.734372] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.734441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.734522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.734601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.734680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.734758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.734842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.734918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.734992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.735067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.735139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.735213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.735289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.735367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.735442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.735519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.735595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.735679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.735759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.735847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.735926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.736004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.736079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.736153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.736228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.736301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.736374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.736450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.736525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.736599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.736671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.736743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.736825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.736902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.736977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.737051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.737124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.737197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.737272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.737344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.737418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.737491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.737573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.737650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.737725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.737808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.737882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.737957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.738031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.738109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.738185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.738264] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.738424] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.738428] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1377, lrc_seqno=1377, guc_id=0, flags=0x73 in no process [-1]
<7> [55.738430] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.738495] ------------[ cut here ]------------
<4> [55.738496] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.738497] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:3/194
<4> [55.738572] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.738636]
<4> [55.738638] CPU: 6 UID: 0 PID: 194 Comm: kworker/u64:3 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.738641] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.738642] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.738643] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.738649] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.738723] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.738728] RSP: 0018:ffffc900015cfca0 EFLAGS: 00010246
<4> [55.738731] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.738732] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.738734] RBP: ffffc900015cfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.738735] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.738736] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.738738] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000
<4> [55.738739] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.738741] CR2: 000079d503ffe000 CR3: 000000000344a006 CR4: 0000000000f72ef0
<4> [55.738743] PKRU: 55555554
<4> [55.738744] Call Trace:
<4> [55.738745] <TASK>
<4> [55.738749] ? lock_acquire+0xb0/0x300
<4> [55.738754] ? lock_release+0xd0/0x2b0
<4> [55.738759] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.738764] process_one_work+0x239/0x740
<4> [55.738771] worker_thread+0x200/0x3f0
<4> [55.738774] ? __pfx_worker_thread+0x10/0x10
<4> [55.738776] kthread+0x10d/0x150
<4> [55.738779] ? __pfx_kthread+0x10/0x10
<4> [55.738782] ret_from_fork+0x3bd/0x470
<4> [55.738784] ? __pfx_kthread+0x10/0x10
<4> [55.738787] ret_from_fork_asm+0x1a/0x30
<4> [55.738795] </TASK>
<4> [55.738796] irq event stamp: 270865
<4> [55.738797] hardirqs last enabled at (270871): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.738799] hardirqs last disabled at (270876): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.738801] softirqs last enabled at (269634): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.738804] softirqs last disabled at (269625): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.738807] ---[ end trace 0000000000000000 ]---
<7> [55.739826] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<5> [55.739896] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1391, lrc_seqno=1391, guc_id=0, flags=0x73 in no process [-1]
<7> [55.739898] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [55.739902] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<7> [55.739963] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [55.739931] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.739984] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<4> [55.740024] ------------[ cut here ]------------
<4> [55.740025] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<7> [55.740051] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [55.740058] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<4> [55.740027] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#13: kworker/u64:7/709
<7> [55.740115] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<4> [55.740154] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.740247]
<4> [55.740250] CPU: 13 UID: 0 PID: 709 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.740254] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.740256] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.740258] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.740266] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.740387] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.740389] RSP: 0018:ffffc90001fdfca0 EFLAGS: 00010246
<4> [55.740392] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.740394] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.740396] RBP: ffffc90001fdfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.740398] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.740399] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.740401] FS: 0000000000000000(0000) GS:ffff8888db303000(0000) knlGS:0000000000000000
<4> [55.740404] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.740406] CR2: 0000732e9c062058 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [55.740408] PKRU: 55555554
<4> [55.740409] Call Trace:
<4> [55.740411] <TASK>
<4> [55.740417] ? lock_acquire+0xb0/0x300
<4> [55.740425] ? lock_release+0xd0/0x2b0
<4> [55.740433] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.740443] process_one_work+0x239/0x740
<4> [55.740453] worker_thread+0x200/0x3f0
<4> [55.740458] ? __pfx_worker_thread+0x10/0x10
<4> [55.740461] kthread+0x10d/0x150
<4> [55.740464] ? __pfx_kthread+0x10/0x10
<4> [55.740469] ret_from_fork+0x3bd/0x470
<4> [55.740472] ? __pfx_kthread+0x10/0x10
<4> [55.740476] ret_from_fork_asm+0x1a/0x30
<4> [55.740488] </TASK>
<4> [55.740490] irq event stamp: 462895
<4> [55.740491] hardirqs last enabled at (462901): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.740494] hardirqs last disabled at (462906): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.740497] softirqs last enabled at (461908): [<ffffffff8133ad83>] kernel_fpu_end+0x53/0x70
<4> [55.740500] softirqs last disabled at (461906): [<ffffffff8133b494>] kernel_fpu_begin_mask+0xc4/0x120
<4> [55.740504] ---[ end trace 0000000000000000 ]---
<6> [55.740506] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.740627] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.740637] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.740761] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [55.741044] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.741319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.741462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.741607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.741754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.741894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.742031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.742169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.742310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.742446] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.742595] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.742768] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.743807] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.753354] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.753609] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.754606] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.754693] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.754773] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.754853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.754931] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.755007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.755082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.755156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.755230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.755310] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.755384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.755459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.755532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.755606] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.755678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.755750] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.755823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.755896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.755967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.756054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.756138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.756217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.756308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.756385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.756462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.756538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.756612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.756685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.756760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.756838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.756915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.756992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.757071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.757149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.757232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.757330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.757412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.757489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.757567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.757641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.757715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.757791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.757865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.757942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.758019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.758096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.758170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.758254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.758327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.758401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.758476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.758548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.758621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.758694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.758767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.758841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.758914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.758987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.759057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.759131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.759208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.759283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.759357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.759428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.759502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.759576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.759646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.759721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.759804] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.759941] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.759945] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1391, lrc_seqno=1391, guc_id=0, flags=0x73 in no process [-1]
<7> [55.759948] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.760013] ------------[ cut here ]------------
<4> [55.760015] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.760016] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:7/709
<4> [55.760094] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.760159]
<4> [55.760162] CPU: 2 UID: 0 PID: 709 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.760170] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.760173] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.760174] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.760180] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.760253] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.760254] RSP: 0018:ffffc90001fdfca0 EFLAGS: 00010246
<4> [55.760257] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.760258] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.760260] RBP: ffffc90001fdfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.760261] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.760262] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.760263] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000
<4> [55.760265] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.760266] CR2: 0000732eb25aa000 CR3: 000000012441f001 CR4: 0000000000f72ef0
<4> [55.760268] PKRU: 55555554
<4> [55.760269] Call Trace:
<4> [55.760270] <TASK>
<4> [55.760274] ? lock_acquire+0xb0/0x300
<4> [55.760279] ? lock_release+0xd0/0x2b0
<4> [55.760284] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.760289] process_one_work+0x239/0x740
<4> [55.760296] worker_thread+0x200/0x3f0
<4> [55.760299] ? __pfx_worker_thread+0x10/0x10
<4> [55.760302] kthread+0x10d/0x150
<4> [55.760304] ? __pfx_kthread+0x10/0x10
<4> [55.760307] ret_from_fork+0x3bd/0x470
<4> [55.760309] ? __pfx_kthread+0x10/0x10
<4> [55.760312] ret_from_fork_asm+0x1a/0x30
<4> [55.760319] </TASK>
<4> [55.760320] irq event stamp: 466299
<4> [55.760321] hardirqs last enabled at (466305): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.760324] hardirqs last disabled at (466310): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.760325] softirqs last enabled at (465246): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.760328] softirqs last disabled at (465241): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.760331] ---[ end trace 0000000000000000 ]---
<6> [55.760333] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.760405] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.760412] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.760797] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.761015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.761107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.761214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.761302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.761390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.761477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.761565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.761651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.761732] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.761831] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.761922] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.762956] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.772843] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.773093] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.774080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.774161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.774239] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.774318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.774397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.774476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.774555] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.774632] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.774708] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.774790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.774867] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.774940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.775014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.775090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.775165] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.775239] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.775312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.775384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.775457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.775539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.775621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.775702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.775784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.775861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.775935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.776007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.776080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.776152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.776224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.776299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.776374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.776446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.776521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.776595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.776672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.776753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.776830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.776906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.776979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.777051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.777123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.777194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.777262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.777336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.777416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.777494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.777570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.777644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.777719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.777792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.777868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.777943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.778016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.778090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.778161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.778233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.778307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.778386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.778461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.778538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.778612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.778688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.778762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.778833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.778906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.778977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.779047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.779117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.779190] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.779350] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.779354] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1391, lrc_seqno=1391, guc_id=0, flags=0x73 in no process [-1]
<7> [55.779357] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.779421] ------------[ cut here ]------------
<4> [55.779423] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.779424] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:7/709
<4> [55.779498] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.779563]
<4> [55.779565] CPU: 2 UID: 0 PID: 709 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.779568] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.779569] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.779570] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.779576] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.779649] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.779650] RSP: 0018:ffffc90001fdfca0 EFLAGS: 00010246
<4> [55.779653] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.779654] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.779655] RBP: ffffc90001fdfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.779660] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.779662] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.779663] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000
<4> [55.779665] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.779667] CR2: 0000732eb25aa000 CR3: 000000012441f001 CR4: 0000000000f72ef0
<4> [55.779668] PKRU: 55555554
<4> [55.779669] Call Trace:
<4> [55.779671] <TASK>
<4> [55.779675] ? lock_acquire+0xb0/0x300
<4> [55.779680] ? lock_release+0xd0/0x2b0
<4> [55.779684] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.779690] process_one_work+0x239/0x740
<4> [55.779697] worker_thread+0x200/0x3f0
<4> [55.779700] ? __pfx_worker_thread+0x10/0x10
<4> [55.779703] kthread+0x10d/0x150
<4> [55.779705] ? __pfx_kthread+0x10/0x10
<4> [55.779708] ret_from_fork+0x3bd/0x470
<4> [55.779710] ? __pfx_kthread+0x10/0x10
<4> [55.779713] ret_from_fork_asm+0x1a/0x30
<4> [55.779720] </TASK>
<4> [55.779721] irq event stamp: 469633
<4> [55.779722] hardirqs last enabled at (469639): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.779724] hardirqs last disabled at (469644): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.779726] softirqs last enabled at (468298): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.779729] softirqs last disabled at (468293): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.779732] ---[ end trace 0000000000000000 ]---
<7> [55.780766] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<5> [55.780843] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1405, lrc_seqno=1405, guc_id=0, flags=0x73 in no process [-1]
<7> [55.780868] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [55.780849] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<7> [55.780922] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [55.780924] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<4> [55.780971] ------------[ cut here ]------------
<4> [55.780973] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<7> [55.780973] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [55.780914] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<4> [55.780975] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#15: kworker/u64:11/1198
<7> [55.781069] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<7> [55.781073] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0.
<4> [55.781106] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.781200]
<4> [55.781203] CPU: 15 UID: 0 PID: 1198 Comm: kworker/u64:11 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.781207] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.781209] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.781211] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.781219] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.781340] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.781343] RSP: 0018:ffffc90001903ca0 EFLAGS: 00010246
<4> [55.781346] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.781348] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.781350] RBP: ffffc90001903db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.781352] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.781354] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.781356] FS: 0000000000000000(0000) GS:ffff8888db403000(0000) knlGS:0000000000000000
<4> [55.781358] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.781360] CR2: 00005dbbac42c42c CR3: 000000000344a004 CR4: 0000000000f72ef0
<4> [55.781362] PKRU: 55555554
<4> [55.781364] Call Trace:
<4> [55.781365] <TASK>
<4> [55.781372] ? lock_acquire+0xb0/0x300
<4> [55.781379] ? lock_release+0xd0/0x2b0
<4> [55.781387] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.781397] process_one_work+0x239/0x740
<4> [55.781407] worker_thread+0x200/0x3f0
<4> [55.781412] ? __pfx_worker_thread+0x10/0x10
<4> [55.781416] kthread+0x10d/0x150
<4> [55.781419] ? __pfx_kthread+0x10/0x10
<4> [55.781423] ret_from_fork+0x3bd/0x470
<4> [55.781426] ? __pfx_kthread+0x10/0x10
<4> [55.781430] ret_from_fork_asm+0x1a/0x30
<4> [55.781442] </TASK>
<4> [55.781444] irq event stamp: 12737
<4> [55.781445] hardirqs last enabled at (12743): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.781449] hardirqs last disabled at (12748): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.781451] softirqs last enabled at (11414): [<ffffffff8133ad83>] kernel_fpu_end+0x53/0x70
<4> [55.781454] softirqs last disabled at (11412): [<ffffffff8133b494>] kernel_fpu_begin_mask+0xc4/0x120
<4> [55.781458] ---[ end trace 0000000000000000 ]---
<6> [55.781460] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.781583] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.781593] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.782055] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.782345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.782492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.782648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.782788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.782927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.783064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.783203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.783344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.783480] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.783633] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.783779] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.785159] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.795263] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.795588] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.796672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.796804] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.796931] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.797059] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.797187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.797335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.797464] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.797592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.797719] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.797848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.797977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.798105] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.798240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.798369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.798497] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.798624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.798751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.798878] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.799005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.799139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.799279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.799412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.799543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.799676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.799808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.799938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.800069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.800206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.800337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.800471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.800605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.800737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.800869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.801002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.801145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.801285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.801423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.801558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.801693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.801824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.801956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.802094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.802224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.802356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.802491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.802623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.802755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.802887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.803017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.803154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.803290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.803421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.803552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.803683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.803813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.803946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.804082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.804213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.804344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.804479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.804610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.804742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.804872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.805008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.805142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.805273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.805403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.805532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.805667] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.805879] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.805886] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1405, lrc_seqno=1405, guc_id=0, flags=0x73 in no process [-1]
<7> [55.805890] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.806964] ------------[ cut here ]------------
<4> [55.806966] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.806967] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:0/12
<4> [55.807055] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.807121]
<4> [55.807124] CPU: 5 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.807127] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.807128] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.807129] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.807135] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.807214] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.807216] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [55.807218] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.807219] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.807221] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.807222] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.807223] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.807224] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000
<4> [55.807226] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.807227] CR2: 000079d50a742098 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [55.807229] PKRU: 55555554
<4> [55.807230] Call Trace:
<4> [55.807231] <TASK>
<4> [55.807235] ? lock_acquire+0xb0/0x300
<4> [55.807240] ? lock_release+0xd0/0x2b0
<4> [55.807245] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.807251] process_one_work+0x239/0x740
<4> [55.807258] worker_thread+0x200/0x3f0
<4> [55.807261] ? __pfx_worker_thread+0x10/0x10
<4> [55.807263] kthread+0x10d/0x150
<4> [55.807266] ? __pfx_kthread+0x10/0x10
<4> [55.807269] ret_from_fork+0x3bd/0x470
<4> [55.807271] ? __pfx_kthread+0x10/0x10
<4> [55.807273] ret_from_fork_asm+0x1a/0x30
<4> [55.807281] </TASK>
<4> [55.807282] irq event stamp: 285991
<4> [55.807283] hardirqs last enabled at (285997): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.807286] hardirqs last disabled at (286002): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.807287] softirqs last enabled at (284890): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.807290] softirqs last disabled at (284885): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.807293] ---[ end trace 0000000000000000 ]---
<6> [55.807295] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.807373] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.807379] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.807308] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.807472] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.807632] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.807855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.807974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.808090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.808181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.808268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.808354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.808439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.808525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.808605] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.808704] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.808795] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.809829] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.819624] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.819875] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.820946] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.821033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.821112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.821190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.821268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.821348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.821426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.821504] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.821590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.821668] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.821743] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.821817] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.821890] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.821964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.822037] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.822110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.822183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.822256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.822330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.822415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.822497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.822586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.822664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.822738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.822812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.822886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.822957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.823029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.823099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.823175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.823253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.823329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.823406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.823482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.823572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.823654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.823735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.823811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.823887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.823960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.824035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.824111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.824185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.824259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.824336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.824410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.824484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.824574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.824647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.824722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.824799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.824874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.824948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.825023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.825094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.825169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.825244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.825317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.825390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.825470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.825544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.825620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.825693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.825767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.825842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.825921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.825998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.826072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.826150] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.826305] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.826309] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1405, lrc_seqno=1405, guc_id=0, flags=0x73 in no process [-1]
<7> [55.826312] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.826377] ------------[ cut here ]------------
<4> [55.826378] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.826380] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:0/12
<4> [55.826466] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.826532]
<4> [55.826534] CPU: 5 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.826537] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.826538] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.826540] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.826545] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.826618] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.826620] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [55.826622] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.826624] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.826625] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.826626] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.826628] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.826629] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000
<4> [55.826631] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.826632] CR2: 000079d50a742098 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [55.826634] PKRU: 55555554
<4> [55.826635] Call Trace:
<4> [55.826636] <TASK>
<4> [55.826640] ? lock_acquire+0xb0/0x300
<4> [55.826646] ? lock_release+0xd0/0x2b0
<4> [55.826650] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.826656] process_one_work+0x239/0x740
<4> [55.826663] worker_thread+0x200/0x3f0
<4> [55.826666] ? __pfx_worker_thread+0x10/0x10
<4> [55.826669] kthread+0x10d/0x150
<4> [55.826671] ? __pfx_kthread+0x10/0x10
<4> [55.826674] ret_from_fork+0x3bd/0x470
<4> [55.826676] ? __pfx_kthread+0x10/0x10
<4> [55.826679] ret_from_fork_asm+0x1a/0x30
<4> [55.826687] </TASK>
<4> [55.826688] irq event stamp: 289343
<4> [55.826689] hardirqs last enabled at (289349): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.826692] hardirqs last disabled at (289354): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.826693] softirqs last enabled at (288600): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.826696] softirqs last disabled at (288595): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.826699] ---[ end trace 0000000000000000 ]---
<5> [55.827377] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1418, lrc_seqno=1418, guc_id=0, flags=0x73 in no process [-1]
<7> [55.827386] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.827527] ------------[ cut here ]------------
<4> [55.827529] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.827530] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:3/194
<4> [55.827620] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.827698]
<4> [55.827702] CPU: 8 UID: 0 PID: 194 Comm: kworker/u64:3 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.827706] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.827707] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.827709] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.827717] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.827804] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.827806] RSP: 0018:ffffc900015cfca0 EFLAGS: 00010246
<4> [55.827808] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.827810] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.827811] RBP: ffffc900015cfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.827812] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.827813] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.827815] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000
<4> [55.827816] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.827818] CR2: 000079d503c55000 CR3: 0000000123785005 CR4: 0000000000f72ef0
<4> [55.827819] PKRU: 55555554
<4> [55.827820] Call Trace:
<4> [55.827821] <TASK>
<4> [55.827825] ? lock_acquire+0xb0/0x300
<4> [55.827831] ? lock_release+0xd0/0x2b0
<4> [55.827836] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.827842] process_one_work+0x239/0x740
<4> [55.827849] worker_thread+0x200/0x3f0
<4> [55.827852] ? __pfx_worker_thread+0x10/0x10
<4> [55.827854] kthread+0x10d/0x150
<4> [55.827857] ? __pfx_kthread+0x10/0x10
<4> [55.827860] ret_from_fork+0x3bd/0x470
<4> [55.827862] ? __pfx_kthread+0x10/0x10
<4> [55.827865] ret_from_fork_asm+0x1a/0x30
<4> [55.827873] </TASK>
<4> [55.827874] irq event stamp: 272941
<4> [55.827875] hardirqs last enabled at (272947): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.827879] hardirqs last disabled at (272952): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.827880] softirqs last enabled at (272180): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.827883] softirqs last disabled at (272173): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.827886] ---[ end trace 0000000000000000 ]---
<6> [55.827888] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.827971] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.827978] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.828038] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.828142] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.828248] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.828485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.828585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.828685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.828778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.828867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.828952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.829037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.829122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.829203] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.829302] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.829405] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.830440] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.840091] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.840342] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.841341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.841428] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.841508] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.841586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.841661] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.841735] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.841810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.841884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.841956] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.842028] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.842125] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.842198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.842270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.842341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.842413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.842485] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.842557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.842630] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.842703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.842787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.842867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.842946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.843036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.843119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.843198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.843275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.843352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.843429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.843505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.843581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.843656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.843731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.843806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.843883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.843966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.844067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.844152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.844233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.844311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.844386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.844464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.844538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.844611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.844685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.844763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.844837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.844913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.844997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.845076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.845154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.845234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.845309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.845384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.845459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.845532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.845606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.845682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.845755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.845830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.845906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.845995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.846072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.846147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.846222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.846297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.846371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.846444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.846520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.846599] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.846756] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.846760] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1418, lrc_seqno=1418, guc_id=0, flags=0x73 in no process [-1]
<7> [55.846763] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.846830] ------------[ cut here ]------------
<4> [55.846832] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.846833] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:0/12
<4> [55.846911] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.846978]
<4> [55.846980] CPU: 1 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.846983] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.846984] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.846985] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.846991] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.847063] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.847065] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [55.847067] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.847068] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.847070] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.847071] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.847072] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.847073] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000
<4> [55.847075] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.847076] CR2: 0000573dd7f36020 CR3: 0000000123785002 CR4: 0000000000f72ef0
<4> [55.847078] PKRU: 55555554
<4> [55.847079] Call Trace:
<4> [55.847080] <TASK>
<4> [55.847084] ? lock_acquire+0xb0/0x300
<4> [55.847089] ? lock_release+0xd0/0x2b0
<4> [55.847094] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.847100] process_one_work+0x239/0x740
<4> [55.847107] worker_thread+0x200/0x3f0
<4> [55.847110] ? __pfx_worker_thread+0x10/0x10
<4> [55.847112] kthread+0x10d/0x150
<4> [55.847115] ? __pfx_kthread+0x10/0x10
<4> [55.847117] ret_from_fork+0x3bd/0x470
<4> [55.847120] ? __pfx_kthread+0x10/0x10
<4> [55.847122] ret_from_fork_asm+0x1a/0x30
<4> [55.847130] </TASK>
<4> [55.847131] irq event stamp: 293163
<4> [55.847132] hardirqs last enabled at (293169): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.847134] hardirqs last disabled at (293174): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.847136] softirqs last enabled at (292196): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.847139] softirqs last disabled at (292191): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.847141] ---[ end trace 0000000000000000 ]---
<6> [55.847143] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.847216] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.847222] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.847627] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.847843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.847946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.848038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.848127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.848214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.848298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.848380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.848466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.848545] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.848643] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.848734] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.849766] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.859580] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.859830] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.860817] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.860899] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.860977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.861057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.861135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.861211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.861287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.861361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.861435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.861509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.861597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.861671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.861745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.861821] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.861893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.861965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.862038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.862110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.862181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.862263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.862344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.862424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.862506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.862585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.862664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.862740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.862814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.862889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.862963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.863043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.863122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.863199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.863277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.863355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.863438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.863534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.863617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.863697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.863775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.863848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.863922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.863996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.864070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.864145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.864222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.864300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.864376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.864458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.864535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.864612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.864690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.864767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.864844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.864922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.864997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.865074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.865150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.865225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.865301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.865380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.865467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.865544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.865619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.865692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.865767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.865842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.865916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.865990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.866066] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.866220] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.866224] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1418, lrc_seqno=1418, guc_id=0, flags=0x73 in no process [-1]
<7> [55.866227] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.866294] ------------[ cut here ]------------
<4> [55.866295] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.866296] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:0/12
<4> [55.866372] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.866442]
<4> [55.866444] CPU: 1 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.866447] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.866448] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.866449] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.866455] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.866527] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.866529] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [55.866531] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.866532] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.866533] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.866534] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.866536] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.866537] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000
<4> [55.866539] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.866540] CR2: 0000573dd7f36020 CR3: 0000000123785002 CR4: 0000000000f72ef0
<4> [55.866541] PKRU: 55555554
<4> [55.866543] Call Trace:
<4> [55.866544] <TASK>
<4> [55.866547] ? lock_acquire+0xb0/0x300
<4> [55.866552] ? lock_release+0xd0/0x2b0
<4> [55.866557] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.866563] process_one_work+0x239/0x740
<4> [55.866569] worker_thread+0x200/0x3f0
<4> [55.866572] ? __pfx_worker_thread+0x10/0x10
<4> [55.866575] kthread+0x10d/0x150
<4> [55.866577] ? __pfx_kthread+0x10/0x10
<4> [55.866580] ret_from_fork+0x3bd/0x470
<4> [55.866582] ? __pfx_kthread+0x10/0x10
<4> [55.866585] ret_from_fork_asm+0x1a/0x30
<4> [55.866593] </TASK>
<4> [55.866594] irq event stamp: 296511
<4> [55.866595] hardirqs last enabled at (296517): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.866597] hardirqs last disabled at (296522): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.866599] softirqs last enabled at (295274): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.866601] softirqs last disabled at (295265): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.866604] ---[ end trace 0000000000000000 ]---
<5> [55.867606] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1419, lrc_seqno=1419, guc_id=0, flags=0x73 in no process [-1]
<7> [55.867610] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<7> [55.867619] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<4> [55.867685] ------------[ cut here ]------------
<4> [55.867686] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.867687] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:0/12
<4> [55.867770] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi
<7> [55.867724] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<4> [55.867773] mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.867837] CPU: 2 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.867840] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.867841] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.867843] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.867849] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.867927] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.867929] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [55.867931] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.867933] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.867934] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.867935] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.867936] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.867938] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000
<4> [55.867939] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.867941] CR2: 0000732eb25aa000 CR3: 000000012441f001 CR4: 0000000000f72ef0
<4> [55.867942] PKRU: 55555554
<4> [55.867943] Call Trace:
<4> [55.867944] <TASK>
<4> [55.867948] ? lock_acquire+0xb0/0x300
<4> [55.867953] ? lock_release+0xd0/0x2b0
<4> [55.867958] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.867964] process_one_work+0x239/0x740
<4> [55.867971] worker_thread+0x200/0x3f0
<4> [55.867974] ? __pfx_worker_thread+0x10/0x10
<4> [55.867977] kthread+0x10d/0x150
<4> [55.867979] ? __pfx_kthread+0x10/0x10
<4> [55.867982] ret_from_fork+0x3bd/0x470
<4> [55.867984] ? __pfx_kthread+0x10/0x10
<4> [55.867987] ret_from_fork_asm+0x1a/0x30
<4> [55.867994] </TASK>
<4> [55.867995] irq event stamp: 297401
<4> [55.867996] hardirqs last enabled at (297407): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.867999] hardirqs last disabled at (297412): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.868000] softirqs last enabled at (295274): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.868003] softirqs last disabled at (295265): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.868006] ---[ end trace 0000000000000000 ]---
<6> [55.868008] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.868086] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.868092] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.868503] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.868725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.868816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.868910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.868997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.869082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.869164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.869246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.869337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.869419] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.869516] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.869610] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.870642] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.881020] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.881271] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.882202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.882283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.882362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.882440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.882517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.882594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.882670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.882745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.882821] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.882895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.882973] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.883051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.883128] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.883203] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.883278] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.883350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.883425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.883497] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.883568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.883651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.883734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.883812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.883888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.883978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.884057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.884135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.884211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.884286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.884363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.884442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.884520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.884600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.884684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.884765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.884848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.884934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.885016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.885096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.885175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.885251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.885327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.885402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.885476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.885551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.885629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.885705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.885783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.885861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.885944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.886019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.886096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.886172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.886246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.886321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.886397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.886474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.886551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.886628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.886703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.886781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.886855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.886946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.887022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.887096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.887172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.887245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.887318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.887389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.887465] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.887618] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.887622] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1419, lrc_seqno=1419, guc_id=0, flags=0x73 in no process [-1]
<7> [55.887625] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.887690] ------------[ cut here ]------------
<4> [55.887691] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.887693] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:7/709
<4> [55.887770] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.887839]
<4> [55.887843] CPU: 4 UID: 0 PID: 709 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.887848] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.887850] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.887853] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.887859] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.887934] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.887936] RSP: 0018:ffffc90001fdfca0 EFLAGS: 00010246
<4> [55.887938] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.887940] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.887941] RBP: ffffc90001fdfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.887942] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.887943] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.887945] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000
<4> [55.887946] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.887948] CR2: 0000732eb25ab000 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [55.887949] PKRU: 55555554
<4> [55.887950] Call Trace:
<4> [55.887951] <TASK>
<4> [55.887956] ? lock_acquire+0xb0/0x300
<4> [55.887961] ? lock_release+0xd0/0x2b0
<4> [55.887966] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.887972] process_one_work+0x239/0x740
<4> [55.887978] worker_thread+0x200/0x3f0
<4> [55.887981] ? __pfx_worker_thread+0x10/0x10
<4> [55.887984] kthread+0x10d/0x150
<4> [55.887986] ? __pfx_kthread+0x10/0x10
<4> [55.887989] ret_from_fork+0x3bd/0x470
<4> [55.887991] ? __pfx_kthread+0x10/0x10
<4> [55.887994] ret_from_fork_asm+0x1a/0x30
<4> [55.888001] </TASK>
<4> [55.888002] irq event stamp: 473611
<4> [55.888003] hardirqs last enabled at (473617): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.888006] hardirqs last disabled at (473622): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.888007] softirqs last enabled at (472466): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.888010] softirqs last disabled at (472459): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.888013] ---[ end trace 0000000000000000 ]---
<6> [55.888015] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.888091] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.888097] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.889338] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.889446] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.889554] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.889780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.889911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.890010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.890101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.890192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.890280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.890364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.890451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.890531] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.890626] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.890714] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.891753] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.901487] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.901737] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.902792] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.902875] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.902953] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.903033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.903111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.903188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.903266] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.903345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.903421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.903517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.903591] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.903667] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.903740] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.903814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.903887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.903960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.904035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.904109] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.904182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.904265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.904348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.904435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.904513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.904590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.904666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.904741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.904814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.904887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.904961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.905037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.905114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.905189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.905268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.905343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.905432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.905513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.905593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.905671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.905748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.905822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.905898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.905972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.906044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.906118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.906194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.906268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.906343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.906429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.906502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.906576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.906653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.906728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.906804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.906883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.906957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.907031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.907104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.907176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.907248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.907324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.907421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.907499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.907574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.907647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.907720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.907793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.907865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.907935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.908015] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.908169] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.908174] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1419, lrc_seqno=1419, guc_id=0, flags=0x73 in no process [-1]
<7> [55.908176] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.908242] ------------[ cut here ]------------
<4> [55.908243] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.908244] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:0/12
<4> [55.908323] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.908389]
<4> [55.908391] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.908394] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.908395] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.908397] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.908402] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.908474] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.908475] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [55.908477] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.908479] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.908480] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.908481] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.908482] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.908484] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000
<4> [55.908485] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.908487] CR2: 0000732eb25ab000 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [55.908488] PKRU: 55555554
<4> [55.908489] Call Trace:
<4> [55.908490] <TASK>
<4> [55.908494] ? lock_acquire+0xb0/0x300
<4> [55.908499] ? lock_release+0xd0/0x2b0
<4> [55.908504] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.908510] process_one_work+0x239/0x740
<4> [55.908516] worker_thread+0x200/0x3f0
<4> [55.908519] ? __pfx_worker_thread+0x10/0x10
<4> [55.908522] kthread+0x10d/0x150
<4> [55.908524] ? __pfx_kthread+0x10/0x10
<4> [55.908527] ret_from_fork+0x3bd/0x470
<4> [55.908529] ? __pfx_kthread+0x10/0x10
<4> [55.908532] ret_from_fork_asm+0x1a/0x30
<4> [55.908539] </TASK>
<4> [55.908540] irq event stamp: 301099
<4> [55.908541] hardirqs last enabled at (301105): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.908544] hardirqs last disabled at (301110): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.908545] softirqs last enabled at (300132): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.908548] softirqs last disabled at (300117): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.908551] ---[ end trace 0000000000000000 ]---
<5> [55.908879] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1420, lrc_seqno=1420, guc_id=0, flags=0x73 in no process [-1]
<7> [55.908888] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.909074] ------------[ cut here ]------------
<4> [55.909076] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.909078] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#15: kworker/u64:11/1198
<4> [55.909204] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.909316]
<4> [55.909321] CPU: 15 UID: 0 PID: 1198 Comm: kworker/u64:11 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.909326] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.909327] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.909330] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.909341] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.909461] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.909464] RSP: 0018:ffffc90001903ca0 EFLAGS: 00010246
<4> [55.909467] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.909469] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.909471] RBP: ffffc90001903db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.909473] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.909474] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.909476] FS: 0000000000000000(0000) GS:ffff8888db403000(0000) knlGS:0000000000000000
<4> [55.909479] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.909480] CR2: 00005dbbac42c42c CR3: 000000000344a004 CR4: 0000000000f72ef0
<4> [55.909483] PKRU: 55555554
<4> [55.909484] Call Trace:
<4> [55.909486] <TASK>
<4> [55.909492] ? lock_acquire+0xb0/0x300
<4> [55.909500] ? lock_release+0xd0/0x2b0
<4> [55.909507] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.909517] process_one_work+0x239/0x740
<4> [55.909527] worker_thread+0x200/0x3f0
<4> [55.909532] ? __pfx_worker_thread+0x10/0x10
<4> [55.909536] kthread+0x10d/0x150
<4> [55.909539] ? __pfx_kthread+0x10/0x10
<4> [55.909543] ret_from_fork+0x3bd/0x470
<4> [55.909546] ? __pfx_kthread+0x10/0x10
<4> [55.909550] ret_from_fork_asm+0x1a/0x30
<4> [55.909562] </TASK>
<4> [55.909564] irq event stamp: 14147
<4> [55.909565] hardirqs last enabled at (14153): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.909568] hardirqs last disabled at (14158): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.909571] softirqs last enabled at (13798): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.909575] softirqs last disabled at (13793): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.909578] ---[ end trace 0000000000000000 ]---
<6> [55.909590] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<7> [55.909581] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<6> [55.909671] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.909679] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.909686] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.909862] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.910082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.910177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.910277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.910366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.910452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.910536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.910621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.910707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.910788] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.910887] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.910980] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.912010] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.921955] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.922205] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.923220] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.923304] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.923383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.923462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.923539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.923612] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.923686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.923759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.923832] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.923915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.923988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.924062] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.924134] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.924208] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.924281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.924353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.924427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.924499] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.924573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.924658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.924742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.924821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.924907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.924985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.925061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.925134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.925208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.925280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.925352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.925430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.925506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.925580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.925655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.925729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.925810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.925905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.925988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.926067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.926148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.926224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.926299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.926374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.926448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.926522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.926599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.926675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.926753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.926834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.926909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.926987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.927064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.927136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.927210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.927283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.927357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.927431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.927504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.927575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.927647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.927728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.927811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.927889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.927963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.928038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.928113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.928188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.928259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.928331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.928406] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.928560] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.928564] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1420, lrc_seqno=1420, guc_id=0, flags=0x73 in no process [-1]
<7> [55.928567] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.928633] ------------[ cut here ]------------
<4> [55.928635] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.928636] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:11/1198
<4> [55.928712] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.928785]
<4> [55.928787] CPU: 3 UID: 0 PID: 1198 Comm: kworker/u64:11 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.928790] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.928791] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.928793] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.928799] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.928871] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.928872] RSP: 0018:ffffc90001903ca0 EFLAGS: 00010246
<4> [55.928875] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.928876] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.928877] RBP: ffffc90001903db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.928879] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.928880] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.928881] FS: 0000000000000000(0000) GS:ffff8888dae03000(0000) knlGS:0000000000000000
<4> [55.928883] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.928884] CR2: 0000732eb25ac000 CR3: 000000012441f002 CR4: 0000000000f72ef0
<4> [55.928886] PKRU: 55555554
<4> [55.928887] Call Trace:
<4> [55.928888] <TASK>
<4> [55.928892] ? lock_acquire+0xb0/0x300
<4> [55.928897] ? lock_release+0xd0/0x2b0
<4> [55.928902] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.928908] process_one_work+0x239/0x740
<4> [55.928915] worker_thread+0x200/0x3f0
<4> [55.928918] ? __pfx_worker_thread+0x10/0x10
<4> [55.928920] kthread+0x10d/0x150
<4> [55.928922] ? __pfx_kthread+0x10/0x10
<4> [55.928925] ret_from_fork+0x3bd/0x470
<4> [55.928927] ? __pfx_kthread+0x10/0x10
<4> [55.928930] ret_from_fork_asm+0x1a/0x30
<4> [55.928938] </TASK>
<4> [55.928939] irq event stamp: 17487
<4> [55.928940] hardirqs last enabled at (17493): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.928942] hardirqs last disabled at (17498): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.928944] softirqs last enabled at (16250): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.928947] softirqs last disabled at (16243): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.928949] ---[ end trace 0000000000000000 ]---
<6> [55.929777] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.929898] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.929907] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.929964] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.930071] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.930181] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.930468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.930618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.930795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.930895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.930990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.931083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.931175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.931264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.931349] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.931448] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.931539] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.932575] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.942419] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.942668] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.943670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.943752] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.943832] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.943910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.943987] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.944064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.944142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.944218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.944294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.944377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.944453] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.944526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.944600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.944673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.944745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.944817] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.944889] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.944960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.945032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.945117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.945198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.945278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.945358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.945437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.945513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.945589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.945665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.945738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.945814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.945891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.945968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.946045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.946122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.946198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.946281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.946370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.946451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.946529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.946608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.946683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.946757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.946829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.946903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.946978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.947055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.947128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.947203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.947278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.947364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.947442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.947520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.947592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.947666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.947740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.947811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.947886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.947961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.948033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.948106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.948181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.948255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.948346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.948420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.948493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.948567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.948641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.948714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.948784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.948859] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.949014] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.949018] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1420, lrc_seqno=1420, guc_id=0, flags=0x73 in no process [-1]
<7> [55.949020] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.949085] ------------[ cut here ]------------
<4> [55.949086] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.949088] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:9/992
<4> [55.949163] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.949228]
<4> [55.949230] CPU: 8 UID: 0 PID: 992 Comm: kworker/u64:9 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.949237] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.949239] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.949240] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.949246] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.949320] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.949322] RSP: 0018:ffffc90003203ca0 EFLAGS: 00010246
<4> [55.949324] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.949325] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.949327] RBP: ffffc90003203db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.949328] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.949329] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.949330] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000
<4> [55.949332] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.949333] CR2: 000079d503c55000 CR3: 000000012441f001 CR4: 0000000000f72ef0
<4> [55.949335] PKRU: 55555554
<4> [55.949336] Call Trace:
<4> [55.949337] <TASK>
<4> [55.949341] ? lock_acquire+0xb0/0x300
<4> [55.949346] ? lock_release+0xd0/0x2b0
<4> [55.949350] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.949356] process_one_work+0x239/0x740
<4> [55.949363] worker_thread+0x200/0x3f0
<4> [55.949366] ? __pfx_worker_thread+0x10/0x10
<4> [55.949368] kthread+0x10d/0x150
<4> [55.949371] ? __pfx_kthread+0x10/0x10
<4> [55.949374] ret_from_fork+0x3bd/0x470
<4> [55.949376] ? __pfx_kthread+0x10/0x10
<4> [55.949378] ret_from_fork_asm+0x1a/0x30
<4> [55.949386] </TASK>
<4> [55.949387] irq event stamp: 570893
<4> [55.949388] hardirqs last enabled at (570899): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.949390] hardirqs last disabled at (570904): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.949392] softirqs last enabled at (569934): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.949395] softirqs last disabled at (569929): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.949397] ---[ end trace 0000000000000000 ]---
<5> [55.949670] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1421, lrc_seqno=1421, guc_id=0, flags=0x73 in no process [-1]
<7> [55.949675] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.949793] ------------[ cut here ]------------
<4> [55.949795] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.949796] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:11/1198
<4> [55.949874] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.949948]
<4> [55.949950] CPU: 0 UID: 0 PID: 1198 Comm: kworker/u64:11 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.949953] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.949955] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.949956] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.949963] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.950045] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.950047] RSP: 0018:ffffc90001903ca0 EFLAGS: 00010246
<4> [55.950049] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.950050] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.950051] RBP: ffffc90001903db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.950053] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.950054] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.950055] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000
<4> [55.950057] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.950058] CR2: 000079d50b68a000 CR3: 000000000344a004 CR4: 0000000000f72ef0
<4> [55.950060] PKRU: 55555554
<4> [55.950061] Call Trace:
<4> [55.950062] <TASK>
<4> [55.950067] ? lock_acquire+0xb0/0x300
<4> [55.950072] ? lock_release+0xd0/0x2b0
<4> [55.950077] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.950084] process_one_work+0x239/0x740
<4> [55.950091] worker_thread+0x200/0x3f0
<4> [55.950095] ? __pfx_worker_thread+0x10/0x10
<4> [55.950097] kthread+0x10d/0x150
<4> [55.950099] ? __pfx_kthread+0x10/0x10
<4> [55.950102] ret_from_fork+0x3bd/0x470
<4> [55.950105] ? __pfx_kthread+0x10/0x10
<4> [55.950107] ret_from_fork_asm+0x1a/0x30
<4> [55.950115] </TASK>
<4> [55.950116] irq event stamp: 18901
<4> [55.950118] hardirqs last enabled at (18907): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.950120] hardirqs last disabled at (18912): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.950122] softirqs last enabled at (17914): [<ffffffff8133ad83>] kernel_fpu_end+0x53/0x70
<4> [55.950124] softirqs last disabled at (17912): [<ffffffff8133b494>] kernel_fpu_begin_mask+0xc4/0x120
<4> [55.950127] ---[ end trace 0000000000000000 ]---
<6> [55.950130] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.950243] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.950257] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.950425] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.950538] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.950646] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.950874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.950973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.951070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.951160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.951268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.951356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.951440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.951526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.951607] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.951707] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.951799] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.952833] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.962886] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.963141] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.964130] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.964213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.964290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.964369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.964447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.964524] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.964602] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.964677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.964751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.964825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.964915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.964989] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.965065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.965140] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.965213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.965286] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.965358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.965429] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.965501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.965584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.965666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.965744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.965825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.965905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.965982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.966057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.966132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.966206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.966280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.966358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.966437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.966514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.966592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.966667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.966750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.966840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.966924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.967003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.967083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.967159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.967233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.967305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.967377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.967453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.967529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.967603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.967677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.967754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.967828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.967903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.967977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.968052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.968129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.968202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.968275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.968349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.968424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.968497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.968570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.968647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.968720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.968822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.968896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.968969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.969041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.969115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.969186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.969259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.969334] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.969484] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.969488] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1421, lrc_seqno=1421, guc_id=0, flags=0x73 in no process [-1]
<7> [55.969490] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.969556] ------------[ cut here ]------------
<4> [55.969558] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.969559] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:9/992
<4> [55.969634] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.969704]
<4> [55.969707] CPU: 6 UID: 0 PID: 992 Comm: kworker/u64:9 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.969710] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.969711] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.969713] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.969719] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.969794] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.969796] RSP: 0018:ffffc90003203ca0 EFLAGS: 00010246
<4> [55.969798] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.969800] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.969801] RBP: ffffc90003203db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.969802] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.969803] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.969805] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000
<4> [55.969806] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.969808] CR2: 000079d503ffe000 CR3: 000000011e8d6004 CR4: 0000000000f72ef0
<4> [55.969810] PKRU: 55555554
<4> [55.969811] Call Trace:
<4> [55.969812] <TASK>
<4> [55.969816] ? lock_acquire+0xb0/0x300
<4> [55.969821] ? lock_release+0xd0/0x2b0
<4> [55.969826] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.969832] process_one_work+0x239/0x740
<4> [55.969839] worker_thread+0x200/0x3f0
<4> [55.969842] ? __pfx_worker_thread+0x10/0x10
<4> [55.969845] kthread+0x10d/0x150
<4> [55.969847] ? __pfx_kthread+0x10/0x10
<4> [55.969850] ret_from_fork+0x3bd/0x470
<4> [55.969852] ? __pfx_kthread+0x10/0x10
<4> [55.969855] ret_from_fork_asm+0x1a/0x30
<4> [55.969863] </TASK>
<4> [55.969864] irq event stamp: 574415
<4> [55.969865] hardirqs last enabled at (574421): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.969867] hardirqs last disabled at (574426): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.969869] softirqs last enabled at (573456): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.969872] softirqs last disabled at (573351): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.969875] ---[ end trace 0000000000000000 ]---
<6> [55.970657] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.970848] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.970856] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.970897] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.971004] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.971112] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.971335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.971428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.971525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.971615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.971714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.971796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.971882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.971967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.972047] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.972144] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.972236] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.973269] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [55.983351] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [55.983603] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [55.984588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [55.984670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [55.984747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [55.984826] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [55.984903] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [55.984978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [55.985053] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [55.985126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [55.985201] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [55.985277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [55.985368] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [55.985442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [55.985517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [55.985590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [55.985661] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [55.985733] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [55.985805] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [55.985877] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [55.985947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [55.986028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [55.986109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [55.986186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [55.986261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [55.986357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [55.986439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [55.986517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [55.986592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [55.986665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [55.986737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [55.986813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [55.986890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [55.986965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [55.987040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [55.987115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [55.987198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [55.987293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [55.987375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [55.987454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [55.987531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [55.987606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [55.987679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [55.987751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [55.987824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [55.987901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [55.987978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [55.988051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [55.988124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [55.988198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [55.988298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [55.988374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [55.988451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [55.988525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [55.988600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [55.988672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [55.988743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [55.988816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [55.988889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [55.988961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [55.989034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [55.989108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [55.989181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [55.989269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [55.989341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [55.989416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [55.989491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [55.989565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [55.989637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [55.989708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [55.989783] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [55.989921] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [55.989925] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1421, lrc_seqno=1421, guc_id=0, flags=0x73 in no process [-1]
<7> [55.989928] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.989992] ------------[ cut here ]------------
<4> [55.989993] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.989995] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:11/1198
<4> [55.990069] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.990134]
<4> [55.990136] CPU: 0 UID: 0 PID: 1198 Comm: kworker/u64:11 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.990139] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.990140] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.990142] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.990147] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.990235] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.990237] RSP: 0018:ffffc90001903ca0 EFLAGS: 00010246
<4> [55.990240] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.990241] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.990243] RBP: ffffc90001903db0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.990244] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.990245] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.990247] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000
<4> [55.990249] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.990250] CR2: 000079d50b68a000 CR3: 000000000344a004 CR4: 0000000000f72ef0
<4> [55.990252] PKRU: 55555554
<4> [55.990253] Call Trace:
<4> [55.990254] <TASK>
<4> [55.990258] ? lock_acquire+0xb0/0x300
<4> [55.990263] ? lock_release+0xd0/0x2b0
<4> [55.990268] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.990275] process_one_work+0x239/0x740
<4> [55.990282] worker_thread+0x200/0x3f0
<4> [55.990285] ? __pfx_worker_thread+0x10/0x10
<4> [55.990288] kthread+0x10d/0x150
<4> [55.990290] ? __pfx_kthread+0x10/0x10
<4> [55.990293] ret_from_fork+0x3bd/0x470
<4> [55.990296] ? __pfx_kthread+0x10/0x10
<4> [55.990299] ret_from_fork_asm+0x1a/0x30
<4> [55.990306] </TASK>
<4> [55.990308] irq event stamp: 22877
<4> [55.990309] hardirqs last enabled at (22883): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.990311] hardirqs last disabled at (22888): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.990313] softirqs last enabled at (21918): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.990316] softirqs last disabled at (21911): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.990318] ---[ end trace 0000000000000000 ]---
<5> [55.990882] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1422, lrc_seqno=1422, guc_id=0, flags=0x73 in no process [-1]
<7> [55.990888] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [55.991037] ------------[ cut here ]------------
<4> [55.991039] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [55.991041] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:3/194
<4> [55.991133] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [55.991226]
<4> [55.991229] CPU: 8 UID: 0 PID: 194 Comm: kworker/u64:3 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [55.991232] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [55.991234] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [55.991236] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [55.991243] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [55.991340] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [55.991343] RSP: 0018:ffffc900015cfca0 EFLAGS: 00010246
<4> [55.991345] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [55.991348] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [55.991349] RBP: ffffc900015cfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [55.991350] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [55.991351] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [55.991353] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000
<4> [55.991354] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [55.991356] CR2: 000079d503c55000 CR3: 000000000344a002 CR4: 0000000000f72ef0
<4> [55.991357] PKRU: 55555554
<4> [55.991358] Call Trace:
<4> [55.991360] <TASK>
<4> [55.991365] ? lock_acquire+0xb0/0x300
<4> [55.991373] ? lock_release+0xd0/0x2b0
<4> [55.991378] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [55.991384] process_one_work+0x239/0x740
<4> [55.991393] worker_thread+0x200/0x3f0
<4> [55.991396] ? __pfx_worker_thread+0x10/0x10
<4> [55.991398] kthread+0x10d/0x150
<4> [55.991401] ? __pfx_kthread+0x10/0x10
<4> [55.991404] ret_from_fork+0x3bd/0x470
<4> [55.991406] ? __pfx_kthread+0x10/0x10
<4> [55.991409] ret_from_fork_asm+0x1a/0x30
<4> [55.991417] </TASK>
<4> [55.991418] irq event stamp: 274651
<4> [55.991420] hardirqs last enabled at (274657): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [55.991422] hardirqs last disabled at (274662): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [55.991424] softirqs last enabled at (273952): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.991427] softirqs last disabled at (273947): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [55.991430] ---[ end trace 0000000000000000 ]---
<6> [55.991432] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [55.991519] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [55.991525] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [55.991622] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [55.991728] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [55.991839] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [55.992080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [55.992196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [55.992299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [55.992395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [55.992485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [55.992573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [55.992660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [55.992749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [55.992833] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [55.992936] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [55.993034] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [55.994076] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [56.003818] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [56.004074] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [56.005029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [56.005120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [56.005204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [56.005286] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [56.005366] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [56.005443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [56.005520] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [56.005599] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [56.005678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [56.005755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [56.005849] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [56.005929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [56.006008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [56.006086] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [56.006164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [56.006241] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [56.006320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [56.006398] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [56.006475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [56.006562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [56.006650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [56.006737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [56.006821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [56.006905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [56.006991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [56.007072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [56.007152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [56.007233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [56.007311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [56.007392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [56.007474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [56.007554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [56.007635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [56.007718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [56.007805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [56.007893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [56.007977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [56.008058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [56.008142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [56.008221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [56.008300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [56.008378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [56.008459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [56.008541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [56.008623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [56.008704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [56.008781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [56.008858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [56.008935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [56.009015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [56.009094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [56.009171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [56.009248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [56.009324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [56.009400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [56.009477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [56.009555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [56.009631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [56.009714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [56.009795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [56.009876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [56.009958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [56.010037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [56.010114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [56.010191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [56.010270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [56.010346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [56.010421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [56.010501] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [56.010663] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [56.010682] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1422, lrc_seqno=1422, guc_id=0, flags=0x73 in no process [-1]
<7> [56.010684] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [56.010753] ------------[ cut here ]------------
<4> [56.010754] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [56.010755] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:11/1198
<4> [56.010835] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [56.010902]
<4> [56.010904] CPU: 8 UID: 0 PID: 1198 Comm: kworker/u64:11 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [56.010907] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [56.010908] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [56.010909] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [56.010915] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [56.010992] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [56.010994] RSP: 0018:ffffc90001903ca0 EFLAGS: 00010246
<4> [56.010996] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [56.010998] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [56.010999] RBP: ffffc90001903db0 R08: 0000000000000000 R09: 0000000000000000
<4> [56.011000] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [56.011001] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [56.011003] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000
<4> [56.011004] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [56.011006] CR2: 000079d503c55000 CR3: 000000000344a002 CR4: 0000000000f72ef0
<4> [56.011007] PKRU: 55555554
<4> [56.011008] Call Trace:
<4> [56.011010] <TASK>
<4> [56.011014] ? lock_acquire+0xb0/0x300
<4> [56.011019] ? lock_release+0xd0/0x2b0
<4> [56.011024] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [56.011030] process_one_work+0x239/0x740
<4> [56.011036] worker_thread+0x200/0x3f0
<4> [56.011040] ? __pfx_worker_thread+0x10/0x10
<4> [56.011042] kthread+0x10d/0x150
<4> [56.011044] ? __pfx_kthread+0x10/0x10
<4> [56.011047] ret_from_fork+0x3bd/0x470
<4> [56.011050] ? __pfx_kthread+0x10/0x10
<4> [56.011052] ret_from_fork_asm+0x1a/0x30
<4> [56.011060] </TASK>
<4> [56.011061] irq event stamp: 26269
<4> [56.011062] hardirqs last enabled at (26275): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [56.011064] hardirqs last disabled at (26280): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [56.011066] softirqs last enabled at (25464): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [56.011069] softirqs last disabled at (25457): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [56.011071] ---[ end trace 0000000000000000 ]---
<6> [56.011073] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [56.011153] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [56.011159] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [56.012412] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [56.012528] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [56.012648] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [56.012888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [56.012987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [56.013083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [56.013172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [56.013259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [56.013343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [56.013428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [56.013512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [56.013624] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [56.013724] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [56.013819] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [56.014850] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [56.025585] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [56.025838] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [56.026884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [56.026968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [56.027047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [56.027127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [56.027204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [56.027295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [56.027373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [56.027447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [56.027523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [56.027597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [56.027672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [56.027745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [56.027819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [56.027891] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [56.027963] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [56.028037] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [56.028110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [56.028181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [56.028265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [56.028346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [56.028428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [56.028508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [56.028585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [56.028663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [56.028740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [56.028815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [56.028889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [56.028963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [56.029037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [56.029113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [56.029204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [56.029283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [56.029362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [56.029439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [56.029520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [56.029602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [56.029685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [56.029762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [56.029838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [56.029913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [56.029988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [56.030063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [56.030137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [56.030223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [56.030302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [56.030377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [56.030452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [56.030526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [56.030598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [56.030672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [56.030749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [56.030826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [56.030902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [56.030976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [56.031049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [56.031123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [56.031210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [56.031285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [56.031360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [56.031436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [56.031511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [56.031587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [56.031662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [56.031739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [56.031814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [56.031888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [56.031962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [56.032033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [56.032107] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [56.032272] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [56.032276] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1422, lrc_seqno=1422, guc_id=0, flags=0x73 in no process [-1]
<7> [56.032278] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [56.032343] ------------[ cut here ]------------
<4> [56.032344] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [56.032346] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:0/12
<4> [56.032420] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [56.032485]
<4> [56.032487] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [56.032490] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [56.032491] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [56.032493] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [56.032498] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [56.032571] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [56.032573] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [56.032576] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [56.032577] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [56.032578] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [56.032580] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [56.032581] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [56.032582] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000
<4> [56.032584] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [56.032585] CR2: 0000732eb25ad000 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [56.032587] PKRU: 55555554
<4> [56.032588] Call Trace:
<4> [56.032589] <TASK>
<4> [56.032593] ? lock_acquire+0xb0/0x300
<4> [56.032598] ? lock_release+0xd0/0x2b0
<4> [56.032603] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [56.032609] process_one_work+0x239/0x740
<4> [56.032616] worker_thread+0x200/0x3f0
<4> [56.032619] ? __pfx_worker_thread+0x10/0x10
<4> [56.032621] kthread+0x10d/0x150
<4> [56.032624] ? __pfx_kthread+0x10/0x10
<4> [56.032627] ret_from_fork+0x3bd/0x470
<4> [56.032629] ? __pfx_kthread+0x10/0x10
<4> [56.032632] ret_from_fork_asm+0x1a/0x30
<4> [56.032640] </TASK>
<4> [56.032641] irq event stamp: 305077
<4> [56.032642] hardirqs last enabled at (305083): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [56.032644] hardirqs last disabled at (305088): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [56.032646] softirqs last enabled at (303996): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [56.032649] softirqs last disabled at (303989): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [56.032652] ---[ end trace 0000000000000000 ]---
<5> [56.032997] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1423, lrc_seqno=1423, guc_id=0, flags=0x73 in no process [-1]
<7> [56.033004] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [56.033146] ------------[ cut here ]------------
<4> [56.033148] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [56.033151] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:9/992
<4> [56.033243] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [56.033319]
<4> [56.033322] CPU: 1 UID: 0 PID: 992 Comm: kworker/u64:9 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [56.033325] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [56.033326] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [56.033328] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [56.033336] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [56.033418] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [56.033420] RSP: 0018:ffffc90003203ca0 EFLAGS: 00010246
<4> [56.033423] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [56.033425] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [56.033426] RBP: ffffc90003203db0 R08: 0000000000000000 R09: 0000000000000000
<4> [56.033427] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [56.033428] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [56.033429] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000
<4> [56.033431] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [56.033432] CR2: 0000573dd7f36020 CR3: 0000000123785002 CR4: 0000000000f72ef0
<4> [56.033434] PKRU: 55555554
<4> [56.033435] Call Trace:
<4> [56.033437] <TASK>
<4> [56.033442] ? lock_acquire+0xb0/0x300
<4> [56.033448] ? lock_release+0xd0/0x2b0
<4> [56.033453] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [56.033459] process_one_work+0x239/0x740
<4> [56.033467] worker_thread+0x200/0x3f0
<4> [56.033470] ? __pfx_worker_thread+0x10/0x10
<4> [56.033473] kthread+0x10d/0x150
<4> [56.033476] ? __pfx_kthread+0x10/0x10
<4> [56.033478] ret_from_fork+0x3bd/0x470
<4> [56.033481] ? __pfx_kthread+0x10/0x10
<4> [56.033483] ret_from_fork_asm+0x1a/0x30
<4> [56.033495] </TASK>
<4> [56.033498] irq event stamp: 575645
<4> [56.033500] hardirqs last enabled at (575651): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [56.033504] hardirqs last disabled at (575656): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [56.033507] softirqs last enabled at (574884): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [56.033512] softirqs last disabled at (574879): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [56.033515] ---[ end trace 0000000000000000 ]---
<6> [56.033520] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [56.033665] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [56.033676] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [56.033692] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [56.033797] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [56.033903] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [56.034132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [56.034228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [56.034326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [56.034419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [56.034510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [56.034605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [56.034698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [56.034789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [56.034873] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [56.034974] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [56.035094] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [56.036129] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [56.045805] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [56.046061] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [56.047068] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [56.047155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [56.047240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [56.047327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [56.047411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [56.047492] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [56.047571] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [56.047650] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [56.047731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [56.047824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [56.047904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [56.047983] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [56.048062] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [56.048142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [56.048220] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [56.048298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [56.048377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [56.048454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [56.048532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [56.048621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [56.048708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [56.048802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [56.048885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [56.048964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [56.049043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [56.049119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [56.049195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [56.049269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [56.049345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [56.049426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [56.049506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [56.049584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [56.049660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [56.049742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [56.049824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [56.049907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [56.049987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [56.050065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [56.050143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [56.050218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [56.050296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [56.050370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [56.050442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [56.050517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [56.050593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [56.050669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [56.050753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [56.050828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [56.050901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [56.050976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [56.051054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [56.051131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [56.051207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [56.051280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [56.051354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [56.051428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [56.051505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [56.051579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [56.051650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [56.051737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [56.051812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [56.051888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [56.051963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [56.052037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [56.052114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [56.052188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [56.052260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [56.052332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [56.052410] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [56.052562] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [56.052566] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1423, lrc_seqno=1423, guc_id=0, flags=0x73 in no process [-1]
<7> [56.052569] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [56.052633] ------------[ cut here ]------------
<4> [56.052634] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [56.052635] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:11/1198
<4> [56.052725] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [56.052790]
<4> [56.052792] CPU: 8 UID: 0 PID: 1198 Comm: kworker/u64:11 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [56.052795] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [56.052796] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [56.052798] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [56.052803] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [56.052876] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [56.052878] RSP: 0018:ffffc90001903ca0 EFLAGS: 00010246
<4> [56.052880] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [56.052881] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [56.052883] RBP: ffffc90001903db0 R08: 0000000000000000 R09: 0000000000000000
<4> [56.052884] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [56.052885] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [56.052886] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000
<4> [56.052888] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [56.052889] CR2: 000079d503c55000 CR3: 000000011b756006 CR4: 0000000000f72ef0
<4> [56.052891] PKRU: 55555554
<4> [56.052892] Call Trace:
<4> [56.052893] <TASK>
<4> [56.052897] ? lock_acquire+0xb0/0x300
<4> [56.052902] ? lock_release+0xd0/0x2b0
<4> [56.052906] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [56.052912] process_one_work+0x239/0x740
<4> [56.052919] worker_thread+0x200/0x3f0
<4> [56.052922] ? __pfx_worker_thread+0x10/0x10
<4> [56.052925] kthread+0x10d/0x150
<4> [56.052927] ? __pfx_kthread+0x10/0x10
<4> [56.052930] ret_from_fork+0x3bd/0x470
<4> [56.052932] ? __pfx_kthread+0x10/0x10
<4> [56.052934] ret_from_fork_asm+0x1a/0x30
<4> [56.052942] </TASK>
<4> [56.052943] irq event stamp: 30109
<4> [56.052944] hardirqs last enabled at (30115): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [56.052946] hardirqs last disabled at (30120): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [56.052948] softirqs last enabled at (28866): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [56.052951] softirqs last disabled at (28857): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [56.052953] ---[ end trace 0000000000000000 ]---
<6> [56.052955] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [56.053028] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [56.053034] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [56.054264] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [56.054371] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [56.054478] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [56.054705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [56.054797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [56.054889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [56.054975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [56.055062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [56.055148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [56.055234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [56.055320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [56.055400] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [56.055496] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [56.055595] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [56.056626] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [56.066337] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [56.066589] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [56.067649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [56.067739] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [56.067821] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [56.067900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [56.067977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [56.068054] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [56.068130] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [56.068204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [56.068278] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [56.068371] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [56.068445] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [56.068519] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [56.068592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [56.068665] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [56.068737] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [56.068809] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [56.068881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [56.068953] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [56.069026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [56.069109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [56.069191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [56.069277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [56.069354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [56.069431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [56.069510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [56.069586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [56.069661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [56.069736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [56.069812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [56.069889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [56.069967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [56.070043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [56.070120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [56.070194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [56.070282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [56.070362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [56.070444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [56.070524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [56.070603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [56.070677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [56.070754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [56.070829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [56.070901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [56.070976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [56.071053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [56.071129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [56.071204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [56.071289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [56.071362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [56.071437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [56.071514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [56.071589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [56.071669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [56.071747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [56.071821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [56.071896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [56.071970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [56.072043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [56.072117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [56.072192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [56.072292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [56.072367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [56.072441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [56.072512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [56.072586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [56.072658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [56.072730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [56.072802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [56.072877] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [56.073028] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [56.073032] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1423, lrc_seqno=1423, guc_id=0, flags=0x73 in no process [-1]
<7> [56.073035] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [56.073099] ------------[ cut here ]------------
<4> [56.073100] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [56.073102] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:3/194
<4> [56.073183] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [56.073248]
<4> [56.073250] CPU: 6 UID: 0 PID: 194 Comm: kworker/u64:3 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [56.073253] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [56.073255] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [56.073256] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [56.073261] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [56.073336] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [56.073338] RSP: 0018:ffffc900015cfca0 EFLAGS: 00010246
<4> [56.073340] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [56.073342] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [56.073343] RBP: ffffc900015cfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [56.073344] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [56.073345] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [56.073347] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000
<4> [56.073348] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [56.073350] CR2: 000079d503ffe000 CR3: 000000011e8d6004 CR4: 0000000000f72ef0
<4> [56.073351] PKRU: 55555554
<4> [56.073352] Call Trace:
<4> [56.073354] <TASK>
<4> [56.073357] ? lock_acquire+0xb0/0x300
<4> [56.073362] ? lock_release+0xd0/0x2b0
<4> [56.073367] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [56.073373] process_one_work+0x239/0x740
<4> [56.073379] worker_thread+0x200/0x3f0
<4> [56.073382] ? __pfx_worker_thread+0x10/0x10
<4> [56.073385] kthread+0x10d/0x150
<4> [56.073387] ? __pfx_kthread+0x10/0x10
<4> [56.073390] ret_from_fork+0x3bd/0x470
<4> [56.073392] ? __pfx_kthread+0x10/0x10
<4> [56.073395] ret_from_fork_asm+0x1a/0x30
<4> [56.073402] </TASK>
<4> [56.073403] irq event stamp: 278613
<4> [56.073405] hardirqs last enabled at (278619): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [56.073407] hardirqs last disabled at (278624): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [56.073408] softirqs last enabled at (277646): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [56.073411] softirqs last disabled at (277557): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [56.073414] ---[ end trace 0000000000000000 ]---
<5> [56.074380] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1424, lrc_seqno=1424, guc_id=0, flags=0x73 in no process [-1]
<7> [56.074384] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [56.074456] ------------[ cut here ]------------
<4> [56.074458] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<7> [56.074428] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<4> [56.074459] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:3/194
<4> [56.074543] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64
<7> [56.074535] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<4> [56.074586] video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [56.074612] CPU: 2 UID: 0 PID: 194 Comm: kworker/u64:3 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [56.074614] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [56.074616] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [56.074617] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [56.074622] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [56.074698] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [56.074700] RSP: 0018:ffffc900015cfca0 EFLAGS: 00010246
<4> [56.074702] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [56.074703] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [56.074705] RBP: ffffc900015cfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [56.074706] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [56.074707] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [56.074708] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000
<4> [56.074710] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [56.074711] CR2: 0000732eb25aa000 CR3: 000000012441f001 CR4: 0000000000f72ef0
<4> [56.074712] PKRU: 55555554
<4> [56.074714] Call Trace:
<4> [56.074715] <TASK>
<4> [56.074718] ? lock_acquire+0xb0/0x300
<4> [56.074723] ? lock_release+0xd0/0x2b0
<4> [56.074728] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [56.074734] process_one_work+0x239/0x740
<4> [56.074740] worker_thread+0x200/0x3f0
<4> [56.074743] ? __pfx_worker_thread+0x10/0x10
<4> [56.074746] kthread+0x10d/0x150
<4> [56.074748] ? __pfx_kthread+0x10/0x10
<4> [56.074751] ret_from_fork+0x3bd/0x470
<4> [56.074753] ? __pfx_kthread+0x10/0x10
<4> [56.074756] ret_from_fork_asm+0x1a/0x30
<4> [56.074763] </TASK>
<4> [56.074764] irq event stamp: 279475
<4> [56.074765] hardirqs last enabled at (279481): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [56.074768] hardirqs last disabled at (279486): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [56.074769] softirqs last enabled at (277646): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [56.074772] softirqs last disabled at (277557): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [56.074775] ---[ end trace 0000000000000000 ]---
<6> [56.074777] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [56.074850] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [56.074856] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [56.075270] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [56.075500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [56.075596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [56.075691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [56.075782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [56.075868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [56.075952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [56.076036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [56.076136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [56.076224] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [56.076320] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [56.076411] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [56.077447] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [56.087848] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [56.088098] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [56.089103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [56.089193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [56.089271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [56.089349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [56.089426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [56.089503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [56.089579] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [56.089655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [56.089730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [56.089824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [56.089906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [56.089981] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [56.090053] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [56.090125] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [56.090198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [56.090270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [56.090343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [56.090414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [56.090487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [56.090571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [56.090652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [56.090730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [56.090820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [56.090910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [56.090987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [56.091062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [56.091136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [56.091211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [56.091285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [56.091360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [56.091436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [56.091511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [56.091588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [56.091663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [56.091744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [56.091844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [56.091936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [56.092014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [56.092092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [56.092168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [56.092248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [56.092327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [56.092404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [56.092481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [56.092560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [56.092636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [56.092712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [56.092803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [56.092889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [56.092964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [56.093040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [56.093113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [56.093188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [56.093262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [56.093336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [56.093409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [56.093483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [56.093557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [56.093629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [56.093712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [56.093800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [56.093874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [56.093947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [56.094019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [56.094094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [56.094169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [56.094242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [56.094314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [56.094391] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [56.094547] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [56.094551] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1424, lrc_seqno=1424, guc_id=0, flags=0x73 in no process [-1]
<7> [56.094554] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [56.094619] ------------[ cut here ]------------
<4> [56.094620] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [56.094622] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:0/12
<4> [56.094715] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [56.094802]
<4> [56.094805] CPU: 5 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [56.094808] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [56.094809] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [56.094810] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [56.094816] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [56.094888] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [56.094890] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [56.094892] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [56.094893] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [56.094895] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [56.094896] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [56.094897] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [56.094898] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000
<4> [56.094900] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [56.094901] CR2: 000079d50a742098 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [56.094903] PKRU: 55555554
<4> [56.094904] Call Trace:
<4> [56.094905] <TASK>
<4> [56.094909] ? lock_acquire+0xb0/0x300
<4> [56.094914] ? lock_release+0xd0/0x2b0
<4> [56.094919] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [56.094925] process_one_work+0x239/0x740
<4> [56.094932] worker_thread+0x200/0x3f0
<4> [56.094935] ? __pfx_worker_thread+0x10/0x10
<4> [56.094937] kthread+0x10d/0x150
<4> [56.094940] ? __pfx_kthread+0x10/0x10
<4> [56.094943] ret_from_fork+0x3bd/0x470
<4> [56.094945] ? __pfx_kthread+0x10/0x10
<4> [56.094947] ret_from_fork_asm+0x1a/0x30
<4> [56.094955] </TASK>
<4> [56.094956] irq event stamp: 308795
<4> [56.094957] hardirqs last enabled at (308801): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [56.094959] hardirqs last disabled at (308806): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [56.094961] softirqs last enabled at (307558): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [56.094964] softirqs last disabled at (307551): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [56.094966] ---[ end trace 0000000000000000 ]---
<6> [56.095667] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [56.095787] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [56.095798] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [56.095985] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [56.096089] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [56.096195] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [56.096412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [56.096506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [56.096602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [56.096709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [56.096796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [56.096882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [56.096967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [56.097053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [56.097133] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [56.097230] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [56.097321] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [56.098352] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [56.108379] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [56.108635] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [56.109610] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [56.109691] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [56.109772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [56.109852] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [56.109930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [56.110006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [56.110083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [56.110158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [56.110233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [56.110305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [56.110392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [56.110468] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [56.110541] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [56.110613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [56.110687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [56.110762] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [56.110836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [56.110907] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [56.110977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [56.111061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [56.111145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [56.111224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [56.111307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [56.111386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [56.111468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [56.111548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [56.111627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [56.111704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [56.111782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [56.111861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [56.111940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [56.112018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [56.112094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [56.112170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [56.112251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [56.112343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [56.112427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [56.112504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [56.112581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [56.112656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [56.112730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [56.112805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [56.112879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [56.112953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [56.113026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [56.113101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [56.113174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [56.113248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [56.113350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [56.113430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [56.113508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [56.113583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [56.113661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [56.113736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [56.113810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [56.113884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [56.113958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [56.114029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [56.114100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [56.114175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [56.114252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [56.114329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [56.114404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [56.114476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [56.114550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [56.114623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [56.114695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [56.114767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [56.114841] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [56.114992] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [56.114996] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1424, lrc_seqno=1424, guc_id=0, flags=0x73 in no process [-1]
<7> [56.114998] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [56.115065] ------------[ cut here ]------------
<4> [56.115066] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [56.115068] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:0/12
<4> [56.115142] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [56.115206]
<4> [56.115208] CPU: 2 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [56.115211] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [56.115212] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [56.115217] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [56.115223] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [56.115294] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [56.115296] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [56.115298] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [56.115300] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [56.115301] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [56.115302] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [56.115303] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [56.115305] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000
<4> [56.115306] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [56.115308] CR2: 0000732eb25aa000 CR3: 000000012441f001 CR4: 0000000000f72ef0
<4> [56.115309] PKRU: 55555554
<4> [56.115310] Call Trace:
<4> [56.115311] <TASK>
<4> [56.115315] ? lock_acquire+0xb0/0x300
<4> [56.115320] ? lock_release+0xd0/0x2b0
<4> [56.115325] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [56.115331] process_one_work+0x239/0x740
<4> [56.115337] worker_thread+0x200/0x3f0
<4> [56.115340] ? __pfx_worker_thread+0x10/0x10
<4> [56.115343] kthread+0x10d/0x150
<4> [56.115345] ? __pfx_kthread+0x10/0x10
<4> [56.115348] ret_from_fork+0x3bd/0x470
<4> [56.115350] ? __pfx_kthread+0x10/0x10
<4> [56.115353] ret_from_fork_asm+0x1a/0x30
<4> [56.115361] </TASK>
<4> [56.115362] irq event stamp: 312223
<4> [56.115363] hardirqs last enabled at (312229): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [56.115365] hardirqs last disabled at (312234): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [56.115367] softirqs last enabled at (311256): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [56.115370] softirqs last disabled at (311249): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [56.115372] ---[ end trace 0000000000000000 ]---
<5> [56.116384] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1425, lrc_seqno=1425, guc_id=0, flags=0x73 in no process [-1]
<7> [56.116388] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<7> [56.116390] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<4> [56.116462] ------------[ cut here ]------------
<4> [56.116463] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [56.116464] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:7/709
<4> [56.116544] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb
<7> [56.116500] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<4> [56.116549] mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [56.116612] CPU: 4 UID: 0 PID: 709 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [56.116615] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [56.116616] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [56.116618] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [56.116623] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [56.116697] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [56.116698] RSP: 0018:ffffc90001fdfca0 EFLAGS: 00010246
<4> [56.116701] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [56.116702] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [56.116703] RBP: ffffc90001fdfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [56.116705] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [56.116706] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [56.116707] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000
<4> [56.116709] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [56.116710] CR2: 0000732eb25af000 CR3: 000000012441f003 CR4: 0000000000f72ef0
<4> [56.116712] PKRU: 55555554
<4> [56.116713] Call Trace:
<4> [56.116714] <TASK>
<4> [56.116717] ? lock_acquire+0xb0/0x300
<4> [56.116722] ? lock_release+0xd0/0x2b0
<4> [56.116727] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [56.116733] process_one_work+0x239/0x740
<4> [56.116739] worker_thread+0x200/0x3f0
<4> [56.116742] ? __pfx_worker_thread+0x10/0x10
<4> [56.116745] kthread+0x10d/0x150
<4> [56.116747] ? __pfx_kthread+0x10/0x10
<4> [56.116750] ret_from_fork+0x3bd/0x470
<4> [56.116752] ? __pfx_kthread+0x10/0x10
<4> [56.116755] ret_from_fork_asm+0x1a/0x30
<4> [56.116762] </TASK>
<4> [56.116763] irq event stamp: 475001
<4> [56.116764] hardirqs last enabled at (475007): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [56.116767] hardirqs last disabled at (475012): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [56.116768] softirqs last enabled at (473950): [<ffffffff8133ad83>] kernel_fpu_end+0x53/0x70
<4> [56.116771] softirqs last disabled at (473948): [<ffffffff8133b494>] kernel_fpu_begin_mask+0xc4/0x120
<4> [56.116773] ---[ end trace 0000000000000000 ]---
<6> [56.116775] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [56.116847] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [56.116853] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [56.117261] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [56.117482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [56.117576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [56.117670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [56.117757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [56.117841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [56.117926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [56.118009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [56.118095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [56.118182] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [56.118277] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [56.118370] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [56.119402] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [56.129887] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [56.130138] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [56.131123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [56.131205] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [56.131281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [56.131357] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [56.131432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [56.131510] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [56.131587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [56.131660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [56.131732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [56.131803] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [56.131887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [56.131959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [56.132032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [56.132104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [56.132174] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [56.132246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [56.132319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [56.132391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [56.132464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [56.132545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [56.132626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [56.132703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [56.132778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [56.132865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [56.132942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [56.133016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [56.133092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [56.133166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [56.133242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [56.133318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [56.133396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [56.133472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [56.133548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [56.133624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [56.133705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [56.133785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [56.133884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [56.133966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [56.134046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [56.134122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [56.134197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [56.134270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [56.134341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [56.134416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [56.134492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [56.134566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [56.134640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [56.134711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [56.134785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [56.134860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [56.134936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [56.135008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [56.135083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [56.135157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [56.135233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [56.135308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [56.135382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [56.135453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [56.135526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [56.135602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [56.135676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [56.135752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [56.135828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [56.135901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [56.135975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [56.136048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [56.136121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [56.136191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [56.136267] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [56.136419] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [56.136423] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1425, lrc_seqno=1425, guc_id=0, flags=0x73 in no process [-1]
<7> [56.136425] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [56.136490] ------------[ cut here ]------------
<4> [56.136491] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [56.136492] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:0/12
<4> [56.136566] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [56.136630]
<4> [56.136632] CPU: 6 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [56.136635] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [56.136636] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [56.136637] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [56.136643] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [56.136725] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [56.136727] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [56.136730] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [56.136731] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [56.136733] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [56.136734] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [56.136736] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [56.136737] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000
<4> [56.136739] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [56.136741] CR2: 000079d503ffe000 CR3: 000000012441f005 CR4: 0000000000f72ef0
<4> [56.136742] PKRU: 55555554
<4> [56.136743] Call Trace:
<4> [56.136744] <TASK>
<4> [56.136748] ? lock_acquire+0xb0/0x300
<4> [56.136753] ? lock_release+0xd0/0x2b0
<4> [56.136758] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [56.136764] process_one_work+0x239/0x740
<4> [56.136771] worker_thread+0x200/0x3f0
<4> [56.136774] ? __pfx_worker_thread+0x10/0x10
<4> [56.136777] kthread+0x10d/0x150
<4> [56.136779] ? __pfx_kthread+0x10/0x10
<4> [56.136782] ret_from_fork+0x3bd/0x470
<4> [56.136784] ? __pfx_kthread+0x10/0x10
<4> [56.136787] ret_from_fork_asm+0x1a/0x30
<4> [56.136795] </TASK>
<4> [56.136796] irq event stamp: 315587
<4> [56.136797] hardirqs last enabled at (315593): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [56.136799] hardirqs last disabled at (315598): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [56.136801] softirqs last enabled at (314354): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [56.136804] softirqs last disabled at (314349): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [56.136806] ---[ end trace 0000000000000000 ]---
<6> [56.137745] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [56.137818] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [56.137824] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [56.137877] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [56.137981] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [56.138088] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [56.138308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [56.138398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [56.138492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [56.138579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [56.138666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [56.138767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [56.138852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [56.138940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [56.139021] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [56.139119] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [56.139208] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [56.140241] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [56.150418] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [56.150669] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [56.151703] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [56.151787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [56.151867] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [56.151944] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [56.152020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [56.152094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [56.152169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [56.152242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [56.152315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [56.152397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [56.152471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [56.152543] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [56.152613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [56.152686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [56.152758] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [56.152831] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [56.152904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [56.152975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [56.153046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [56.153129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [56.153209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [56.153288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [56.153371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [56.153450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [56.153527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [56.153604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [56.153680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [56.153757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [56.153833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [56.153911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [56.153988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [56.154062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [56.154137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [56.154213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [56.154292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [56.154381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [56.154466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [56.154542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [56.154620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [56.154693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [56.154768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [56.154843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [56.154917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [56.154996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [56.155073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [56.155150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [56.155225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [56.155301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [56.155392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [56.155467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [56.155544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [56.155620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [56.155695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [56.155768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [56.155842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [56.155916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [56.155991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [56.156064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [56.156135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [56.156212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [56.156291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [56.156368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [56.156443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [56.156518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [56.156593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [56.156667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [56.156738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [56.156808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [56.156883] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [56.157034] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [56.157038] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1425, lrc_seqno=1425, guc_id=0, flags=0x73 in no process [-1]
<7> [56.157040] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [56.157107] ------------[ cut here ]------------
<4> [56.157108] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [56.157109] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:0/12
<4> [56.157184] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [56.157249]
<4> [56.157251] CPU: 6 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [56.157258] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [56.157259] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [56.157260] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [56.157266] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [56.157344] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [56.157345] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [56.157348] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [56.157349] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [56.157350] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [56.157351] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [56.157353] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [56.157354] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000
<4> [56.157356] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [56.157357] CR2: 000079d503ffe000 CR3: 000000012441f005 CR4: 0000000000f72ef0
<4> [56.157358] PKRU: 55555554
<4> [56.157360] Call Trace:
<4> [56.157361] <TASK>
<4> [56.157365] ? lock_acquire+0xb0/0x300
<4> [56.157370] ? lock_release+0xd0/0x2b0
<4> [56.157375] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [56.157381] process_one_work+0x239/0x740
<4> [56.157387] worker_thread+0x200/0x3f0
<4> [56.157390] ? __pfx_worker_thread+0x10/0x10
<4> [56.157393] kthread+0x10d/0x150
<4> [56.157395] ? __pfx_kthread+0x10/0x10
<4> [56.157398] ret_from_fork+0x3bd/0x470
<4> [56.157400] ? __pfx_kthread+0x10/0x10
<4> [56.157403] ret_from_fork_asm+0x1a/0x30
<4> [56.157411] </TASK>
<4> [56.157412] irq event stamp: 318963
<4> [56.157413] hardirqs last enabled at (318969): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [56.157415] hardirqs last disabled at (318974): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [56.157417] softirqs last enabled at (317996): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [56.157419] softirqs last disabled at (317985): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [56.157422] ---[ end trace 0000000000000000 ]---
<5> [56.157794] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1426, lrc_seqno=1426, guc_id=0, flags=0x73 in no process [-1]
<7> [56.157802] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [56.157931] ------------[ cut here ]------------
<4> [56.157932] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [56.157934] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:7/709
<4> [56.158028] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [56.158103]
<4> [56.158107] CPU: 2 UID: 0 PID: 709 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [56.158112] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [56.158113] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [56.158115] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [56.158123] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [56.158212] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [56.158214] RSP: 0018:ffffc90001fdfca0 EFLAGS: 00010246
<4> [56.158216] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [56.158218] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [56.158219] RBP: ffffc90001fdfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [56.158220] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [56.158221] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [56.158223] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000
<4> [56.158224] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [56.158225] CR2: 0000732eb25aa000 CR3: 000000000344a004 CR4: 0000000000f72ef0
<4> [56.158227] PKRU: 55555554
<4> [56.158228] Call Trace:
<4> [56.158229] <TASK>
<4> [56.158249] ? lock_acquire+0xb0/0x300
<4> [56.158258] ? lock_release+0xd0/0x2b0
<4> [56.158263] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [56.158269] process_one_work+0x239/0x740
<4> [56.158276] worker_thread+0x200/0x3f0
<4> [56.158279] ? __pfx_worker_thread+0x10/0x10
<4> [56.158282] kthread+0x10d/0x150
<4> [56.158286] ? __pfx_kthread+0x10/0x10
<4> [56.158289] ret_from_fork+0x3bd/0x470
<4> [56.158292] ? __pfx_kthread+0x10/0x10
<4> [56.158295] ret_from_fork_asm+0x1a/0x30
<4> [56.158302] </TASK>
<4> [56.158303] irq event stamp: 476279
<4> [56.158305] hardirqs last enabled at (476285): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [56.158309] hardirqs last disabled at (476290): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [56.158310] softirqs last enabled at (476206): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [56.158315] softirqs last disabled at (476201): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [56.158318] ---[ end trace 0000000000000000 ]---
<6> [56.158320] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [56.158426] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [56.158432] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [56.158490] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [56.158598] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [56.158748] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0.
<7> [56.159007] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [56.159257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [56.159351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [56.159445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [56.159533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [56.159619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [56.159705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [56.159791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [56.159877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [56.159957] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [56.160055] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [56.160148] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [56.161228] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [56.170949] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [56.171201] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [56.172186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [56.172267] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [56.172345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [56.172424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [56.172500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [56.172575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [56.172653] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [56.172730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [56.172806] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [56.172881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [56.172968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [56.173042] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [56.173116] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [56.173188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [56.173262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [56.173336] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [56.173410] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [56.173482] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [56.173553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [56.173636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [56.173720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff
<7> [56.173801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [56.173887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [56.173967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008
<7> [56.174045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [56.174120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [56.174196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [56.174269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [56.174343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [56.174420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [56.174497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [56.174574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [56.174650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [56.174725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [56.174807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [56.174896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [56.174977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [56.175056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003
<7> [56.175134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [56.175210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [56.175285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff
<7> [56.175361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [56.175434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [56.175508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008
<7> [56.175583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [56.175657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [56.175732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff
<7> [56.175805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [56.175892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [56.175970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008
<7> [56.176049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [56.176123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [56.176196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff
<7> [56.176270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [56.176345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [56.176421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008
<7> [56.176497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [56.176572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [56.176647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [56.176724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [56.176799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [56.176892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff
<7> [56.176967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [56.177039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [56.177117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008
<7> [56.177196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [56.177272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [56.177345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [56.177420] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [56.177574] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [56.177578] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1426, lrc_seqno=1426, guc_id=0, flags=0x73 in no process [-1]
<7> [56.177581] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [56.177648] ------------[ cut here ]------------
<4> [56.177649] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [56.177650] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:0/12
<4> [56.177725] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp asus_nb_wmi cmdlinepart asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid intel_cstate realtek nls_iso8859_1 phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep intel_pmc_core snd_pcm pmt_telemetry pmt_discovery pmt_class snd_timer i2c_i801 i2c_mux spi_intel_pci snd mei_me intel_pmc_ssram_telemetry spi_intel i2c_smbus soundcore acpi_tad acpi_pad pinctrl_alderlake intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [56.177795]
<4> [56.177798] CPU: 2 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.1.0-rc4-lgci-xe-xe-pw-164149v2-debug+ #1 PREEMPT(lazy)
<4> [56.177800] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [56.177802] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [56.177803] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [56.177809] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe]
<4> [56.177883] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e0 d7 3c e1 48 89 c6 48 8d 3d d6 8b d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49
<4> [56.177885] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [56.177887] RAX: ffffffffa12bc195 RBX: 0000000000000000 RCX: 0000000000000000
<4> [56.177889] RDX: ffff888104ddc410 RSI: ffffffffa12bc195 RDI: ffffffffa0c04020
<4> [56.177890] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [56.177891] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [56.177892] R13: ffff888104ddc410 R14: ffff888115643818 R15: 00000000ffffffc2
<4> [56.177894] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000
<4> [56.177895] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [56.177896] CR2: 0000732eb25aa000 CR3: 000000000344a004 CR4: 0000000000f72ef0
<4> [56.177898] PKRU: 55555554
<4> [56.177899] Call Trace:
<4> [56.177900] <TASK>
<4> [56.177904] ? lock_acquire+0xb0/0x300
<4> [56.177909] ? lock_release+0xd0/0x2b0
<4> [56.177914] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [56.177920] process_one_work+0x239/0x740
<4> [56.177926] worker_thread+0x200/0x3f0
<4> [56.177929] ? __pfx_worker_thread+0x10/0x10
<4> [56.177932] kthread+0x10d/0x150
<4> [56.177934] ? __pfx_kthread+0x10/0x10
<4> [56.177937] ret_from_fork+0x3bd/0x470
<4> [56.177939] ? __pfx_kthread+0x10/0x10
<4> [56.177942] ret_from_fork_asm+0x1a/0x30
<4> [56.177949] </TASK>
<4> [56.177951] irq event stamp: 322363
<4> [56.177952] hardirqs last enabled at (322369): [<ffffffff814ab629>] __up_console_sem+0x79/0xa0
<4> [56.177954] hardirqs last disabled at (322374): [<ffffffff814ab60e>] __up_console_sem+0x5e/0xa0
<4> [56.177955] softirqs last enabled at (321404): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [56.177958] softirqs last disabled at (321399): [<ffffffff813d233b>] __irq_exit_rcu+0xdb/0x1c0
<4> [56.177961] ---[ end trace 0000000000000000 ]---
<6> [56.177963] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [56.178036] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [56.178042] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [56.178428] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
Created at 2026-05-20 18:49:47