igt@xe_exec_system_allocator@threads-many-stride-new-bo-map-nomemset on shard-bmg@xe-4691-bf3ba6a508ffb59323357535a459eb64f02d94f7 Test details

Detail	Value
Duration	unknown
Hostname	shard-bmg-10
Igt-Version	IGT-Version: 2.3-gb319fd181 (x86_64) (Linux: 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ x86_64)
Out	Using IGT_SRANDOM=1773221772 for randomisation Opened device: /dev/dri/card0 Starting subtest: threads-many-stride-new-bo-map-nomemset [thread:6199] Stack trace: [thread:6196] Stack trace: [thread:6195] Stack trace: [thread:6197] Stack trace: [thread:6197] #0 ../lib/igt_core.c:2075 __igt_fail_assert() [thread:6196] #0 ../lib/igt_core.c:2075 __igt_fail_assert() [thread:6199] #0 ../lib/igt_core.c:2075 __igt_fail_assert() [thread:6195] #0 ../lib/igt_core.c:2075 __igt_fail_assert() [thread:6197] #1 [xe_wait_ufence+0x57] [thread:6196] #1 [xe_wait_ufence+0x57] [thread:6199] #1 [xe_wait_ufence+0x57] [thread:6197] #2 ../tests/intel/xe_exec_system_allocator.c:1757 test_exec() [thread:6197] #3 ../tests/intel/xe_exec_system_allocator.c:2047 thread() [thread:6195] #1 [xe_wait_ufence+0x57] [thread:6196] #2 ../tests/intel/xe_exec_system_allocator.c:1757 test_exec() [thread:6196] #3 ../tests/intel/xe_exec_system_allocator.c:2047 thread() [thread:6199] #2 ../tests/intel/xe_exec_system_allocator.c:1757 test_exec() [thread:6199] #3 ../tests/intel/xe_exec_system_allocator.c:2047 thread() [thread:6195] #2 ../tests/intel/xe_exec_system_allocator.c:1757 test_exec() [thread:6195] #3 ../tests/intel/xe_exec_system_allocator.c:2047 thread() [thread:6197] #4 [pthread_condattr_setpshared+0x684] [thread:6196] #4 [pthread_condattr_setpshared+0x684] [thread:6199] #4 [pthread_condattr_setpshared+0x684] [thread:6197] #5 [__clone+0x24c] [thread:6195] #4 [pthread_condattr_setpshared+0x684] [thread:6196] #5 [__clone+0x24c] [thread:6199] #5 [__clone+0x24c] [thread:6195] #5 [__clone+0x24c] [thread:6198] Stack trace: [thread:6201] Stack trace: [thread:6200] Stack trace: [thread:6198] #0 ../lib/igt_core.c:2075 __igt_fail_assert() [thread:6201] #0 ../lib/igt_core.c:2075 __igt_fail_assert() [thread:6198] #1 [xe_wait_ufence+0x57] [thread:6201] #1 [xe_wait_ufence+0x57] [thread:6198] #2 ../tests/intel/xe_exec_system_allocator.c:1757 test_exec() [thread:6198] #3 ../tests/intel/xe_exec_system_allocator.c:2047 thread() [thread:6200] #0 ../lib/igt_core.c:2075 __igt_fail_assert() [thread:6201] #2 ../tests/intel/xe_exec_system_allocator.c:1757 test_exec() [thread:6201] #3 ../tests/intel/xe_exec_system_allocator.c:2047 thread() [thread:6198] #4 [pthread_condattr_setpshared+0x684] [thread:6201] #4 [pthread_condattr_setpshared+0x684] [thread:6200] #1 [xe_wait_ufence+0x57] [thread:6198] #5 [__clone+0x24c] [thread:6201] #5 [__clone+0x24c] [thread:6200] #2 ../tests/intel/xe_exec_system_allocator.c:1757 test_exec() [thread:6200] #3 ../tests/intel/xe_exec_system_allocator.c:2047 thread() [thread:6200] #4 [pthread_condattr_setpshared+0x684] [thread:6200] #5 [__clone+0x24c] Subtest threads-many-stride-new-bo-map-nomemset: FAIL (12.239s) This test caused an abort condition: Kernel badly tainted (0x4244, 0x200) (check dmesg for details): TAINT_WARN: WARN_ON has happened.
Err	Starting subtest: threads-many-stride-new-bo-map-nomemset (xe_exec_system_allocator:6193) [thread:6199] xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_exec_system_allocator:6193) [thread:6199] xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_exec_system_allocator:6193) [thread:6199] xe/xe_ioctl-CRITICAL: Last errno: 62, Timer expired (xe_exec_system_allocator:6193) [thread:6199] xe/xe_ioctl-CRITICAL: error: -62 != 0 (xe_exec_system_allocator:6193) [thread:6196] xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_exec_system_allocator:6193) [thread:6196] xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_exec_system_allocator:6193) [thread:6195] xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_exec_system_allocator:6193) [thread:6195] xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_exec_system_allocator:6193) [thread:6195] xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_exec_system_allocator:6193) [thread:6195] xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_exec_system_allocator:6193) [thread:6196] xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_exec_system_allocator:6193) [thread:6196] xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_exec_system_allocator:6193) [thread:6197] xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_exec_system_allocator:6193) [thread:6197] xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_exec_system_allocator:6193) [thread:6197] xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_exec_system_allocator:6193) [thread:6197] xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_exec_system_allocator:6193) [thread:6201] xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_exec_system_allocator:6193) [thread:6201] xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_exec_system_allocator:6193) [thread:6201] xe/xe_ioctl-CRITICAL: Last errno: 62, Timer expired (xe_exec_system_allocator:6193) [thread:6201] xe/xe_ioctl-CRITICAL: error: -62 != 0 (xe_exec_system_allocator:6193) [thread:6200] xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_exec_system_allocator:6193) [thread:6198] xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_exec_system_allocator:6193) [thread:6198] xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_exec_system_allocator:6193) [thread:6198] xe/xe_ioctl-CRITICAL: Last errno: 62, Timer expired (xe_exec_system_allocator:6193) [thread:6198] xe/xe_ioctl-CRITICAL: error: -62 != 0 (xe_exec_system_allocator:6193) [thread:6200] xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_exec_system_allocator:6193) [thread:6200] xe/xe_ioctl-CRITICAL: Last errno: 62, Timer expired (xe_exec_system_allocator:6193) [thread:6200] xe/xe_ioctl-CRITICAL: error: -62 != 0 (xe_exec_system_allocator:6193) igt_thread-CRITICAL: Failure in a thread! Subtest threads-many-stride-new-bo-map-nomemset failed. ** DEBUG (xe_exec_system_allocator:6193) [thread:6199] xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_exec_system_allocator:6193) [thread:6199] xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_exec_system_allocator:6193) [thread:6199] xe/xe_ioctl-CRITICAL: Last errno: 62, Timer expired (xe_exec_system_allocator:6193) [thread:6199] xe/xe_ioctl-CRITICAL: error: -62 != 0 (xe_exec_system_allocator:6193) [thread:6196] xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_exec_system_allocator:6193) [thread:6195] xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_exec_system_allocator:6193) [thread:6196] xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_exec_system_allocator:6193) [thread:6196] xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_exec_system_allocator:6193) [thread:6195] xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_exec_system_allocator:6193) [thread:6195] xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_exec_system_allocator:6193) [thread:6195] xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_exec_system_allocator:6193) [thread:6196] xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_exec_system_allocator:6193) [thread:6199] igt_core-INFO: Stack trace: (xe_exec_system_allocator:6193) [thread:6196] igt_core-INFO: Stack trace: (xe_exec_system_allocator:6193) [thread:6195] igt_core-INFO: Stack trace: (xe_exec_system_allocator:6193) [thread:6197] xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_exec_system_allocator:6193) [thread:6197] xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_exec_system_allocator:6193) [thread:6197] xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_exec_system_allocator:6193) [thread:6197] xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_exec_system_allocator:6193) [thread:6197] igt_core-INFO: Stack trace: (xe_exec_system_allocator:6193) [thread:6197] igt_core-INFO: #0 ../lib/igt_core.c:2075 __igt_fail_assert() (xe_exec_system_allocator:6193) [thread:6196] igt_core-INFO: #0 ../lib/igt_core.c:2075 __igt_fail_assert() (xe_exec_system_allocator:6193) [thread:6199] igt_core-INFO: #0 ../lib/igt_core.c:2075 __igt_fail_assert() (xe_exec_system_allocator:6193) [thread:6195] igt_core-INFO: #0 ../lib/igt_core.c:2075 __igt_fail_assert() (xe_exec_system_allocator:6193) [thread:6197] igt_core-INFO: #1 [xe_wait_ufence+0x57] (xe_exec_system_allocator:6193) [thread:6196] igt_core-INFO: #1 [xe_wait_ufence+0x57] (xe_exec_system_allocator:6193) [thread:6199] igt_core-INFO: #1 [xe_wait_ufence+0x57] (xe_exec_system_allocator:6193) [thread:6197] igt_core-INFO: #2 ../tests/intel/xe_exec_system_allocator.c:1757 test_exec() (xe_exec_system_allocator:6193) [thread:6197] igt_core-INFO: #3 ../tests/intel/xe_exec_system_allocator.c:2047 thread() (xe_exec_system_allocator:6193) [thread:6195] igt_core-INFO: #1 [xe_wait_ufence+0x57] (xe_exec_system_allocator:6193) [thread:6196] igt_core-INFO: #2 ../tests/intel/xe_exec_system_allocator.c:1757 test_exec() (xe_exec_system_allocator:6193) [thread:6196] igt_core-INFO: #3 ../tests/intel/xe_exec_system_allocator.c:2047 thread() (xe_exec_system_allocator:6193) [thread:6199] igt_core-INFO: #2 ../tests/intel/xe_exec_system_allocator.c:1757 test_exec() (xe_exec_system_allocator:6193) [thread:6199] igt_core-INFO: #3 ../tests/intel/xe_exec_system_allocator.c:2047 thread() (xe_exec_system_allocator:6193) [thread:6195] igt_core-INFO: #2 ../tests/intel/xe_exec_system_allocator.c:1757 test_exec() (xe_exec_system_allocator:6193) [thread:6195] igt_core-INFO: #3 ../tests/intel/xe_exec_system_allocator.c:2047 thread() (xe_exec_system_allocator:6193) [thread:6197] igt_core-INFO: #4 [pthread_condattr_setpshared+0x684] (xe_exec_system_allocator:6193) [thread:6196] igt_core-INFO: #4 [pthread_condattr_setpshared+0x684] (xe_exec_system_allocator:6193) [thread:6199] igt_core-INFO: #4 [pthread_condattr_setpshared+0x684] (xe_exec_system_allocator:6193) [thread:6197] igt_core-INFO: #5 [__clone+0x24c] (xe_exec_system_allocator:6193) [thread:6195] igt_core-INFO: #4 [pthread_condattr_setpshared+0x684] (xe_exec_system_allocator:6193) [thread:6196] igt_core-INFO: #5 [__clone+0x24c] (xe_exec_system_allocator:6193) [thread:6199] igt_core-INFO: #5 [__clone+0x24c] (xe_exec_system_allocator:6193) [thread:6195] igt_core-INFO: #5 [__clone+0x24c] (xe_exec_system_allocator:6193) [thread:6201] xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_exec_system_allocator:6193) [thread:6198] xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_exec_system_allocator:6193) [thread:6201] xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_exec_system_allocator:6193) [thread:6200] xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_exec_system_allocator:6193) [thread:6201] xe/xe_ioctl-CRITICAL: Last errno: 62, Timer expired (xe_exec_system_allocator:6193) [thread:6201] xe/xe_ioctl-CRITICAL: error: -62 != 0 (xe_exec_system_allocator:6193) [thread:6200] xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_exec_system_allocator:6193) [thread:6198] xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_exec_system_allocator:6193) [thread:6198] xe/xe_ioctl-CRITICAL: Last errno: 62, Timer expired (xe_exec_system_allocator:6193) [thread:6198] xe/xe_ioctl-CRITICAL: error: -62 != 0 (xe_exec_system_allocator:6193) [thread:6200] xe/xe_ioctl-CRITICAL: Last errno: 62, Timer expired (xe_exec_system_allocator:6193) [thread:6200] xe/xe_ioctl-CRITICAL: error: -62 != 0 (xe_exec_system_allocator:6193) [thread:6198] igt_core-INFO: Stack trace: (xe_exec_system_allocator:6193) [thread:6201] igt_core-INFO: Stack trace: (xe_exec_system_allocator:6193) [thread:6200] igt_core-INFO: Stack trace: (xe_exec_system_allocator:6193) [thread:6198] igt_core-INFO: #0 ../lib/igt_core.c:2075 __igt_fail_assert() (xe_exec_system_allocator:6193) [thread:6201] igt_core-INFO: #0 ../lib/igt_core.c:2075 __igt_fail_assert() (xe_exec_system_allocator:6193) [thread:6198] igt_core-INFO: #1 [xe_wait_ufence+0x57] (xe_exec_system_allocator:6193) [thread:6201] igt_core-INFO: #1 [xe_wait_ufence+0x57] (xe_exec_system_allocator:6193) [thread:6198] igt_core-INFO: #2 ../tests/intel/xe_exec_system_allocator.c:1757 test_exec() (xe_exec_system_allocator:6193) [thread:6198] igt_core-INFO: #3 ../tests/intel/xe_exec_system_allocator.c:2047 thread() (xe_exec_system_allocator:6193) [thread:6200] igt_core-INFO: #0 ../lib/igt_core.c:2075 __igt_fail_assert() (xe_exec_system_allocator:6193) [thread:6201] igt_core-INFO: #2 ../tests/intel/xe_exec_system_allocator.c:1757 test_exec() (xe_exec_system_allocator:6193) [thread:6201] igt_core-INFO: #3 ../tests/intel/xe_exec_system_allocator.c:2047 thread() (xe_exec_system_allocator:6193) [thread:6198] igt_core-INFO: #4 [pthread_condattr_setpshared+0x684] (xe_exec_system_allocator:6193) [thread:6201] igt_core-INFO: #4 [pthread_condattr_setpshared+0x684] (xe_exec_system_allocator:6193) [thread:6200] igt_core-INFO: #1 [xe_wait_ufence+0x57] (xe_exec_system_allocator:6193) [thread:6198] igt_core-INFO: #5 [__clone+0x24c] (xe_exec_system_allocator:6193) [thread:6201] igt_core-INFO: #5 [__clone+0x24c] (xe_exec_system_allocator:6193) [thread:6200] igt_core-INFO: #2 ../tests/intel/xe_exec_system_allocator.c:1757 test_exec() (xe_exec_system_allocator:6193) [thread:6200] igt_core-INFO: #3 ../tests/intel/xe_exec_system_allocator.c:2047 thread() (xe_exec_system_allocator:6193) [thread:6200] igt_core-INFO: #4 [pthread_condattr_setpshared+0x684] (xe_exec_system_allocator:6193) [thread:6200] igt_core-INFO: #5 [__clone+0x24c] (xe_exec_system_allocator:6193) igt_thread-CRITICAL: Failure in a thread! END ** Subtest threads-many-stride-new-bo-map-nomemset: FAIL (12.239s)
Dmesg Scroll to first warning	<6> [239.862034] Console: switching to colour dummy device 80x25 <6> [239.862319] [IGT] xe_exec_system_allocator: executing <6> [239.892220] [IGT] xe_exec_system_allocator: starting subtest threads-many-stride-new-bo-map-nomemset <7> [239.893784] xe 0000:03:00.0: [drm:drm_pagemap_dev_unhold_work [drm_gpusvm_helper]] Releasing reference on provider device and module. <7> [239.904217] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [239.908512] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [239.912568] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [239.923101] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [239.923244] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [239.927252] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [239.929898] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [239.931223] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [239.938723] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [239.939827] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [239.940503] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [239.942669] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [239.950524] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [239.951785] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [239.953844] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [239.953992] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [239.958654] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [239.961157] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [239.964198] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [239.964515] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [239.982297] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [239.982334] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [239.987649] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [239.989085] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [239.998468] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [239.998886] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [239.998892] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.009733] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.018780] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.019379] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.023684] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.026897] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.031192] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.034548] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.034569] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.046613] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.046638] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.050966] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.051993] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.060341] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.060548] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.061226] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.075159] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.075266] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.077880] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.084807] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.089561] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.092538] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.092553] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.099021] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.103465] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.103504] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.105564] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.111283] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.113725] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.115751] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.123533] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.123687] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.127489] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.128080] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.133521] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.137759] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.138426] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.139461] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.144893] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.148563] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.150936] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.152477] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.153426] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.156731] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.156775] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.163020] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.167773] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.169040] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.169489] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.172558] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.177672] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.177821] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.178109] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.186587] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.188243] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.188301] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.194033] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.195712] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.195826] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.195829] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.202311] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.203293] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.203698] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.207704] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.207751] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.208926] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.209227] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.214327] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.215887] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.216007] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.218746] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.219058] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.221355] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.225022] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.228965] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.229107] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.238221] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.238943] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.247376] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.249001] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.249005] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.253138] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.255143] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.265190] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.267705] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.274515] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.274629] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.275032] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.277627] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.277778] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.289014] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.291986] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.292076] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.292711] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.306212] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.306333] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.311233] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.317818] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.317828] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.330786] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.334029] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.336726] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.345974] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.351555] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.353521] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.354082] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.361507] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.362620] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.366331] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.370613] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.374295] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.374311] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.374781] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.376685] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.377064] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.383533] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.384236] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.385718] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.388994] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.391099] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.391825] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.394357] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.397691] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.398955] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.401768] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.401971] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [240.402057] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.407372] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.407608] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.409125] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.409183] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.417919] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.417977] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.420225] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.426470] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.426693] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.426902] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.428141] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.434948] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.434947] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.436034] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.441638] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.447137] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.452301] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.452346] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.461469] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.461518] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.461948] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.465426] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.475126] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.475900] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.476169] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.480461] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.491358] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.491419] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.491458] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.500924] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.503001] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.503036] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.503205] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.511166] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.512681] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.513429] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.516322] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.516374] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.522223] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.522224] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.523644] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.531257] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.531366] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.531484] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.535993] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.540216] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.546693] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.549149] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.549597] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.554414] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.563222] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.566056] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.571275] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.578040] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.578058] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.582604] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.591537] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.601787] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.604194] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.608429] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.608728] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.623258] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.627710] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.635109] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.651234] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.662791] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.666997] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.667316] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.674197] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.678595] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.683225] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.695623] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.699971] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.704003] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.704024] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.704227] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.711470] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.711496] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.715488] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.716756] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.716893] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.718697] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.722187] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.729244] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.731348] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.731608] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.736075] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.740608] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.747180] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.755359] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.772328] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.772347] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.777815] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.778623] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.792761] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.797375] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.797458] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.812748] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.816472] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.816771] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.833077] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.837274] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.847544] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.863155] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.867771] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.884990] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.888316] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.900445] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.907347] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.917599] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.917785] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.918586] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.925694] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.938454] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.941205] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.947151] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.954321] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.958786] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.959263] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.966382] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.979709] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.979897] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.995310] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.997762] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.997812] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [240.998197] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [241.001080] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <6> [241.006966] xe 0000:03:00.0: [drm] Tile0: GT0: ASID: 0 Faulted Address: 0x0000000001790000 FaultType: 0 AccessType: 1 FaultLevel: 0 EngineClass: 3 bcs EngineInstance: 8 <6> [241.007768] xe 0000:03:00.0: [drm] Tile0: GT0: Fault response: Unsuccessful -EINVAL <6> [241.007866] xe 0000:03:00.0: [drm] Tile0: GT0: Engine memory CAT error [18]: class=bcs, logical_mask: 0x2, guc_id=0 <7> [241.009800] xe 0000:03:00.0: [drm:xe_hw_engine_snapshot_capture [xe]] Tile0: GT0: Proceeding with manual engine snapshot <6> [241.011711] xe 0000:03:00.0: [drm] Tile0: GT0: Engine reset: engine_class=bcs, logical_mask: 0x2, guc_id=0, state=0x249 <5> [246.486130] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7122, lrc_seqno=7122, guc_id=0, flags=0x73 in no process [-1] <6> [246.668256] xe 0000:03:00.0: [drm] Xe device coredump has been created <6> [246.668290] xe 0000:03:00.0: [drm] Check your /sys/class/drm/card0/device/devcoredump/data <4> [246.668293] ------------[ cut here ]------------ <4> [246.668295] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.668296] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:25/2644 <4> [246.668385] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [246.668458] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [246.668463] CPU: 3 UID: 0 PID: 2644 Comm: kworker/u64:25 Tainted: G S U L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [246.668466] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [L]=SOFTLOCKUP <4> [246.668467] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [246.668468] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.668474] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [246.668537] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [246.668539] RSP: 0018:ffffc90004767ca0 EFLAGS: 00010246 <4> [246.668541] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.668542] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [246.668543] RBP: ffffc90004767db0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.668544] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.668545] R13: ffff8881042cae10 R14: ffff8881d5fa0000 R15: 00000000fffffffb <4> [246.668546] FS: 0000000000000000(0000) GS:ffff8888dae1b000(0000) knlGS:0000000000000000 <4> [246.668548] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.668549] CR2: 000070fe9acab2b0 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [246.668550] PKRU: 55555554 <4> [246.668551] Call Trace: <4> [246.668552] <TASK> <4> [246.668556] ? lock_acquire+0x40/0x2f0 <4> [246.668562] ? __pfx_autoremove_wake_function+0x10/0x10 <4> [246.668566] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.668571] process_one_work+0x22e/0x740 <4> [246.668577] worker_thread+0x1e8/0x3d0 <4> [246.668579] ? __pfx_worker_thread+0x10/0x10 <4> [246.668581] kthread+0x10d/0x150 <4> [246.668584] ? __pfx_kthread+0x10/0x10 <4> [246.668587] ret_from_fork+0x3d4/0x480 <4> [246.668589] ? __pfx_kthread+0x10/0x10 <4> [246.668592] ret_from_fork_asm+0x1a/0x30 <4> [246.668598] </TASK> <4> [246.668599] irq event stamp: 533991 <4> [246.668600] hardirqs last enabled at (533997): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [246.668603] hardirqs last disabled at (534002): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [246.668605] softirqs last enabled at (533056): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [246.668607] softirqs last disabled at (533051): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [246.668609] ---[ end trace 0000000000000000 ]--- <6> [246.668611] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [246.668674] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [246.668984] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [246.669034] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [246.669254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [246.669336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [246.669415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [246.669486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [246.669555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [246.669623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [246.669694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [246.669760] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [246.669849] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [246.669958] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [246.670967] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [246.681760] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [246.682051] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [246.682986] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [246.683072] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [246.683148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [246.683219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [246.683288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [246.683356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [246.683424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [246.683491] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [246.683557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [246.683623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [246.683691] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [246.683757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [246.683823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [246.683910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [246.683983] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [246.684049] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [246.684115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [246.684181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [246.684247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [246.684325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [246.684401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [246.684473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [246.684544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [246.684612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [246.684682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [246.684750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [246.684817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [246.684899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [246.684970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [246.685040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [246.685112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [246.685183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [246.685256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [246.685331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [246.685403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [246.685475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [246.685544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [246.685612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [246.685679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [246.685746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [246.685814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [246.685896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [246.685965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [246.686032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [246.686103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [246.686170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [246.686238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [246.686305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [246.686374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [246.686442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [246.686507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [246.686575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [246.686642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [246.686708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [246.686775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [246.686848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [246.686918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [246.686985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [246.687056] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [246.687306] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [246.687312] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7122, lrc_seqno=7122, guc_id=0, flags=0x73 in no process [-1] <7> [246.687315] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.687373] ------------[ cut here ]------------ <4> [246.687375] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.687376] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:25/2644 <4> [246.687443] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [246.687506] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [246.687511] CPU: 4 UID: 0 PID: 2644 Comm: kworker/u64:25 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [246.687514] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.687515] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [246.687517] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.687522] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [246.687587] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [246.687589] RSP: 0018:ffffc90004767ca0 EFLAGS: 00010246 <4> [246.687591] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.687592] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [246.687594] RBP: ffffc90004767db0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.687595] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.687596] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [246.687597] FS: 0000000000000000(0000) GS:ffff8888dae9b000(0000) knlGS:0000000000000000 <4> [246.687599] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.687600] CR2: 00007f39d21a009c CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [246.687601] PKRU: 55555554 <4> [246.687602] Call Trace: <4> [246.687603] <TASK> <4> [246.687607] ? lock_acquire+0x40/0x2f0 <4> [246.687614] ? lock_release+0xd0/0x2b0 <4> [246.687619] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.687624] process_one_work+0x22e/0x740 <4> [246.687630] worker_thread+0x1e8/0x3d0 <4> [246.687633] ? __pfx_worker_thread+0x10/0x10 <4> [246.687635] kthread+0x10d/0x150 <4> [246.687638] ? __pfx_kthread+0x10/0x10 <4> [246.687641] ret_from_fork+0x3d4/0x480 <4> [246.687644] ? __pfx_kthread+0x10/0x10 <4> [246.687647] ret_from_fork_asm+0x1a/0x30 <4> [246.687654] </TASK> <4> [246.687655] irq event stamp: 537285 <4> [246.687657] hardirqs last enabled at (537291): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [246.687660] hardirqs last disabled at (537296): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [246.687662] softirqs last enabled at (536250): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [246.687664] softirqs last disabled at (536243): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [246.687666] ---[ end trace 0000000000000000 ]--- <6> [246.687668] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [246.687734] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [246.687740] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [246.687790] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [246.688006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [246.688084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [246.688165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [246.688241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [246.688317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [246.688391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [246.688465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [246.688537] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [246.688624] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [246.688748] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [246.689941] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [246.700669] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [246.700918] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [246.701726] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [246.701802] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [246.701947] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [246.702078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [246.702198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [246.702315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [246.702433] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [246.702549] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [246.702666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [246.702783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [246.702909] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [246.703027] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [246.703144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [246.703261] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [246.703378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [246.703494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [246.703611] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [246.703728] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [246.703849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [246.703974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [246.704097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [246.704218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [246.704341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [246.704462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [246.704583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [246.704703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [246.704824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [246.704952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [246.705075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [246.705199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [246.705321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [246.705443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [246.705573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [246.705701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [246.705827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [246.705957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [246.706083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [246.706204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [246.706325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [246.706445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [246.706569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [246.706691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [246.706812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [246.706936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [246.707063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [246.707185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [246.707306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [246.707425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [246.707547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [246.707667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [246.707786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [246.707913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [246.708035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [246.708156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [246.708276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [246.708398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [246.708517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [246.708637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [246.708760] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [246.709132] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [246.709140] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7122, lrc_seqno=7122, guc_id=0, flags=0x73 in no process [-1] <7> [246.709143] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.709245] ------------[ cut here ]------------ <4> [246.709246] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.709248] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:25/2644 <4> [246.709357] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [246.709446] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [246.709452] CPU: 12 UID: 0 PID: 2644 Comm: kworker/u64:25 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [246.709456] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.709457] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [246.709459] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.709467] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [246.709575] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [246.709578] RSP: 0018:ffffc90004767ca0 EFLAGS: 00010246 <4> [246.709581] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.709583] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [246.709584] RBP: ffffc90004767db0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.709586] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.709588] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [246.709589] FS: 0000000000000000(0000) GS:ffff8888db29b000(0000) knlGS:0000000000000000 <4> [246.709591] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.709593] CR2: 00007f39d310d098 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [246.709595] PKRU: 55555554 <4> [246.709597] Call Trace: <4> [246.709598] <TASK> <4> [246.709605] ? lock_acquire+0x40/0x2f0 <4> [246.709613] ? lock_release+0xd0/0x2b0 <4> [246.709621] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.709630] process_one_work+0x22e/0x740 <4> [246.709640] worker_thread+0x1e8/0x3d0 <4> [246.709644] ? __pfx_worker_thread+0x10/0x10 <4> [246.709647] kthread+0x10d/0x150 <4> [246.709651] ? __pfx_kthread+0x10/0x10 <4> [246.709656] ret_from_fork+0x3d4/0x480 <4> [246.709658] ? __pfx_kthread+0x10/0x10 <4> [246.709663] ret_from_fork_asm+0x1a/0x30 <4> [246.709675] </TASK> <4> [246.709676] irq event stamp: 540635 <4> [246.709678] hardirqs last enabled at (540641): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [246.709681] hardirqs last disabled at (540646): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [246.709684] softirqs last enabled at (539612): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [246.709687] softirqs last disabled at (539605): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [246.709690] ---[ end trace 0000000000000000 ]--- <7> [246.711357] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <5> [246.711514] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7129, lrc_seqno=7129, guc_id=0, flags=0x73 in no process [-1] <7> [246.711523] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [246.711525] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [246.711637] ------------[ cut here ]------------ <4> [246.711638] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.711640] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#13: kworker/u64:25/2644 <4> [246.711760] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [246.711859] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [246.711866] CPU: 13 UID: 0 PID: 2644 Comm: kworker/u64:25 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [246.711870] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.711872] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [246.711874] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.711882] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [246.711995] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [246.711997] RSP: 0018:ffffc90004767ca0 EFLAGS: 00010246 <4> [246.712000] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.712002] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [246.712004] RBP: ffffc90004767db0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.712006] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.712007] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [246.712009] FS: 0000000000000000(0000) GS:ffff8888db31b000(0000) knlGS:0000000000000000 <4> [246.712012] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.712013] CR2: 00007f39d355c098 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [246.712015] PKRU: 55555554 <4> [246.712017] Call Trace: <4> [246.712018] <TASK> <4> [246.712025] ? lock_acquire+0x40/0x2f0 <4> [246.712034] ? lock_release+0xd0/0x2b0 <4> [246.712042] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.712051] process_one_work+0x22e/0x740 <4> [246.712061] worker_thread+0x1e8/0x3d0 <4> [246.712065] ? __pfx_worker_thread+0x10/0x10 <4> [246.712068] kthread+0x10d/0x150 <4> [246.712071] ? __pfx_kthread+0x10/0x10 <4> [246.712076] ret_from_fork+0x3d4/0x480 <4> [246.712079] ? __pfx_kthread+0x10/0x10 <4> [246.712083] ret_from_fork_asm+0x1a/0x30 <4> [246.712096] </TASK> <4> [246.712097] irq event stamp: 541621 <4> [246.712099] hardirqs last enabled at (541627): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [246.712103] hardirqs last disabled at (541632): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [246.712105] softirqs last enabled at (540732): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [246.712108] softirqs last disabled at (540727): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [246.712111] ---[ end trace 0000000000000000 ]--- <6> [246.712115] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [246.712227] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [246.712236] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [246.712252] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <6> [246.712542] xe 0000:03:00.0: [drm] exec queue reset detected <6> [246.712551] xe 0000:03:00.0: [drm] exec queue reset detected <7> [246.712685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [246.712818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [246.712962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [246.713094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [246.713223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [246.713351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [246.713482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [246.713611] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [246.713752] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [246.713864] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [246.713921] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [246.715274] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [246.725867] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [246.726185] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [246.726973] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [246.727092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [246.727208] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [246.727326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [246.727443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [246.727561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [246.727678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [246.727796] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [246.727918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [246.728037] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [246.728154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [246.728271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [246.728389] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [246.728507] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [246.728624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [246.728742] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [246.728864] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [246.728982] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [246.729099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [246.729221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [246.729343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [246.729464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [246.729586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [246.729706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [246.729826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [246.729951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [246.730072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [246.730197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [246.730321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [246.730443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [246.730566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [246.730689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [246.730817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [246.730949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [246.731077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [246.731202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [246.731327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [246.731448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [246.731570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [246.731690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [246.731814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [246.731942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [246.732064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [246.732184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [246.732310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [246.732431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [246.732552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [246.732672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [246.732794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [246.732931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [246.733020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [246.733102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [246.733180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [246.733254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [246.733325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [246.733396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [246.733464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [246.733533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [246.733605] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [246.733741] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [246.733745] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7129, lrc_seqno=7129, guc_id=0, flags=0x73 in no process [-1] <7> [246.733748] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.733805] ------------[ cut here ]------------ <4> [246.733806] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.733807] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:25/2644 <4> [246.733890] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [246.733974] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [246.733978] CPU: 2 UID: 0 PID: 2644 Comm: kworker/u64:25 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [246.733982] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.733983] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [246.733984] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.733989] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [246.734056] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [246.734058] RSP: 0018:ffffc90004767ca0 EFLAGS: 00010246 <4> [246.734060] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.734061] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [246.734063] RBP: ffffc90004767db0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.734064] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.734065] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [246.734066] FS: 0000000000000000(0000) GS:ffff8888dad9b000(0000) knlGS:0000000000000000 <4> [246.734067] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.734069] CR2: 00007f3a19b0b09c CR3: 000000011de45006 CR4: 0000000000f72ef0 <4> [246.734070] PKRU: 55555554 <4> [246.734071] Call Trace: <4> [246.734072] <TASK> <4> [246.734076] ? lock_acquire+0x40/0x2f0 <4> [246.734081] ? lock_release+0xd0/0x2b0 <4> [246.734086] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.734092] process_one_work+0x22e/0x740 <4> [246.734098] worker_thread+0x1e8/0x3d0 <4> [246.734100] ? __pfx_worker_thread+0x10/0x10 <4> [246.734102] kthread+0x10d/0x150 <4> [246.734105] ? __pfx_kthread+0x10/0x10 <4> [246.734108] ret_from_fork+0x3d4/0x480 <4> [246.734110] ? __pfx_kthread+0x10/0x10 <4> [246.734113] ret_from_fork_asm+0x1a/0x30 <4> [246.734120] </TASK> <4> [246.734121] irq event stamp: 544977 <4> [246.734122] hardirqs last enabled at (544983): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [246.734125] hardirqs last disabled at (544988): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [246.734127] softirqs last enabled at (544228): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [246.734129] softirqs last disabled at (544221): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [246.734131] ---[ end trace 0000000000000000 ]--- <6> [246.734133] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [246.734199] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <5> [246.734209] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967247, lrc_seqno=4294967247, guc_id=8, flags=0x0 in xe_exec_system_ [6193] <7> [246.734216] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [246.734964] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967241, lrc_seqno=4294967241, guc_id=10, flags=0x0 in xe_exec_system_ [6193] <7> [246.734971] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [246.735105] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [246.735097] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [246.735208] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [246.735412] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [246.735678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [246.735812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [246.735971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [246.736082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [246.736182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [246.736279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [246.736373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [246.736461] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [246.736561] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [246.736681] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [246.737832] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [246.747845] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [246.748109] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [246.748801] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [246.748893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [246.748975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [246.749057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [246.749137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [246.749214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [246.749293] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [246.749369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [246.749448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [246.749526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [246.749602] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [246.749680] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [246.749756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [246.749833] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [246.749922] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [246.749998] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [246.750077] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [246.750152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [246.750232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [246.750320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [246.750405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [246.750487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [246.750568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [246.750648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [246.750726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [246.750803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [246.750887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [246.750967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [246.751049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [246.751129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [246.751210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [246.751291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [246.751379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [246.751465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [246.751552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [246.751635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [246.751718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [246.751797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [246.751882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [246.751958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [246.752040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [246.752119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [246.752198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [246.752275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [246.752354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [246.752432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [246.752509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [246.752588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [246.752665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [246.752743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [246.752820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [246.752906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [246.752985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [246.753065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [246.753143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [246.753222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [246.753300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [246.753379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [246.753463] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [246.753615] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [246.753619] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7129, lrc_seqno=7129, guc_id=0, flags=0x73 in no process [-1] <7> [246.753621] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.753701] ------------[ cut here ]------------ <4> [246.753702] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.753704] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:56/2675 <4> [246.753783] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [246.753856] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [246.753860] CPU: 10 UID: 0 PID: 2675 Comm: kworker/u64:56 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [246.753864] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.753865] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [246.753866] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.753871] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [246.753955] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [246.753957] RSP: 0018:ffffc90004847ca0 EFLAGS: 00010246 <4> [246.753959] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.753960] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [246.753961] RBP: ffffc90004847db0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.753962] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.753963] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [246.753965] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [246.753966] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.753968] CR2: 00007f3a50edeb08 CR3: 0000000206817005 CR4: 0000000000f72ef0 <4> [246.753969] PKRU: 55555554 <4> [246.753970] Call Trace: <4> [246.753971] <TASK> <4> [246.753975] ? lock_acquire+0x40/0x2f0 <4> [246.753981] ? lock_release+0xd0/0x2b0 <4> [246.753985] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.753991] process_one_work+0x22e/0x740 <4> [246.754004] worker_thread+0x1e8/0x3d0 <4> [246.754006] ? __pfx_worker_thread+0x10/0x10 <4> [246.754008] kthread+0x10d/0x150 <4> [246.754011] ? __pfx_kthread+0x10/0x10 <4> [246.754014] ret_from_fork+0x3d4/0x480 <4> [246.754016] ? __pfx_kthread+0x10/0x10 <4> [246.754019] ret_from_fork_asm+0x1a/0x30 <4> [246.754026] </TASK> <4> [246.754027] irq event stamp: 561337 <4> [246.754028] hardirqs last enabled at (561343): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [246.754031] hardirqs last disabled at (561348): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [246.754033] softirqs last enabled at (560226): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [246.754035] softirqs last disabled at (560215): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [246.754037] ---[ end trace 0000000000000000 ]--- <7> [246.755323] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [246.755436] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [246.755542] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7136, lrc_seqno=7136, guc_id=0, flags=0x73 in no process [-1] <7> [246.755547] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.755609] ------------[ cut here ]------------ <4> [246.755610] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.755611] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:34/2653 <4> [246.755685] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [246.755745] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [246.755750] CPU: 5 UID: 0 PID: 2653 Comm: kworker/u64:34 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [246.755753] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.755754] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [246.755755] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.755760] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [246.755828] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [246.755830] RSP: 0018:ffffc900047afca0 EFLAGS: 00010246 <4> [246.755832] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.755833] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [246.755834] RBP: ffffc900047afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.755844] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.755846] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [246.755848] FS: 0000000000000000(0000) GS:ffff8888daf1b000(0000) knlGS:0000000000000000 <4> [246.755851] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.755852] CR2: 00007f39f6a8309c CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [246.755854] PKRU: 55555554 <4> [246.755855] Call Trace: <4> [246.755856] <TASK> <4> [246.755860] ? lock_acquire+0x40/0x2f0 <4> [246.755866] ? lock_release+0xd0/0x2b0 <4> [246.755871] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.755876] process_one_work+0x22e/0x740 <4> [246.755882] worker_thread+0x1e8/0x3d0 <4> [246.755884] ? __pfx_worker_thread+0x10/0x10 <4> [246.755886] kthread+0x10d/0x150 <4> [246.755889] ? __pfx_kthread+0x10/0x10 <4> [246.755893] ret_from_fork+0x3d4/0x480 <4> [246.755895] ? __pfx_kthread+0x10/0x10 <4> [246.755898] ret_from_fork_asm+0x1a/0x30 <4> [246.755905] </TASK> <4> [246.755906] irq event stamp: 899957 <4> [246.755907] hardirqs last enabled at (899963): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [246.755909] hardirqs last disabled at (899968): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [246.755912] softirqs last enabled at (899834): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [246.755914] softirqs last disabled at (899829): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [246.755916] ---[ end trace 0000000000000000 ]--- <6> [246.755918] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [246.755986] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [246.755993] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [246.756012] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <6> [246.756155] xe 0000:03:00.0: [drm] exec queue reset detected <7> [246.756467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [246.756604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [246.756739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [246.756877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [246.757010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [246.757137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [246.757266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [246.757393] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [246.757531] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [246.757690] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [246.759049] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [246.769828] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [246.770151] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [246.770943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [246.771064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [246.771180] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [246.771298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [246.771417] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [246.771535] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [246.771652] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [246.771768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [246.771892] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [246.772013] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [246.772130] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [246.772246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [246.772363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [246.772480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [246.772597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [246.772714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [246.772830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [246.772953] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [246.773072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [246.773193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [246.773315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [246.773436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [246.773558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [246.773677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [246.773796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [246.773921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [246.774041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [246.774165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [246.774289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [246.774412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [246.774535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [246.774657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [246.774785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [246.774917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [246.775046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [246.775171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [246.775295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [246.775417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [246.775538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [246.775658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [246.775781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [246.775909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [246.776033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [246.776153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [246.776278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [246.776399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [246.776520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [246.776640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [246.776761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [246.776886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [246.777008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [246.777131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [246.777252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [246.777373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [246.777493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [246.777614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [246.777734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [246.777859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [246.777985] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [246.778176] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [246.778183] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7136, lrc_seqno=7136, guc_id=0, flags=0x73 in no process [-1] <7> [246.778186] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.778287] ------------[ cut here ]------------ <4> [246.778289] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.778290] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#13: kworker/u64:56/2675 <4> [246.778400] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [246.778488] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [246.778494] CPU: 13 UID: 0 PID: 2675 Comm: kworker/u64:56 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [246.778498] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.778499] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [246.778501] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.778508] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [246.778618] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [246.778620] RSP: 0018:ffffc90004847ca0 EFLAGS: 00010246 <4> [246.778623] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.778625] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [246.778627] RBP: ffffc90004847db0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.778628] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.778630] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [246.778632] FS: 0000000000000000(0000) GS:ffff8888db31b000(0000) knlGS:0000000000000000 <4> [246.778634] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.778636] CR2: 00007f39d355c098 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [246.778638] PKRU: 55555554 <4> [246.778639] Call Trace: <4> [246.778641] <TASK> <4> [246.778647] ? lock_acquire+0x40/0x2f0 <4> [246.778655] ? lock_release+0xd0/0x2b0 <4> [246.778663] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.778673] process_one_work+0x22e/0x740 <4> [246.778683] worker_thread+0x1e8/0x3d0 <4> [246.778686] ? __pfx_worker_thread+0x10/0x10 <4> [246.778689] kthread+0x10d/0x150 <4> [246.778693] ? __pfx_kthread+0x10/0x10 <4> [246.778698] ret_from_fork+0x3d4/0x480 <4> [246.778701] ? __pfx_kthread+0x10/0x10 <4> [246.778705] ret_from_fork_asm+0x1a/0x30 <4> [246.778717] </TASK> <4> [246.778718] irq event stamp: 564979 <4> [246.778720] hardirqs last enabled at (564985): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [246.778723] hardirqs last disabled at (564990): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [246.778726] softirqs last enabled at (564052): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [246.778729] softirqs last disabled at (564045): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [246.778732] ---[ end trace 0000000000000000 ]--- <6> [246.778734] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [246.780101] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <5> [246.780114] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967241, lrc_seqno=4294967241, guc_id=9, flags=0x0 in xe_exec_system_ [6193] <7> [246.780117] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [246.780248] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [246.780279] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [246.780428] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [246.780578] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [246.780796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [246.780900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [246.780989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [246.781071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [246.781151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [246.781230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [246.781309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [246.781384] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [246.781474] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [246.781584] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [246.782593] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [246.792847] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [246.793095] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [246.793748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [246.793822] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [246.793917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [246.793988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [246.794058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [246.794126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [246.794194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [246.794264] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [246.794333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [246.794400] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [246.794467] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [246.794535] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [246.794604] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [246.794671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [246.794738] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [246.794805] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [246.794888] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [246.794955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [246.795020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [246.795094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [246.795166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [246.795238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [246.795309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [246.795380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [246.795449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [246.795517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [246.795585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [246.795655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [246.795726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [246.795794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [246.795871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [246.795940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [246.796015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [246.796091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [246.796164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [246.796236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [246.796307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [246.796377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [246.796447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [246.796515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [246.796584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [246.796652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [246.796721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [246.796788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [246.796869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [246.796938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [246.797005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [246.797072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [246.797139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [246.797204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [246.797272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [246.797340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [246.797405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [246.797472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [246.797539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [246.797607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [246.797673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [246.797740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [246.797810] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [246.798171] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [246.798176] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7136, lrc_seqno=7136, guc_id=0, flags=0x73 in no process [-1] <7> [246.798179] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.798235] ------------[ cut here ]------------ <4> [246.798237] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.798238] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:25/2644 <4> [246.798305] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [246.798367] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [246.798371] CPU: 3 UID: 0 PID: 2644 Comm: kworker/u64:25 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [246.798375] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.798376] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [246.798377] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.798382] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [246.798448] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [246.798449] RSP: 0018:ffffc90004767ca0 EFLAGS: 00010246 <4> [246.798451] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.798453] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [246.798454] RBP: ffffc90004767db0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.798455] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.798456] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [246.798457] FS: 0000000000000000(0000) GS:ffff8888dae1b000(0000) knlGS:0000000000000000 <4> [246.798459] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.798460] CR2: 0000744f0c331000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [246.798461] PKRU: 55555554 <4> [246.798463] Call Trace: <4> [246.798464] <TASK> <4> [246.798467] ? lock_acquire+0x40/0x2f0 <4> [246.798473] ? lock_release+0xd0/0x2b0 <4> [246.798478] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.798483] process_one_work+0x22e/0x740 <4> [246.798489] worker_thread+0x1e8/0x3d0 <4> [246.798492] ? __pfx_worker_thread+0x10/0x10 <4> [246.798494] kthread+0x10d/0x150 <4> [246.798496] ? __pfx_kthread+0x10/0x10 <4> [246.798500] ret_from_fork+0x3d4/0x480 <4> [246.798501] ? __pfx_kthread+0x10/0x10 <4> [246.798505] ret_from_fork_asm+0x1a/0x30 <4> [246.798511] </TASK> <4> [246.798512] irq event stamp: 549241 <4> [246.798514] hardirqs last enabled at (549247): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [246.798516] hardirqs last disabled at (549252): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [246.798518] softirqs last enabled at (548016): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [246.798520] softirqs last disabled at (548007): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [246.798522] ---[ end trace 0000000000000000 ]--- <5> [246.799428] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7138, lrc_seqno=7138, guc_id=0, flags=0x73 in no process [-1] <7> [246.799433] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.799523] ------------[ cut here ]------------ <4> [246.799524] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.799526] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:25/2644 <4> [246.799618] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [246.799679] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [246.799683] CPU: 3 UID: 0 PID: 2644 Comm: kworker/u64:25 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [246.799686] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.799687] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [246.799688] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.799694] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [246.799761] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [246.799762] RSP: 0018:ffffc90004767ca0 EFLAGS: 00010246 <4> [246.799764] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.799766] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [246.799767] RBP: ffffc90004767db0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.799768] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.799769] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [246.799770] FS: 0000000000000000(0000) GS:ffff8888dae1b000(0000) knlGS:0000000000000000 <4> [246.799771] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.799773] CR2: 0000744f0c331000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [246.799774] PKRU: 55555554 <4> [246.799775] Call Trace: <4> [246.799776] <TASK> <4> [246.799779] ? lock_acquire+0x40/0x2f0 <4> [246.799785] ? lock_release+0xd0/0x2b0 <4> [246.799790] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.799795] process_one_work+0x22e/0x740 <4> [246.799801] worker_thread+0x1e8/0x3d0 <4> [246.799803] ? __pfx_worker_thread+0x10/0x10 <4> [246.799805] kthread+0x10d/0x150 <4> [246.799808] ? __pfx_kthread+0x10/0x10 <4> [246.799811] ret_from_fork+0x3d4/0x480 <4> [246.799813] ? __pfx_kthread+0x10/0x10 <4> [246.799816] ret_from_fork_asm+0x1a/0x30 <4> [246.799823] </TASK> <4> [246.799824] irq event stamp: 550145 <4> [246.799825] hardirqs last enabled at (550151): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [246.799828] hardirqs last disabled at (550156): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [246.799830] softirqs last enabled at (548016): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [246.799832] softirqs last disabled at (548007): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [246.799834] ---[ end trace 0000000000000000 ]--- <6> [246.799841] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [246.799909] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [246.799916] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [246.799929] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [246.800027] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [246.800130] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [246.800390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [246.800492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [246.800591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [246.800683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [246.800769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [246.800870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [246.800957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [246.801039] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [246.801142] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [246.801263] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [246.802512] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [246.812847] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [246.813134] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [246.813831] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [246.813929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [246.814008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [246.814085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [246.814173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [246.814257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [246.814332] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [246.814414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [246.814489] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [246.814572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [246.814648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [246.814730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [246.814804] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [246.814890] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [246.814969] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [246.815052] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [246.815127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [246.815200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [246.815285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [246.815367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [246.815447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [246.815525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [246.815604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [246.815681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [246.815756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [246.815833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [246.815926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [246.815996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [246.816066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [246.816140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [246.816210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [246.816291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [246.816366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [246.816457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [246.816538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [246.816624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [246.816703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [246.816779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [246.816861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [246.816935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [246.817019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [246.817094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [246.817176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [246.817252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [246.817328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [246.817414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [246.817497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [246.817575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [246.817659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [246.817733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [246.817815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [246.817903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [246.817978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [246.818060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [246.818139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [246.818216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [246.818289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [246.818374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [246.818458] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [246.818740] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [246.818744] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7138, lrc_seqno=7138, guc_id=0, flags=0x73 in no process [-1] <7> [246.818747] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.818816] ------------[ cut here ]------------ <4> [246.818817] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.818818] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [246.818908] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [246.818976] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [246.818988] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [246.818991] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.818992] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [246.818994] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.818999] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [246.819077] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [246.819079] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [246.819081] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.819082] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [246.819083] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.819084] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.819086] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [246.819087] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [246.819088] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.819090] CR2: 00007f3a424227fd CR3: 0000000206817005 CR4: 0000000000f72ef0 <4> [246.819091] PKRU: 55555554 <4> [246.819092] Call Trace: <4> [246.819093] <TASK> <4> [246.819097] ? lock_acquire+0x40/0x2f0 <4> [246.819103] ? lock_release+0xd0/0x2b0 <4> [246.819107] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.819113] process_one_work+0x22e/0x740 <4> [246.819119] worker_thread+0x1e8/0x3d0 <4> [246.819121] ? __pfx_worker_thread+0x10/0x10 <4> [246.819123] kthread+0x10d/0x150 <4> [246.819126] ? __pfx_kthread+0x10/0x10 <4> [246.819129] ret_from_fork+0x3d4/0x480 <4> [246.819131] ? __pfx_kthread+0x10/0x10 <4> [246.819134] ret_from_fork_asm+0x1a/0x30 <4> [246.819148] </TASK> <4> [246.819149] irq event stamp: 1684637 <4> [246.819150] hardirqs last enabled at (1684643): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [246.819153] hardirqs last disabled at (1684648): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [246.819162] softirqs last enabled at (1683508): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [246.819164] softirqs last disabled at (1683495): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [246.819166] ---[ end trace 0000000000000000 ]--- <6> [246.819168] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [246.819244] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [246.819249] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [246.819296] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [246.819700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [246.819805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [246.819914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [246.820004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [246.820090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [246.820175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [246.820259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [246.820348] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [246.820449] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [246.820565] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [246.821817] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [246.831846] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [246.832129] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [246.832871] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [246.832963] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [246.833047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [246.833127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [246.833204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [246.833281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [246.833355] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [246.833442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [246.833523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [246.833598] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [246.833673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [246.833755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [246.833842] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [246.833919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [246.833992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [246.834078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [246.834160] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [246.834234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [246.834315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [246.834400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [246.834481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [246.834558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [246.834647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [246.834725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [246.834801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [246.834896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [246.834978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [246.835055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [246.835133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [246.835214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [246.835289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [246.835364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [246.835452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [246.835535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [246.835623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [246.835701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [246.835784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [246.835868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [246.835951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [246.836024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [246.836107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [246.836181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [246.836264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [246.836337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [246.836422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [246.836497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [246.836569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [246.836654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [246.836729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [246.836813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [246.836899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [246.836982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [246.837057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [246.837133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [246.837212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [246.837286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [246.837357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [246.837441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [246.837526] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [246.837683] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [246.837687] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7138, lrc_seqno=7138, guc_id=0, flags=0x73 in no process [-1] <7> [246.837689] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.837760] ------------[ cut here ]------------ <4> [246.837761] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.837762] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [246.837849] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [246.837922] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [246.837927] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [246.837929] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.837930] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [246.837932] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.837936] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [246.838015] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [246.838017] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [246.838019] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.838021] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [246.838022] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.838023] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.838024] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [246.838025] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [246.838027] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.838028] CR2: 00007f3a424227fd CR3: 0000000206817005 CR4: 0000000000f72ef0 <4> [246.838029] PKRU: 55555554 <4> [246.838030] Call Trace: <4> [246.838031] <TASK> <4> [246.838035] ? lock_acquire+0x40/0x2f0 <4> [246.838040] ? lock_release+0xd0/0x2b0 <4> [246.838045] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.838050] process_one_work+0x22e/0x740 <4> [246.838056] worker_thread+0x1e8/0x3d0 <4> [246.838059] ? __pfx_worker_thread+0x10/0x10 <4> [246.838060] kthread+0x10d/0x150 <4> [246.838063] ? __pfx_kthread+0x10/0x10 <4> [246.838066] ret_from_fork+0x3d4/0x480 <4> [246.838068] ? __pfx_kthread+0x10/0x10 <4> [246.838071] ret_from_fork_asm+0x1a/0x30 <4> [246.838085] </TASK> <4> [246.838093] irq event stamp: 1688267 <4> [246.838094] hardirqs last enabled at (1688273): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [246.838097] hardirqs last disabled at (1688278): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [246.838099] softirqs last enabled at (1687124): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [246.838101] softirqs last disabled at (1687115): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [246.838103] ---[ end trace 0000000000000000 ]--- <7> [246.839178] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [246.839289] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [252.131877] [IGT] xe_exec_system_allocator: finished subtest threads-many-stride-new-bo-map-nomemset, FAIL <6> [252.132616] [IGT] xe_exec_system_allocator: exiting, ret=98 <6> [252.133297] Console: switching to colour frame buffer device 240x67 <6> [252.134673] xe 0000:03:00.0: [drm] Tile0: GT1: ASID: 12 Faulted Address: 0x00007f39d1c9d000 FaultType: 0 AccessType: 0 FaultLevel: 1 EngineClass: 2 vecs EngineInstance: 0 <6> [252.134681] xe 0000:03:00.0: [drm] Tile0: GT1: Fault response: Unsuccessful -EFAULT <6> [252.134784] xe 0000:03:00.0: [drm] Tile0: GT1: Engine memory CAT error [18]: class=vecs, logical_mask: 0x1, guc_id=0 <6> [252.136752] xe 0000:03:00.0: [drm] Tile0: GT1: Engine reset: engine_class=vecs, logical_mask: 0x1, guc_id=0, state=0x249 <5> [252.136888] xe 0000:03:00.0: [drm] Tile0: GT1: Timedout job: seqno=4294967248, lrc_seqno=4294967248, guc_id=0, flags=0x0 in xe_exec_system_ [6193] <7> [252.136954] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [252.137620] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7139, lrc_seqno=7139, guc_id=0, flags=0x73 in no process [-1] <7> [252.137626] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [252.137645] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.137644] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <4> [252.137728] ------------[ cut here ]------------ <4> [252.137730] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [252.137694] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <4> [252.137732] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:34/2653 <4> [252.137840] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.137938] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.137945] CPU: 8 UID: 0 PID: 2653 Comm: kworker/u64:34 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.137950] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.137951] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.137953] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [252.137925] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <4> [252.137960] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <7> [252.137962] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <4> [252.138059] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.138061] RSP: 0018:ffffc900047afca0 EFLAGS: 00010246 <4> [252.138064] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.138066] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.138067] RBP: ffffc900047afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.138069] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.138070] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <7> [252.137983] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <4> [252.138072] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [252.138074] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.138075] CR2: 00007f3a328227fd CR3: 000000011c098002 CR4: 0000000000f72ef0 <4> [252.138077] PKRU: 55555554 <4> [252.138078] Call Trace: <4> [252.138080] <TASK> <4> [252.138085] ? lock_acquire+0x40/0x2f0 <4> [252.138093] ? lock_release+0xd0/0x2b0 <4> [252.138100] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.138108] process_one_work+0x22e/0x740 <4> [252.138116] worker_thread+0x1e8/0x3d0 <4> [252.138120] ? __pfx_worker_thread+0x10/0x10 <4> [252.138122] kthread+0x10d/0x150 <4> [252.138126] ? __pfx_kthread+0x10/0x10 <4> [252.138130] ret_from_fork+0x3d4/0x480 <4> [252.138133] ? __pfx_kthread+0x10/0x10 <4> [252.138137] ret_from_fork_asm+0x1a/0x30 <4> [252.138147] </TASK> <4> [252.138149] irq event stamp: 1361469 <4> [252.138150] hardirqs last enabled at (1361475): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.138154] hardirqs last disabled at (1361480): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.138156] softirqs last enabled at (1336440): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.138160] softirqs last disabled at (1336435): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.138162] ---[ end trace 0000000000000000 ]--- <7> [252.138152] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <6> [252.138165] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [252.138195] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <6> [252.138264] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.138277] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.138336] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.138380] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.138355] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.138421] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.138581] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.138625] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.138690] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.138686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.138820] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.138908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.139013] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.139097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.139275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.139328] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.139450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.139627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.139813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.140017] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.140224] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.140453] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.142591] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.152840] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.153154] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.153964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.154098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.154229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.154363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.154496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.154629] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.154759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.154893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.155019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.155143] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.155267] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.155391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.155508] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.155625] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.155742] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.155864] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.155982] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.156098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.156215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.156336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.156457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.156577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.156700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.156819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.156943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.157065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.157187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.157311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.157436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.157558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.157680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.157803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.157939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.158068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.158194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.158319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.158444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.158565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.158686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.158805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.158940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.159065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.159186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.159306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.159431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.159551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.159672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.159792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.159919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.160042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.160161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.160285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.160405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.160526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.160646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.160767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.160892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.161014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.161137] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.161334] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.161341] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7139, lrc_seqno=7139, guc_id=0, flags=0x73 in no process [-1] <7> [252.161345] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.161444] ------------[ cut here ]------------ <4> [252.161446] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.161447] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:2/121 <4> [252.161557] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.161649] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.161656] CPU: 12 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.161660] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.161662] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.161663] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.161671] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.161779] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.161782] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [252.161785] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.161786] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.161788] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.161790] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.161791] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.161793] FS: 0000000000000000(0000) GS:ffff8888db29b000(0000) knlGS:0000000000000000 <4> [252.161795] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.161797] CR2: 00007f3a4f257000 CR3: 000000011c098003 CR4: 0000000000f72ef0 <4> [252.161799] PKRU: 55555554 <4> [252.161800] Call Trace: <4> [252.161802] <TASK> <4> [252.161808] ? lock_acquire+0x40/0x2f0 <4> [252.161817] ? lock_release+0xd0/0x2b0 <4> [252.161825] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.161841] process_one_work+0x22e/0x740 <4> [252.161852] worker_thread+0x1e8/0x3d0 <4> [252.161855] ? __pfx_worker_thread+0x10/0x10 <4> [252.161859] kthread+0x10d/0x150 <4> [252.161863] ? __pfx_kthread+0x10/0x10 <4> [252.161868] ret_from_fork+0x3d4/0x480 <4> [252.161871] ? __pfx_kthread+0x10/0x10 <4> [252.161875] ret_from_fork_asm+0x1a/0x30 <4> [252.161888] </TASK> <4> [252.161889] irq event stamp: 1736239 <4> [252.161891] hardirqs last enabled at (1736245): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.161895] hardirqs last disabled at (1736250): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.161898] softirqs last enabled at (1735250): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.161901] softirqs last disabled at (1735243): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.161904] ---[ end trace 0000000000000000 ]--- <6> [252.163121] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.163237] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.163246] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.163308] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.163455] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.163942] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.164210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.164337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.164469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.164597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.164725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.164861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.164991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.165117] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.165254] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.165414] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.166792] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.176840] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.177147] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.177895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.177977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.178051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.178123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.178192] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.178260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.178327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.178395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.178463] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.178530] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.178596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.178663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.178729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.178795] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.178878] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.178948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.179016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.179082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.179148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.179236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.179312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.179384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.179457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.179527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.179596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.179665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.179735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.179807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.179889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.179960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.180030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.180099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.180173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.180247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.180321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.180392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.180461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.180529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.180600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.180668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.180738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.180807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.180885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.180952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.181024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.181090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.181158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.181225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.181295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.181361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.181427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.181496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.181563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.181632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.181696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.181761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.181826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.181908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.181979] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.182113] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.182118] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7139, lrc_seqno=7139, guc_id=0, flags=0x73 in no process [-1] <7> [252.182120] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.182176] ------------[ cut here ]------------ <4> [252.182177] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.182179] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [252.182245] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.182307] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.182311] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.182314] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.182316] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.182317] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.182322] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.182387] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.182388] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [252.182390] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.182392] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.182393] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.182394] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.182395] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.182397] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [252.182398] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.182399] CR2: 00007f3a424227fd CR3: 000000011c098003 CR4: 0000000000f72ef0 <4> [252.182401] PKRU: 55555554 <4> [252.182402] Call Trace: <4> [252.182403] <TASK> <4> [252.182407] ? lock_acquire+0x40/0x2f0 <4> [252.182412] ? lock_release+0xd0/0x2b0 <4> [252.182417] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.182422] process_one_work+0x22e/0x740 <4> [252.182428] worker_thread+0x1e8/0x3d0 <4> [252.182431] ? __pfx_worker_thread+0x10/0x10 <4> [252.182433] kthread+0x10d/0x150 <4> [252.182436] ? __pfx_kthread+0x10/0x10 <4> [252.182439] ret_from_fork+0x3d4/0x480 <4> [252.182441] ? __pfx_kthread+0x10/0x10 <4> [252.182444] ret_from_fork_asm+0x1a/0x30 <4> [252.182451] </TASK> <4> [252.182452] irq event stamp: 1739633 <4> [252.182453] hardirqs last enabled at (1739639): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.182455] hardirqs last disabled at (1739644): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.182457] softirqs last enabled at (1738706): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.182459] softirqs last disabled at (1738701): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.182461] ---[ end trace 0000000000000000 ]--- <7> [252.182496] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <5> [252.182745] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7160, lrc_seqno=7160, guc_id=0, flags=0x73 in no process [-1] <7> [252.182753] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [252.182776] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <4> [252.182932] ------------[ cut here ]------------ <4> [252.182934] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.182938] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:10/211 <4> [252.183075] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake <7> [252.183100] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <4> [252.183183] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.183196] CPU: 6 UID: 0 PID: 211 Comm: kworker/u64:10 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.183201] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.183203] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.183205] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.183216] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.183333] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.183337] RSP: 0018:ffffc90001657ca0 EFLAGS: 00010246 <4> [252.183341] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.183344] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.183346] RBP: ffffc90001657db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.183348] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.183350] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.183352] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [252.183354] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.183357] CR2: 00007f3a1c001098 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [252.183359] PKRU: 55555554 <4> [252.183360] Call Trace: <4> [252.183362] <TASK> <4> [252.183369] ? lock_acquire+0x40/0x2f0 <4> [252.183379] ? lock_release+0xd0/0x2b0 <4> [252.183387] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.183396] process_one_work+0x22e/0x740 <4> [252.183407] worker_thread+0x1e8/0x3d0 <4> [252.183411] ? __pfx_worker_thread+0x10/0x10 <4> [252.183414] kthread+0x10d/0x150 <4> [252.183418] ? __pfx_kthread+0x10/0x10 <4> [252.183422] ret_from_fork+0x3d4/0x480 <4> [252.183425] ? __pfx_kthread+0x10/0x10 <4> [252.183429] ret_from_fork_asm+0x1a/0x30 <4> [252.183440] </TASK> <4> [252.183442] irq event stamp: 810867 <4> [252.183444] hardirqs last enabled at (810873): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.183447] hardirqs last disabled at (810878): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.183450] softirqs last enabled at (810100): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.183454] softirqs last disabled at (810091): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.183457] ---[ end trace 0000000000000000 ]--- <7> [252.183403] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <6> [252.183459] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.183568] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <7> [252.183522] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [252.183584] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.183621] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.183640] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.183724] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.183855] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.183987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.184097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.184186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.184268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.184351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.184430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.184508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.184582] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.184671] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.184779] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.185785] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.195838] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.196103] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.196742] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.196816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.196902] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.196973] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.197045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.197115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.197185] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.197255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.197324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.197392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.197459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.197526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.197592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.197658] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.197724] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.197790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.197880] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.197947] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.198012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.198088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.198162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.198235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.198309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.198379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.198450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.198517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.198584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.198654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.198726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.198795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.198877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.198949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.199023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.199097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.199172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.199242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.199312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.199380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.199449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.199518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.199590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.199658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.199726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.199794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.199876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.199946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.200014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.200081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.200148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.200216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.200284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.200356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.200422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.200491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.200557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.200624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.200689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.200756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.200826] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.200981] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.200986] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7160, lrc_seqno=7160, guc_id=0, flags=0x73 in no process [-1] <7> [252.200989] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.201046] ------------[ cut here ]------------ <4> [252.201047] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.201048] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:10/211 <4> [252.201116] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.201178] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.201183] CPU: 6 UID: 0 PID: 211 Comm: kworker/u64:10 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.201186] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.201187] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.201188] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.201193] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.201258] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.201259] RSP: 0018:ffffc90001657ca0 EFLAGS: 00010246 <4> [252.201262] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.201263] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.201264] RBP: ffffc90001657db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.201265] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.201266] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.201267] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [252.201269] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.201270] CR2: 00007f3a1c001098 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [252.201272] PKRU: 55555554 <4> [252.201273] Call Trace: <4> [252.201274] <TASK> <4> [252.201278] ? lock_acquire+0x40/0x2f0 <4> [252.201283] ? lock_release+0xd0/0x2b0 <4> [252.201288] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.201293] process_one_work+0x22e/0x740 <4> [252.201299] worker_thread+0x1e8/0x3d0 <4> [252.201302] ? __pfx_worker_thread+0x10/0x10 <4> [252.201304] kthread+0x10d/0x150 <4> [252.201307] ? __pfx_kthread+0x10/0x10 <4> [252.201310] ret_from_fork+0x3d4/0x480 <4> [252.201312] ? __pfx_kthread+0x10/0x10 <4> [252.201315] ret_from_fork_asm+0x1a/0x30 <4> [252.201322] </TASK> <4> [252.201323] irq event stamp: 814201 <4> [252.201324] hardirqs last enabled at (814207): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.201326] hardirqs last disabled at (814212): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.201328] softirqs last enabled at (813074): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.201331] softirqs last disabled at (813069): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.201334] ---[ end trace 0000000000000000 ]--- <6> [252.201336] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.201403] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.201409] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.201456] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.201662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.201741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.201821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.201912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.201989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.202065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.202140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.202212] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.202299] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.202406] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.203406] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.213836] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.214091] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.214324] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.214327] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.214325] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.214328] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.214549] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.214552] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.214600] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.214650] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.214721] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.214734] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.214795] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.214896] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.214907] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.214929] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.214952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.215052] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.215061] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.215040] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.215065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.215181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.215184] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.215207] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.215219] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.215290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.215287] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.215365] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.215380] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.215410] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.215440] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.215517] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.215533] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.215523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.215531] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.215644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.215676] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.215693] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.215699] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.215760] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.215786] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.215836] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.215851] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.215899] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.215954] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.215999] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.216007] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.216010] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.216060] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.216126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.216149] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.216158] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.216209] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.216241] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.216305] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.216308] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.216313] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.216351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.216465] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.216462] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.216466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.216528] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.216560] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.216577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.216612] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.216690] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.216692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.216710] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.216814] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.216804] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.216809] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.216870] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.216951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.216968] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.217020] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.217036] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.217064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.217081] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.217188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.217221] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.217243] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.217238] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.217303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.217328] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.217399] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.217421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.217483] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <6> [252.217560] xe 0000:03:00.0: [drm] Tile0: GT1: Engine reset: engine_class=vcs, logical_mask: 0x2, guc_id=1, state=0x289 <7> [252.217558] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.217540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.217541] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.217639] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.217650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.217675] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.217716] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.217774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.217803] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.217880] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.217883] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.217900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <6> [252.218038] xe 0000:03:00.0: [drm] Tile0: GT1: Engine reset: engine_class=vcs, logical_mask: 0x1, guc_id=2, state=0x289 <7> [252.217983] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.218014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.218041] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.218054] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.218091] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.218139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.218248] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.218256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.218253] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.218314] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.218381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.218441] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.218460] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.218493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.218540] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.218521] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.218616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <6> [252.218710] xe 0000:03:00.0: [drm] Tile0: GT1: Engine reset: engine_class=vecs, logical_mask: 0x2, guc_id=3, state=0x289 <7> [252.218711] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.218703] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.218742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.218797] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.218775] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.218878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.218939] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.218971] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.219000] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.219001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.219051] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.219123] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.219129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.219170] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.219231] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.219250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.219302] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.219329] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.219313] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.219368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.219458] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.219487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.219486] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.219537] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.219577] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.219617] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.219599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.219721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.219741] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.219745] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.219774] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.219841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.219844] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.219911] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.219941] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.219964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.220010] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.220079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.220109] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.220137] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.220166] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.220198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.220265] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.220293] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.220317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.220429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.220426] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.220494] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.220519] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.220551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.220656] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.220664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.220688] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.220771] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.220780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.220813] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.220908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.220989] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.221016] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.221023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.221144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.221154] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.221193] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.221260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.221274] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.221379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.221401] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.221486] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.221495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.221535] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.221598] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.221613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.221730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.221763] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.221745] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.221794] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.221855] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <7> [252.221948] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.222100] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.222129] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.222147] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <6> [252.222217] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <7> [252.222250] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.222416] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.222447] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.222626] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.222549] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.222723] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.222813] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <5> [252.223067] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7160, lrc_seqno=7160, guc_id=0, flags=0x73 in no process [-1] <7> [252.223034] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.223072] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.223158] ------------[ cut here ]------------ <4> [252.223160] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [252.223155] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.223150] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <4> [252.223162] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:10/211 <7> [252.223193] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <4> [252.223274] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec <7> [252.223346] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <4> [252.223385] acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.223404] CPU: 6 UID: 0 PID: 211 Comm: kworker/u64:10 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.223408] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.223410] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.223412] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.223420] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <7> [252.223417] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <4> [252.223527] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.223530] RSP: 0018:ffffc90001657ca0 EFLAGS: 00010246 <7> [252.223497] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <4> [252.223534] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.223536] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.223538] RBP: ffffc90001657db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.223539] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <7> [252.223479] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <4> [252.223541] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.223543] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [252.223545] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.223547] CR2: 00007f3a1c001098 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [252.223549] PKRU: 55555554 <4> [252.223551] Call Trace: <4> [252.223552] <TASK> <4> [252.223558] ? lock_acquire+0x40/0x2f0 <4> [252.223566] ? lock_release+0xd0/0x2b0 <4> [252.223576] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.223585] process_one_work+0x22e/0x740 <4> [252.223596] worker_thread+0x1e8/0x3d0 <4> [252.223600] ? __pfx_worker_thread+0x10/0x10 <4> [252.223604] kthread+0x10d/0x150 <4> [252.223608] ? __pfx_kthread+0x10/0x10 <4> [252.223614] ret_from_fork+0x3d4/0x480 <4> [252.223617] ? __pfx_kthread+0x10/0x10 <4> [252.223623] ret_from_fork_asm+0x1a/0x30 <4> [252.223635] </TASK> <4> [252.223637] irq event stamp: 817545 <4> [252.223639] hardirqs last enabled at (817551): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.223643] hardirqs last disabled at (817556): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.223646] softirqs last enabled at (816618): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.223650] softirqs last disabled at (816611): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.223653] ---[ end trace 0000000000000000 ]--- <7> [252.223645] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.223754] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.223800] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.223837] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.223962] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <5> [252.224067] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7180, lrc_seqno=7180, guc_id=0, flags=0x73 in no process [-1] <7> [252.224072] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [252.224114] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <4> [252.224161] ------------[ cut here ]------------ <4> [252.224163] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [252.224151] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <4> [252.224164] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:10/211 <7> [252.224169] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <4> [252.224278] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper <7> [252.224258] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <4> [252.224294] drm_buddy drm_ttm_helper ttm <6> [252.224296] xe 0000:03:00.0: [drm] Tile0: GT1: ASID: 11 Faulted Address: 0x00007f3a42eed000 FaultType: 0 AccessType: 0 FaultLevel: 1 EngineClass: 1 vcs EngineInstance: 2 <4> [252.224299] gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec <6> [252.224304] xe 0000:03:00.0: [drm] Tile0: GT1: Fault response: Unsuccessful -EINVAL <4> [252.224306] rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.224407] CPU: 6 UID: 0 PID: 211 Comm: kworker/u64:10 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.224411] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.224414] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.224416] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [252.224399] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <4> [252.224424] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.224531] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.224533] RSP: 0018:ffffc90001657ca0 EFLAGS: 00010246 <4> [252.224536] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.224538] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.224540] RBP: ffffc90001657db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.224541] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.224543] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.224545] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [252.224548] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.224550] CR2: 00007f3a1c001098 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [252.224552] PKRU: 55555554 <4> [252.224554] Call Trace: <4> [252.224556] <TASK> <4> [252.224562] ? lock_acquire+0x40/0x2f0 <7> [252.224510] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <4> [252.224571] ? lock_release+0xd0/0x2b0 <7> [252.224544] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <4> [252.224580] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.224588] process_one_work+0x22e/0x740 <4> [252.224597] worker_thread+0x1e8/0x3d0 <4> [252.224600] ? __pfx_worker_thread+0x10/0x10 <4> [252.224603] kthread+0x10d/0x150 <4> [252.224607] ? __pfx_kthread+0x10/0x10 <4> [252.224612] ret_from_fork+0x3d4/0x480 <4> [252.224614] ? __pfx_kthread+0x10/0x10 <4> [252.224619] ret_from_fork_asm+0x1a/0x30 <4> [252.224632] </TASK> <4> [252.224633] irq event stamp: 818857 <4> [252.224638] hardirqs last enabled at (818863): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.224642] hardirqs last disabled at (818868): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.224645] softirqs last enabled at (816618): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.224649] softirqs last disabled at (816611): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.224651] ---[ end trace 0000000000000000 ]--- <6> [252.224653] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.224722] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.224728] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.224687] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.224769] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.224876] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.224962] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.224975] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.225117] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.225184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.225269] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.225274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.225363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.225444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.225453] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.225527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.225604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.225604] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.225685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.225752] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.225763] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.225859] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.225909] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.225967] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.226057] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.226339] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.226579] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.226782] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.226977] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.227127] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.227282] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.227431] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.227581] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.227770] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.228002] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.228225] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.228423] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [252.236837] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.237087] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.238117] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.238190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.238260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.238329] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.238397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.238465] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.238533] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.238599] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.238665] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.238730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.238797] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.238950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.239017] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.239083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.239150] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.239217] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.239284] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.239350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.239417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.239491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.239565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.239636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.239710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.239780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.239859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.239929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.239998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.240072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.240144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.240214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.240285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.240353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.240428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.240505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.240582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.240654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.240726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.240794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.240872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.240939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.241009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.241076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.241145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.241210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.241281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.241351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.241418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.241485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.241552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.241619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.241683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.241753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.241818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.241903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.241969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.242036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.242102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.242167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.242235] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.242365] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.242370] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7180, lrc_seqno=7180, guc_id=0, flags=0x73 in no process [-1] <7> [252.242372] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.242428] ------------[ cut here ]------------ <4> [252.242429] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.242431] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:2/121 <4> [252.242496] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.242557] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.242561] CPU: 8 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.242564] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.242565] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.242567] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.242571] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.242636] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.242638] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [252.242640] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.242641] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.242642] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.242643] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.242644] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.242646] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [252.242647] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.242649] CR2: 00007f3a328227fd CR3: 000000011c098002 CR4: 0000000000f72ef0 <4> [252.242650] PKRU: 55555554 <4> [252.242651] Call Trace: <4> [252.242652] <TASK> <4> [252.242656] ? lock_acquire+0x40/0x2f0 <4> [252.242661] ? lock_release+0xd0/0x2b0 <4> [252.242666] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.242672] process_one_work+0x22e/0x740 <4> [252.242677] worker_thread+0x1e8/0x3d0 <4> [252.242680] ? __pfx_worker_thread+0x10/0x10 <4> [252.242682] kthread+0x10d/0x150 <4> [252.242684] ? __pfx_kthread+0x10/0x10 <4> [252.242688] ret_from_fork+0x3d4/0x480 <4> [252.242689] ? __pfx_kthread+0x10/0x10 <4> [252.242692] ret_from_fork_asm+0x1a/0x30 <4> [252.242699] </TASK> <4> [252.242700] irq event stamp: 1744983 <4> [252.242701] hardirqs last enabled at (1744989): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.242704] hardirqs last disabled at (1744994): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.242706] softirqs last enabled at (1743856): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.242708] softirqs last disabled at (1743847): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.242710] ---[ end trace 0000000000000000 ]--- <6> [252.242712] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.242778] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.242786] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.244048] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.244148] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.244248] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.244514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.244651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.244789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.244929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.245061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.245190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.245321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.245449] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.245588] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.245751] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.247142] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.257838] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.258085] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.259105] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.259184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.259256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.259327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.259397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.259466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.259534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.259599] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.259668] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.259734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.259800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.259876] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.259944] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.260010] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.260075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.260142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.260209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.260275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.260342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.260417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.260491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.260562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.260635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.260704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.260773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.260845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.260912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.260981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.261051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.261119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.261189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.261260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.261335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.261409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.261486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.261562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.261634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.261702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.261770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.261840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.261910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.261978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.262045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.262111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.262181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.262249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.262316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.262382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.262449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.262516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.262583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.262654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.262723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.262791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.262867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.262935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.263001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.263066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.263137] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.263261] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.263265] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7180, lrc_seqno=7180, guc_id=0, flags=0x73 in no process [-1] <7> [252.263267] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.263325] ------------[ cut here ]------------ <4> [252.263326] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.263327] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:56/2675 <4> [252.263393] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.263454] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.263459] CPU: 10 UID: 0 PID: 2675 Comm: kworker/u64:56 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.263462] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.263463] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.263464] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.263469] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.263533] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.263534] RSP: 0018:ffffc90004847ca0 EFLAGS: 00010246 <4> [252.263536] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.263538] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.263539] RBP: ffffc90004847db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.263540] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.263541] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.263542] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [252.263544] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.263545] CR2: 00007f3a424227fd CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [252.263546] PKRU: 55555554 <4> [252.263547] Call Trace: <4> [252.263548] <TASK> <4> [252.263552] ? lock_acquire+0x40/0x2f0 <4> [252.263558] ? lock_release+0xd0/0x2b0 <4> [252.263563] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.263568] process_one_work+0x22e/0x740 <4> [252.263574] worker_thread+0x1e8/0x3d0 <4> [252.263576] ? __pfx_worker_thread+0x10/0x10 <4> [252.263578] kthread+0x10d/0x150 <4> [252.263581] ? __pfx_kthread+0x10/0x10 <4> [252.263584] ret_from_fork+0x3d4/0x480 <4> [252.263586] ? __pfx_kthread+0x10/0x10 <4> [252.263589] ret_from_fork_asm+0x1a/0x30 <4> [252.263596] </TASK> <4> [252.263597] irq event stamp: 577559 <4> [252.263598] hardirqs last enabled at (577565): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.263601] hardirqs last disabled at (577570): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.263603] softirqs last enabled at (576654): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.263605] softirqs last disabled at (576647): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.263607] ---[ end trace 0000000000000000 ]--- <5> [252.264472] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7210, lrc_seqno=7210, guc_id=0, flags=0x73 in no process [-1] <7> [252.264479] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.264581] ------------[ cut here ]------------ <4> [252.264584] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.264585] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:34/2653 <4> [252.264658] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.264727] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.264732] CPU: 5 UID: 0 PID: 2653 Comm: kworker/u64:34 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.264735] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.264736] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.264739] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.264745] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.264825] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.264832] RSP: 0018:ffffc900047afca0 EFLAGS: 00010246 <4> [252.264836] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.264838] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.264839] RBP: ffffc900047afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.264840] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.264841] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.264842] FS: 0000000000000000(0000) GS:ffff8888daf1b000(0000) knlGS:0000000000000000 <4> [252.264844] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.264845] CR2: 00007f39f6a8309c CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [252.264846] PKRU: 55555554 <4> [252.264848] Call Trace: <4> [252.264849] <TASK> <4> [252.264853] ? lock_acquire+0x40/0x2f0 <4> [252.264862] ? lock_release+0xd0/0x2b0 <4> [252.264868] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.264874] process_one_work+0x22e/0x740 <4> [252.264881] worker_thread+0x1e8/0x3d0 <4> [252.264884] ? __pfx_worker_thread+0x10/0x10 <4> [252.264886] kthread+0x10d/0x150 <4> [252.264889] ? __pfx_kthread+0x10/0x10 <4> [252.264893] ret_from_fork+0x3d4/0x480 <4> [252.264895] ? __pfx_kthread+0x10/0x10 <4> [252.264898] ret_from_fork_asm+0x1a/0x30 <4> [252.264905] </TASK> <4> [252.264907] irq event stamp: 1363845 <4> [252.264908] hardirqs last enabled at (1363851): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.264913] hardirqs last disabled at (1363856): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.264915] softirqs last enabled at (1336440): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.264917] softirqs last disabled at (1336435): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.264919] ---[ end trace 0000000000000000 ]--- <6> [252.264923] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.265001] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.265014] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.265235] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.265332] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.265433] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.265693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.265826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.265969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.266108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.266239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.266368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.266499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.266627] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.266766] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.266950] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.268281] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.278840] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.279156] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.280309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.280430] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.280546] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.280663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.280780] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.280911] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.281031] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.281148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.281272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.281390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.281507] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.281624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.281741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.281881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.282000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.282117] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.282234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.282351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.282467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.282589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.282712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.282838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.282963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.283083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.283203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.283323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.283442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.283565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.283689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.283811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.283938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.284063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.284191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.284319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.284446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.284571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.284695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.284817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.284942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.285065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.285189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.285311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.285432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.285552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.285677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.285797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.285922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.286044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.286167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.286287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.286407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.286531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.286653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.286775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.286899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.287024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.287144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.287264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.287400] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.287580] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.287588] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7210, lrc_seqno=7210, guc_id=0, flags=0x73 in no process [-1] <7> [252.287591] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.287691] ------------[ cut here ]------------ <4> [252.287693] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.287694] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:2/121 <4> [252.287804] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.287901] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.287907] CPU: 12 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.287911] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.287913] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.287915] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.287923] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.288033] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.288035] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [252.288038] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.288040] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.288042] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.288043] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.288045] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.288047] FS: 0000000000000000(0000) GS:ffff8888db29b000(0000) knlGS:0000000000000000 <4> [252.288049] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.288050] CR2: 00007f3a4f257000 CR3: 000000011c098003 CR4: 0000000000f72ef0 <4> [252.288052] PKRU: 55555554 <4> [252.288054] Call Trace: <4> [252.288055] <TASK> <4> [252.288061] ? lock_acquire+0x40/0x2f0 <4> [252.288070] ? lock_release+0xd0/0x2b0 <4> [252.288078] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.288087] process_one_work+0x22e/0x740 <4> [252.288097] worker_thread+0x1e8/0x3d0 <4> [252.288101] ? __pfx_worker_thread+0x10/0x10 <4> [252.288104] kthread+0x10d/0x150 <4> [252.288107] ? __pfx_kthread+0x10/0x10 <4> [252.288112] ret_from_fork+0x3d4/0x480 <4> [252.288115] ? __pfx_kthread+0x10/0x10 <4> [252.288119] ret_from_fork_asm+0x1a/0x30 <4> [252.288131] </TASK> <4> [252.288132] irq event stamp: 1749075 <4> [252.288134] hardirqs last enabled at (1749081): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.288137] hardirqs last disabled at (1749086): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.288140] softirqs last enabled at (1748462): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.288143] softirqs last disabled at (1748457): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.288146] ---[ end trace 0000000000000000 ]--- <6> [252.289737] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.289879] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.289887] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.289893] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.290041] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.290220] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.290434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.290522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.290608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.290688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.290766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.290933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.291010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.291085] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.291174] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.291282] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.292346] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.302835] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.303083] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.304094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.304167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.304235] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.304305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.304375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.304442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.304512] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.304577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.304645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.304711] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.304777] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.304847] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.304913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.304980] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.305047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.305113] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.305181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.305247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.305314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.305389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.305462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.305533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.305604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.305674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.305741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.305808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.305886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.305956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.306026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.306095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.306164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.306233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.306307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.306381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.306454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.306524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.306593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.306660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.306727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.306793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.306871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.306939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.307005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.307071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.307141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.307206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.307272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.307337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.307404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.307470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.307536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.307607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.307675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.307743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.307808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.307887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.307953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.308020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.308091] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.308220] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.308225] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7210, lrc_seqno=7210, guc_id=0, flags=0x73 in no process [-1] <7> [252.308227] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.308285] ------------[ cut here ]------------ <4> [252.308286] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.308288] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [252.308357] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.308421] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.308426] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.308429] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.308430] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.308431] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.308437] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.308504] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.308506] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [252.308508] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.308509] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.308510] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.308511] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.308513] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.308514] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [252.308515] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.308517] CR2: 000073fc1932ad48 CR3: 0000000127a8f001 CR4: 0000000000f72ef0 <4> [252.308518] PKRU: 55555554 <4> [252.308519] Call Trace: <4> [252.308520] <TASK> <4> [252.308524] ? lock_acquire+0x40/0x2f0 <4> [252.308530] ? lock_release+0xd0/0x2b0 <4> [252.308534] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.308540] process_one_work+0x22e/0x740 <4> [252.308546] worker_thread+0x1e8/0x3d0 <4> [252.308549] ? __pfx_worker_thread+0x10/0x10 <4> [252.308551] kthread+0x10d/0x150 <4> [252.308554] ? __pfx_kthread+0x10/0x10 <4> [252.308557] ret_from_fork+0x3d4/0x480 <4> [252.308559] ? __pfx_kthread+0x10/0x10 <4> [252.308562] ret_from_fork_asm+0x1a/0x30 <4> [252.308569] </TASK> <4> [252.308570] irq event stamp: 1752611 <4> [252.308571] hardirqs last enabled at (1752617): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.308574] hardirqs last disabled at (1752622): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.308575] softirqs last enabled at (1751496): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.308578] softirqs last disabled at (1751491): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.308580] ---[ end trace 0000000000000000 ]--- <5> [252.308931] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7216, lrc_seqno=7216, guc_id=0, flags=0x73 in no process [-1] <7> [252.308934] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.308999] ------------[ cut here ]------------ <4> [252.309000] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.309001] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [252.309071] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.309133] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.309137] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.309140] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.309141] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.309142] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.309147] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.309213] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.309214] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [252.309216] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.309217] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.309219] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.309220] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.309221] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.309222] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [252.309223] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.309225] CR2: 000073fc1932ad48 CR3: 0000000127a8f001 CR4: 0000000000f72ef0 <4> [252.309226] PKRU: 55555554 <4> [252.309227] Call Trace: <4> [252.309228] <TASK> <4> [252.309231] ? lock_acquire+0x40/0x2f0 <4> [252.309237] ? lock_release+0xd0/0x2b0 <4> [252.309242] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.309247] process_one_work+0x22e/0x740 <4> [252.309253] worker_thread+0x1e8/0x3d0 <4> [252.309255] ? __pfx_worker_thread+0x10/0x10 <4> [252.309257] kthread+0x10d/0x150 <4> [252.309261] ? __pfx_kthread+0x10/0x10 <4> [252.309264] ret_from_fork+0x3d4/0x480 <4> [252.309266] ? __pfx_kthread+0x10/0x10 <4> [252.309269] ret_from_fork_asm+0x1a/0x30 <4> [252.309275] </TASK> <4> [252.309276] irq event stamp: 1753659 <4> [252.309277] hardirqs last enabled at (1753665): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.309280] hardirqs last disabled at (1753670): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.309282] softirqs last enabled at (1751496): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.309284] softirqs last disabled at (1751491): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.309286] ---[ end trace 0000000000000000 ]--- <6> [252.309287] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.309353] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.309363] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.309409] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.309612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.309697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.309783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.309878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.309957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.310034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.310111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.310186] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.310279] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.310387] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.311392] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.320673] xe 0000:03:00.0: [drm:xe_hwmon_read [xe]] thermal data for group 0 val 0x25242122 <7> [252.320804] xe 0000:03:00.0: [drm:xe_hwmon_read [xe]] thermal data for group 1 val 0x25252525 <7> [252.321840] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.322162] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.323492] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.323615] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.323734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.323861] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.323981] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.324100] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.324218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.324336] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.324453] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.324571] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.324688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.324805] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.324927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.325046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.325164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.325281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.325398] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.325515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.325633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.325757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.325887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.326009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.326132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.326252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.326373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.326493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.326613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.326736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.326866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.326991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.327114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.327237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.327366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.327494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.327621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.327747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.327876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.327999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.328122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.328243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.328368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.328491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.328614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.328735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.328866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.328989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.329111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.329232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.329355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.329477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.329598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.329722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.329858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.329949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.330028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.330105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.330179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.330250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.330325] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.330442] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.330455] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7216, lrc_seqno=7216, guc_id=0, flags=0x73 in no process [-1] <7> [252.330461] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.330570] ------------[ cut here ]------------ <4> [252.330571] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.330573] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#15: kworker/u64:56/2675 <4> [252.330690] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.330781] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.330788] CPU: 15 UID: 0 PID: 2675 Comm: kworker/u64:56 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.330792] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.330794] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.330796] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.330806] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.330928] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.330931] RSP: 0018:ffffc90004847ca0 EFLAGS: 00010246 <4> [252.330935] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.330937] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.330939] RBP: ffffc90004847db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.330940] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.330942] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.330944] FS: 0000000000000000(0000) GS:ffff8888db41b000(0000) knlGS:0000000000000000 <4> [252.330946] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.330948] CR2: 0000647c528ad8b0 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [252.330950] PKRU: 55555554 <4> [252.330951] Call Trace: <4> [252.330953] <TASK> <4> [252.330960] ? lock_acquire+0x40/0x2f0 <4> [252.330970] ? lock_release+0xd0/0x2b0 <4> [252.330978] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.330987] process_one_work+0x22e/0x740 <4> [252.330997] worker_thread+0x1e8/0x3d0 <4> [252.331002] ? __pfx_worker_thread+0x10/0x10 <4> [252.331005] kthread+0x10d/0x150 <4> [252.331009] ? __pfx_kthread+0x10/0x10 <4> [252.331014] ret_from_fork+0x3d4/0x480 <4> [252.331017] ? __pfx_kthread+0x10/0x10 <4> [252.331021] ret_from_fork_asm+0x1a/0x30 <4> [252.331033] </TASK> <4> [252.331034] irq event stamp: 579545 <4> [252.331036] hardirqs last enabled at (579551): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.331040] hardirqs last disabled at (579556): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.331042] softirqs last enabled at (579384): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.331046] softirqs last disabled at (579379): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.331049] ---[ end trace 0000000000000000 ]--- <6> [252.331052] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.331166] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.331181] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.331395] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.331493] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.331591] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.331805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.331924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.332019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.332102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.332183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.332264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.332342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.332416] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.332503] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.332611] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.333621] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.344187] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.344435] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.345446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.345521] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.345591] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.345660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.345728] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.345796] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.345878] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.345962] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.346030] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.346096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.346162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.346228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.346294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.346359] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.346424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.346490] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.346555] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.346620] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.346686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.346760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.346838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.346936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.347010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.347079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.347148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.347216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.347283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.347352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.347422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.347488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.347556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.347625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.347697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.347769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.347848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.347941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.348012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.348079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.348146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.348211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.348279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.348346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.348412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.348476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.348544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.348607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.348671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.348734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.348799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.348881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.348980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.349054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.349124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.349191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.349256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.349324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.349389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.349455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.349522] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.349656] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.349660] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7216, lrc_seqno=7216, guc_id=0, flags=0x73 in no process [-1] <7> [252.349663] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.349720] ------------[ cut here ]------------ <4> [252.349721] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.349722] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:25/2644 <4> [252.349790] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.349861] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.349866] CPU: 9 UID: 0 PID: 2644 Comm: kworker/u64:25 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.349869] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.349871] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.349872] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.349877] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.349970] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.349971] RSP: 0018:ffffc90004767ca0 EFLAGS: 00010246 <4> [252.349974] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.349975] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.349976] RBP: ffffc90004767db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.349978] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.349979] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.349980] FS: 0000000000000000(0000) GS:ffff8888db11b000(0000) knlGS:0000000000000000 <4> [252.349981] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.349983] CR2: 00007f3a51545c60 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [252.349984] PKRU: 55555554 <4> [252.349985] Call Trace: <4> [252.349986] <TASK> <4> [252.349990] ? lock_acquire+0x40/0x2f0 <4> [252.349996] ? lock_release+0xd0/0x2b0 <4> [252.350001] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.350006] process_one_work+0x22e/0x740 <4> [252.350012] worker_thread+0x1e8/0x3d0 <4> [252.350015] ? __pfx_worker_thread+0x10/0x10 <4> [252.350017] kthread+0x10d/0x150 <4> [252.350019] ? __pfx_kthread+0x10/0x10 <4> [252.350023] ret_from_fork+0x3d4/0x480 <4> [252.350024] ? __pfx_kthread+0x10/0x10 <4> [252.350027] ret_from_fork_asm+0x1a/0x30 <4> [252.350034] </TASK> <4> [252.350035] irq event stamp: 1581169 <4> [252.350036] hardirqs last enabled at (1581175): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.350039] hardirqs last disabled at (1581180): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.350041] softirqs last enabled at (1580228): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.350043] softirqs last disabled at (1580223): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.350045] ---[ end trace 0000000000000000 ]--- <5> [252.350880] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7223, lrc_seqno=7223, guc_id=0, flags=0x73 in no process [-1] <7> [252.350886] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.351023] ------------[ cut here ]------------ <4> [252.351025] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.351027] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#15: kworker/u64:56/2675 <4> [252.351142] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.351234] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.351240] CPU: 15 UID: 0 PID: 2675 Comm: kworker/u64:56 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.351244] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.351245] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.351247] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.351255] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.351378] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.351381] RSP: 0018:ffffc90004847ca0 EFLAGS: 00010246 <4> [252.351384] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.351386] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.351387] RBP: ffffc90004847db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.351389] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.351390] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.351392] FS: 0000000000000000(0000) GS:ffff8888db41b000(0000) knlGS:0000000000000000 <4> [252.351394] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.351396] CR2: 0000647c528ad8b0 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [252.351398] PKRU: 55555554 <4> [252.351400] Call Trace: <4> [252.351401] <TASK> <4> [252.351407] ? lock_acquire+0x40/0x2f0 <4> [252.351415] ? lock_release+0xd0/0x2b0 <4> [252.351423] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.351432] process_one_work+0x22e/0x740 <4> [252.351441] worker_thread+0x1e8/0x3d0 <4> [252.351445] ? __pfx_worker_thread+0x10/0x10 <4> [252.351448] kthread+0x10d/0x150 <4> [252.351451] ? __pfx_kthread+0x10/0x10 <4> [252.351456] ret_from_fork+0x3d4/0x480 <4> [252.351459] ? __pfx_kthread+0x10/0x10 <4> [252.351463] ret_from_fork_asm+0x1a/0x30 <4> [252.351475] </TASK> <4> [252.351476] irq event stamp: 580825 <4> [252.351477] hardirqs last enabled at (580831): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.351481] hardirqs last disabled at (580836): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.351483] softirqs last enabled at (579384): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.351486] softirqs last disabled at (579379): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.351489] ---[ end trace 0000000000000000 ]--- <6> [252.351491] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [252.351509] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [252.351602] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.351620] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.351611] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.351806] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.352069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.352200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.352334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.352463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.352591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.352718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.352852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.352980] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.353118] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.353279] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.354644] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.364839] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.365145] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.366387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.366503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.366619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.366736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.366860] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.366978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.367094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.367211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.367327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.367444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.367561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.367677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.367793] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.367914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.368033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.368149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.368266] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.368383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.368499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.368620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.368742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.368878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.368970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.369049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.369122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.369193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.369262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.369334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.369406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.369476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.369548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.369618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.369693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.369768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.369850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.369925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.369995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.370062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.370130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.370198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.370275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.370348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.370419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.370488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.370561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.370629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.370698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.370766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.370838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.370906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.370971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.371040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.371108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.371176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.371243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.371312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.371379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.371447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.371516] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.371643] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.371647] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7223, lrc_seqno=7223, guc_id=0, flags=0x73 in no process [-1] <7> [252.371650] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.371707] ------------[ cut here ]------------ <4> [252.371708] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.371709] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:56/2675 <4> [252.371776] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.371839] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.371844] CPU: 10 UID: 0 PID: 2675 Comm: kworker/u64:56 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.371847] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.371848] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.371850] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.371855] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.371920] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.371922] RSP: 0018:ffffc90004847ca0 EFLAGS: 00010246 <4> [252.371924] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.371925] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.371926] RBP: ffffc90004847db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.371927] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.371929] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.371930] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [252.371931] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.371932] CR2: 000000c000599000 CR3: 000000011c098003 CR4: 0000000000f72ef0 <4> [252.371934] PKRU: 55555554 <4> [252.371935] Call Trace: <4> [252.371936] <TASK> <4> [252.371940] ? lock_acquire+0x40/0x2f0 <4> [252.371945] ? lock_release+0xd0/0x2b0 <4> [252.371950] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.371955] process_one_work+0x22e/0x740 <4> [252.371961] worker_thread+0x1e8/0x3d0 <4> [252.371963] ? __pfx_worker_thread+0x10/0x10 <4> [252.371966] kthread+0x10d/0x150 <4> [252.371968] ? __pfx_kthread+0x10/0x10 <4> [252.371971] ret_from_fork+0x3d4/0x480 <4> [252.371973] ? __pfx_kthread+0x10/0x10 <4> [252.371976] ret_from_fork_asm+0x1a/0x30 <4> [252.371983] </TASK> <4> [252.371984] irq event stamp: 584201 <4> [252.371985] hardirqs last enabled at (584207): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.371988] hardirqs last disabled at (584212): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.371990] softirqs last enabled at (582910): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.371992] softirqs last disabled at (582901): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.371994] ---[ end trace 0000000000000000 ]--- <6> [252.372879] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.373009] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.373021] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.373024] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.373122] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.373251] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.373516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.373649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.373784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.373923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.374053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.374180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.374309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.374435] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.374573] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.374734] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.376049] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.385842] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.386157] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.387321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.387442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.387559] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.387677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.387794] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.387921] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.388041] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.388157] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.388274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.388391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.388508] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.388624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.388741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.388865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.388984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.389101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.389218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.389335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.389451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.389574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.389698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.389818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.389945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.390068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.390188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.390307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.390427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.390549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.390673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.390795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.390922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.391048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.391177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.391304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.391431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.391557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.391681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.391802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.391929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.392051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.392176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.392299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.392420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.392540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.392665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.392785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.392911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.393033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.393156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.393276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.393396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.393520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.393642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.393764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.393888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.394012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.394132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.394253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.394377] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.394556] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.394563] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7223, lrc_seqno=7223, guc_id=0, flags=0x73 in no process [-1] <7> [252.394566] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.394665] ------------[ cut here ]------------ <4> [252.394666] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.394668] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#13: kworker/u64:56/2675 <4> [252.394778] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.394869] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.394875] CPU: 13 UID: 0 PID: 2675 Comm: kworker/u64:56 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.394879] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.394881] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.394883] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.394890] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.394999] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.395001] RSP: 0018:ffffc90004847ca0 EFLAGS: 00010246 <4> [252.395004] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.395006] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.395008] RBP: ffffc90004847db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.395009] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.395011] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.395013] FS: 0000000000000000(0000) GS:ffff8888db31b000(0000) knlGS:0000000000000000 <4> [252.395015] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.395017] CR2: 0000744f0c333000 CR3: 000000011c098002 CR4: 0000000000f72ef0 <4> [252.395019] PKRU: 55555554 <4> [252.395020] Call Trace: <4> [252.395022] <TASK> <4> [252.395028] ? lock_acquire+0x40/0x2f0 <4> [252.395036] ? lock_release+0xd0/0x2b0 <4> [252.395044] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.395053] process_one_work+0x22e/0x740 <4> [252.395063] worker_thread+0x1e8/0x3d0 <4> [252.395067] ? __pfx_worker_thread+0x10/0x10 <4> [252.395070] kthread+0x10d/0x150 <4> [252.395074] ? __pfx_kthread+0x10/0x10 <4> [252.395079] ret_from_fork+0x3d4/0x480 <4> [252.395081] ? __pfx_kthread+0x10/0x10 <4> [252.395085] ret_from_fork_asm+0x1a/0x30 <4> [252.395097] </TASK> <4> [252.395099] irq event stamp: 587409 <4> [252.395100] hardirqs last enabled at (587415): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.395103] hardirqs last disabled at (587420): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.395106] softirqs last enabled at (586448): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.395109] softirqs last disabled at (586441): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.395112] ---[ end trace 0000000000000000 ]--- <5> [252.396766] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7228, lrc_seqno=7228, guc_id=0, flags=0x73 in no process [-1] <7> [252.396770] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.396842] ------------[ cut here ]------------ <4> [252.396844] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.396846] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:25/2644 <4> [252.396916] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.396975] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.396979] CPU: 9 UID: 0 PID: 2644 Comm: kworker/u64:25 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.396982] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.396983] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.396984] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.396989] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <7> [252.396945] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [252.397056] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.397057] RSP: 0018:ffffc90004767ca0 EFLAGS: 00010246 <4> [252.397059] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.397061] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.397062] RBP: ffffc90004767db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.397063] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.397063] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.397065] FS: 0000000000000000(0000) GS:ffff8888db11b000(0000) knlGS:0000000000000000 <4> [252.397066] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.397067] CR2: 00007f3a51545c60 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [252.397068] PKRU: 55555554 <4> [252.397069] Call Trace: <4> [252.397070] <TASK> <4> [252.397073] ? lock_acquire+0x40/0x2f0 <4> [252.397078] ? lock_release+0xd0/0x2b0 <4> [252.397083] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.397088] process_one_work+0x22e/0x740 <4> [252.397094] worker_thread+0x1e8/0x3d0 <4> [252.397096] ? __pfx_worker_thread+0x10/0x10 <4> [252.397098] kthread+0x10d/0x150 <4> [252.397101] ? __pfx_kthread+0x10/0x10 <4> [252.397104] ret_from_fork+0x3d4/0x480 <4> [252.397106] ? __pfx_kthread+0x10/0x10 <4> [252.397109] ret_from_fork_asm+0x1a/0x30 <4> [252.397116] </TASK> <4> [252.397117] irq event stamp: 1582701 <4> [252.397118] hardirqs last enabled at (1582707): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.397120] hardirqs last disabled at (1582712): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.397122] softirqs last enabled at (1580228): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.397124] softirqs last disabled at (1580223): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.397126] ---[ end trace 0000000000000000 ]--- <6> [252.397128] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [252.397113] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [252.397194] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.397201] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.397609] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.397815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.397914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.398002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.398083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.398162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.398238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.398315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.398389] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.398478] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.398585] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.399589] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.409837] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.410081] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.411097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.411171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.411242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.411312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.411382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.411452] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.411523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.411590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.411657] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.411725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.411791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.411868] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.411935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.412003] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.412070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.412137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.412204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.412272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.412338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.412413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.412486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.412557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.412629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.412698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.412766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.412856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.412924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.412995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.413067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.413136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.413206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.413276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.413350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.413425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.413498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.413569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.413637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.413705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.413775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.413847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.413920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.413989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.414059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.414128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.414201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.414269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.414337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.414404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.414472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.414539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.414607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.414676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.414745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.414812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.414893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.414963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.415031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.415097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.415168] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.415298] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.415301] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7228, lrc_seqno=7228, guc_id=0, flags=0x73 in no process [-1] <7> [252.415304] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.415361] ------------[ cut here ]------------ <4> [252.415362] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.415364] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:49/2668 <4> [252.415431] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.415490] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.415494] CPU: 8 UID: 0 PID: 2668 Comm: kworker/u64:49 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.415497] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.415498] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.415500] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.415504] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.415569] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.415570] RSP: 0018:ffffc90004827ca0 EFLAGS: 00010246 <4> [252.415572] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.415574] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.415575] RBP: ffffc90004827db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.415576] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.415577] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.415578] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [252.415580] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.415581] CR2: 0000744f00093428 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [252.415582] PKRU: 55555554 <4> [252.415583] Call Trace: <4> [252.415584] <TASK> <4> [252.415588] ? lock_acquire+0x40/0x2f0 <4> [252.415593] ? lock_release+0xd0/0x2b0 <4> [252.415598] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.415603] process_one_work+0x22e/0x740 <4> [252.415609] worker_thread+0x1e8/0x3d0 <4> [252.415611] ? __pfx_worker_thread+0x10/0x10 <4> [252.415613] kthread+0x10d/0x150 <4> [252.415616] ? __pfx_kthread+0x10/0x10 <4> [252.415619] ret_from_fork+0x3d4/0x480 <4> [252.415621] ? __pfx_kthread+0x10/0x10 <4> [252.415624] ret_from_fork_asm+0x1a/0x30 <4> [252.415631] </TASK> <4> [252.415632] irq event stamp: 284653 <4> [252.415633] hardirqs last enabled at (284659): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.415635] hardirqs last disabled at (284664): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.415637] softirqs last enabled at (283644): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.415639] softirqs last disabled at (283637): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.415641] ---[ end trace 0000000000000000 ]--- <6> [252.415643] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.415707] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.415713] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.416968] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.417066] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.417164] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.417375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.417466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.417556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.417640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.417725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.417805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.417897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.417973] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.418064] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.418174] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.419179] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.429835] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.430085] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.431366] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.431441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.431511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.431580] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.431649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.431718] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.431785] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.431870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.431939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.432007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.432076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.432142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.432209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.432274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.432340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.432406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.432471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.432538] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.432603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.432678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.432753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.432823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.432908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.432979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.433047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.433114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.433184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.433254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.433326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.433395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.433464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.433535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.433609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.433685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.433759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.433834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.433906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.433975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.434044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.434111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.434182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.434252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.434321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.434388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.434457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.434523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.434591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.434658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.434725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.434789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.434862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.434932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.435001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.435068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.435134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.435201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.435268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.435335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.435404] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.435531] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.435534] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7228, lrc_seqno=7228, guc_id=0, flags=0x73 in no process [-1] <7> [252.435537] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.435593] ------------[ cut here ]------------ <4> [252.435594] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.435595] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:2/121 <4> [252.435663] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.435723] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.435727] CPU: 4 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.435730] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.435731] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.435732] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.435737] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.435802] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.435803] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [252.435805] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.435807] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.435808] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.435809] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.435810] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.435811] FS: 0000000000000000(0000) GS:ffff8888dae9b000(0000) knlGS:0000000000000000 <4> [252.435813] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.435814] CR2: 00007f3a503e61b4 CR3: 000000011e422005 CR4: 0000000000f72ef0 <4> [252.435815] PKRU: 55555554 <4> [252.435816] Call Trace: <4> [252.435817] <TASK> <4> [252.435821] ? lock_acquire+0x40/0x2f0 <4> [252.435826] ? lock_release+0xd0/0x2b0 <4> [252.435837] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.435846] process_one_work+0x22e/0x740 <4> [252.435852] worker_thread+0x1e8/0x3d0 <4> [252.435855] ? __pfx_worker_thread+0x10/0x10 <4> [252.435857] kthread+0x10d/0x150 <4> [252.435860] ? __pfx_kthread+0x10/0x10 <4> [252.435863] ret_from_fork+0x3d4/0x480 <4> [252.435865] ? __pfx_kthread+0x10/0x10 <4> [252.435869] ret_from_fork_asm+0x1a/0x30 <4> [252.435876] </TASK> <4> [252.435877] irq event stamp: 1763455 <4> [252.435878] hardirqs last enabled at (1763461): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.435880] hardirqs last disabled at (1763466): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.435882] softirqs last enabled at (1762314): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.435884] softirqs last disabled at (1762307): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.435886] ---[ end trace 0000000000000000 ]--- <5> [252.436872] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7238, lrc_seqno=7238, guc_id=0, flags=0x73 in no process [-1] <7> [252.436879] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.436963] ------------[ cut here ]------------ <4> [252.436964] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.436965] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:25/2644 <4> [252.437032] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.437090] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.437094] CPU: 9 UID: 0 PID: 2644 Comm: kworker/u64:25 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.437097] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.437098] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.437099] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [252.437075] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [252.437104] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.437168] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.437169] RSP: 0018:ffffc90004767ca0 EFLAGS: 00010246 <4> [252.437171] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.437172] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.437174] RBP: ffffc90004767db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.437175] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.437176] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.437177] FS: 0000000000000000(0000) GS:ffff8888db11b000(0000) knlGS:0000000000000000 <4> [252.437179] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.437180] CR2: 00007f3a51545c60 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [252.437181] PKRU: 55555554 <4> [252.437182] Call Trace: <4> [252.437183] <TASK> <4> [252.437187] ? lock_acquire+0x40/0x2f0 <4> [252.437191] ? lock_release+0xd0/0x2b0 <4> [252.437196] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.437201] process_one_work+0x22e/0x740 <4> [252.437207] worker_thread+0x1e8/0x3d0 <4> [252.437209] ? __pfx_worker_thread+0x10/0x10 <4> [252.437211] kthread+0x10d/0x150 <4> [252.437214] ? __pfx_kthread+0x10/0x10 <4> [252.437217] ret_from_fork+0x3d4/0x480 <7> [252.437174] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [252.437219] ? __pfx_kthread+0x10/0x10 <4> [252.437222] ret_from_fork_asm+0x1a/0x30 <4> [252.437228] </TASK> <4> [252.437229] irq event stamp: 1583977 <4> [252.437230] hardirqs last enabled at (1583983): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.437232] hardirqs last disabled at (1583988): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.437234] softirqs last enabled at (1580228): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.437236] softirqs last disabled at (1580223): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.437238] ---[ end trace 0000000000000000 ]--- <6> [252.437240] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.437306] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.437312] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.437717] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.437926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.438010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.438094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.438174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.438251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.438325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.438401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.438474] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.438561] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.438668] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.439684] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.449835] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.450079] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.451346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.451419] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.451490] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.451561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.451629] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.451698] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.451767] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.451851] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.451917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.451983] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.452051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.452119] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.452187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.452254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.452320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.452388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.452455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.452520] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.452586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.452661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.452735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.452805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.452884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.452953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.453022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.453092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.453159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.453229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.453297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.453363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.453430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.453497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.453569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.453643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.453716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.453786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.453862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.453932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.453999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.454064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.454132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.454198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.454264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.454328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.454397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.454464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.454529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.454593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.454659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.454723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.454787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.454866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.454933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.454999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.455066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.455134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.455198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.455262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.455332] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.455458] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.455462] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7238, lrc_seqno=7238, guc_id=0, flags=0x73 in no process [-1] <7> [252.455465] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.455520] ------------[ cut here ]------------ <4> [252.455521] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.455522] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:2/121 <4> [252.455588] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.455646] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.455650] CPU: 4 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.455653] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.455654] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.455655] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.455660] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.455725] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.455727] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [252.455729] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.455730] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.455731] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.455732] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.455733] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.455734] FS: 0000000000000000(0000) GS:ffff8888dae9b000(0000) knlGS:0000000000000000 <4> [252.455736] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.455737] CR2: 00007f3a503e61b4 CR3: 000000011e422005 CR4: 0000000000f72ef0 <4> [252.455738] PKRU: 55555554 <4> [252.455739] Call Trace: <4> [252.455740] <TASK> <4> [252.455744] ? lock_acquire+0x40/0x2f0 <4> [252.455749] ? lock_release+0xd0/0x2b0 <4> [252.455754] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.455759] process_one_work+0x22e/0x740 <4> [252.455765] worker_thread+0x1e8/0x3d0 <4> [252.455767] ? __pfx_worker_thread+0x10/0x10 <4> [252.455769] kthread+0x10d/0x150 <4> [252.455772] ? __pfx_kthread+0x10/0x10 <4> [252.455775] ret_from_fork+0x3d4/0x480 <4> [252.455777] ? __pfx_kthread+0x10/0x10 <4> [252.455780] ret_from_fork_asm+0x1a/0x30 <4> [252.455786] </TASK> <4> [252.455787] irq event stamp: 1767109 <4> [252.455789] hardirqs last enabled at (1767115): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.455791] hardirqs last disabled at (1767120): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.455793] softirqs last enabled at (1765970): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.455795] softirqs last disabled at (1765963): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.455797] ---[ end trace 0000000000000000 ]--- <6> [252.455799] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.455875] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.455880] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.456896] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.456995] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.457094] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.457298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.457382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.457469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.457550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.457629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.457705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.457782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.457865] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.457957] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.458066] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.459068] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.468837] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.469081] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.470355] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.470427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.470496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.470568] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.470636] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.470703] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.470771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.470843] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.470912] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.470980] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.471046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.471112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.471178] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.471244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.471313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.471378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.471444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.471509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.471574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.471648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.471722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.471791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.471876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.471945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.472013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.472080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.472147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.472217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.472289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.472358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.472426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.472494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.472568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.472642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.472717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.472789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.472869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.472938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.473006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.473073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.473143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.473212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.473282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.473350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.473422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.473489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.473557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.473623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.473692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.473759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.473827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.473914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.473983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.474052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.474118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.474186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.474252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.474319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.474387] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.474514] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.474518] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7238, lrc_seqno=7238, guc_id=0, flags=0x73 in no process [-1] <7> [252.474520] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.474576] ------------[ cut here ]------------ <4> [252.474577] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.474579] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:49/2668 <4> [252.474647] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.474705] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.474709] CPU: 8 UID: 0 PID: 2668 Comm: kworker/u64:49 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.474712] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.474713] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.474714] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.474719] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.474783] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.474784] RSP: 0018:ffffc90004827ca0 EFLAGS: 00010246 <4> [252.474786] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.474788] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.474789] RBP: ffffc90004827db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.474790] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.474791] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.474792] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [252.474794] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.474795] CR2: 0000744f00093428 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [252.474796] PKRU: 55555554 <4> [252.474797] Call Trace: <4> [252.474798] <TASK> <4> [252.474802] ? lock_acquire+0x40/0x2f0 <4> [252.474807] ? lock_release+0xd0/0x2b0 <4> [252.474812] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.474817] process_one_work+0x22e/0x740 <4> [252.474823] worker_thread+0x1e8/0x3d0 <4> [252.474825] ? __pfx_worker_thread+0x10/0x10 <4> [252.474832] kthread+0x10d/0x150 <4> [252.474835] ? __pfx_kthread+0x10/0x10 <4> [252.474839] ret_from_fork+0x3d4/0x480 <4> [252.474840] ? __pfx_kthread+0x10/0x10 <4> [252.474844] ret_from_fork_asm+0x1a/0x30 <4> [252.474851] </TASK> <4> [252.474852] irq event stamp: 288149 <4> [252.474853] hardirqs last enabled at (288155): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.474856] hardirqs last disabled at (288160): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.474858] softirqs last enabled at (287008): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.474860] softirqs last disabled at (287003): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.474862] ---[ end trace 0000000000000000 ]--- <5> [252.475882] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7243, lrc_seqno=7243, guc_id=0, flags=0x73 in no process [-1] <7> [252.475888] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.475989] ------------[ cut here ]------------ <4> [252.475990] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.475991] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:56/2675 <4> [252.476069] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.476128] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.476132] CPU: 6 UID: 0 PID: 2675 Comm: kworker/u64:56 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.476135] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.476136] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.476138] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [252.476097] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [252.476143] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.476215] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.476217] RSP: 0018:ffffc90004847ca0 EFLAGS: 00010246 <4> [252.476219] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.476220] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.476222] RBP: ffffc90004847db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.476223] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.476224] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.476225] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [252.476227] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.476228] CR2: 00007f3a1c001098 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [252.476229] PKRU: 55555554 <4> [252.476230] Call Trace: <4> [252.476231] <TASK> <4> [252.476235] ? lock_acquire+0x40/0x2f0 <7> [252.476194] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [252.476240] ? lock_release+0xd0/0x2b0 <4> [252.476245] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.476250] process_one_work+0x22e/0x740 <4> [252.476256] worker_thread+0x1e8/0x3d0 <4> [252.476258] ? __pfx_worker_thread+0x10/0x10 <4> [252.476260] kthread+0x10d/0x150 <4> [252.476263] ? __pfx_kthread+0x10/0x10 <4> [252.476266] ret_from_fork+0x3d4/0x480 <4> [252.476267] ? __pfx_kthread+0x10/0x10 <4> [252.476270] ret_from_fork_asm+0x1a/0x30 <4> [252.476277] </TASK> <4> [252.476278] irq event stamp: 588943 <4> [252.476279] hardirqs last enabled at (588949): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.476283] hardirqs last disabled at (588954): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.476285] softirqs last enabled at (586448): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.476288] softirqs last disabled at (586441): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.476289] ---[ end trace 0000000000000000 ]--- <6> [252.476291] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.476363] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.476369] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.476775] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.477003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.477086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.477170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.477250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.477328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.477405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.477485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.477559] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.477646] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.477755] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.478753] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.488837] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.489081] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.490342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.490414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.490484] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.490553] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.490620] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.490690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.490758] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.490824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.490917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.490984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.491052] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.491118] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.491184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.491249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.491315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.491380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.491448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.491516] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.491583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.491657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.491730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.491801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.491885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.491955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.492023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.492091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.492158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.492227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.492298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.492367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.492438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.492507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.492580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.492654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.492728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.492799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.492886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.492953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.493020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.493085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.493154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.493220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.493286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.493351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.493420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.493487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.493554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.493619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.493687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.493752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.493816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.493901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.493969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.494037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.494102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.494172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.494240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.494307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.494379] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.494507] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.494510] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7243, lrc_seqno=7243, guc_id=0, flags=0x73 in no process [-1] <7> [252.494512] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.494568] ------------[ cut here ]------------ <4> [252.494569] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.494570] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:49/2668 <4> [252.494637] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.494696] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.494700] CPU: 8 UID: 0 PID: 2668 Comm: kworker/u64:49 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.494702] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.494703] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.494705] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.494710] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.494776] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.494777] RSP: 0018:ffffc90004827ca0 EFLAGS: 00010246 <4> [252.494780] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.494781] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.494782] RBP: ffffc90004827db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.494783] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.494784] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.494785] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [252.494787] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.494788] CR2: 0000744f00093428 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [252.494789] PKRU: 55555554 <4> [252.494790] Call Trace: <4> [252.494791] <TASK> <4> [252.494795] ? lock_acquire+0x40/0x2f0 <4> [252.494800] ? lock_release+0xd0/0x2b0 <4> [252.494805] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.494810] process_one_work+0x22e/0x740 <4> [252.494816] worker_thread+0x1e8/0x3d0 <4> [252.494818] ? __pfx_worker_thread+0x10/0x10 <4> [252.494820] kthread+0x10d/0x150 <4> [252.494823] ? __pfx_kthread+0x10/0x10 <4> [252.494826] ret_from_fork+0x3d4/0x480 <4> [252.494833] ? __pfx_kthread+0x10/0x10 <4> [252.494837] ret_from_fork_asm+0x1a/0x30 <4> [252.494845] </TASK> <4> [252.494846] irq event stamp: 291573 <4> [252.494847] hardirqs last enabled at (291579): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.494849] hardirqs last disabled at (291584): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.494851] softirqs last enabled at (290644): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.494854] softirqs last disabled at (290639): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.494856] ---[ end trace 0000000000000000 ]--- <6> [252.494857] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.494924] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.494929] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.496214] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.496309] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.496407] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.496613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.496697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.496783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.496880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.496961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.497039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.497116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.497191] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.497280] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.497388] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.498390] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.508836] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.509082] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.510312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.510385] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.510449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.510513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.510575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.510637] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.510699] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.510759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.510822] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.510904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.510970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.511036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.511103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.511170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.511237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.511303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.511371] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.511437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.511503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.511579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.511655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.511728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.511800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.511895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.511966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.512034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.512102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.512172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.512243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.512314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.512385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.512454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.512528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.512601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.512674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.512744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.512813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.512897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.512966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.513032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.513100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.513171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.513240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.513308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.513379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.513447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.513515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.513581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.513652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.513718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.513785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.513872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.513940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.514009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.514076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.514144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.514211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.514278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.514348] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.514470] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.514474] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7243, lrc_seqno=7243, guc_id=0, flags=0x73 in no process [-1] <7> [252.514477] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.514533] ------------[ cut here ]------------ <4> [252.514534] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.514535] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:2/121 <4> [252.514601] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.514660] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.514664] CPU: 4 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.514667] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.514668] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.514669] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.514674] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.514738] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.514740] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [252.514742] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.514743] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.514744] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.514746] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.514747] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.514748] FS: 0000000000000000(0000) GS:ffff8888dae9b000(0000) knlGS:0000000000000000 <4> [252.514749] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.514751] CR2: 00007f3a503e61b4 CR3: 000000011e422005 CR4: 0000000000f72ef0 <4> [252.514752] PKRU: 55555554 <4> [252.514753] Call Trace: <4> [252.514754] <TASK> <4> [252.514758] ? lock_acquire+0x40/0x2f0 <4> [252.514763] ? lock_release+0xd0/0x2b0 <4> [252.514768] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.514774] process_one_work+0x22e/0x740 <4> [252.514779] worker_thread+0x1e8/0x3d0 <4> [252.514782] ? __pfx_worker_thread+0x10/0x10 <4> [252.514784] kthread+0x10d/0x150 <4> [252.514786] ? __pfx_kthread+0x10/0x10 <4> [252.514790] ret_from_fork+0x3d4/0x480 <4> [252.514791] ? __pfx_kthread+0x10/0x10 <4> [252.514794] ret_from_fork_asm+0x1a/0x30 <4> [252.514801] </TASK> <4> [252.514802] irq event stamp: 1770733 <4> [252.514803] hardirqs last enabled at (1770739): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.514806] hardirqs last disabled at (1770744): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.514808] softirqs last enabled at (1769706): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.514810] softirqs last disabled at (1769697): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.514812] ---[ end trace 0000000000000000 ]--- <5> [252.515861] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7250, lrc_seqno=7250, guc_id=0, flags=0x73 in no process [-1] <7> [252.515864] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.515921] ------------[ cut here ]------------ <4> [252.515922] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.515923] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:49/2668 <4> [252.515992] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class <7> [252.515994] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [252.516044] intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.516055] CPU: 8 UID: 0 PID: 2668 Comm: kworker/u64:49 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.516057] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.516058] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.516059] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.516064] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.516128] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.516129] RSP: 0018:ffffc90004827ca0 EFLAGS: 00010246 <4> [252.516131] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.516132] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.516133] RBP: ffffc90004827db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.516134] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.516135] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.516137] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [252.516138] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.516139] CR2: 0000744f00093428 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [252.516141] PKRU: 55555554 <7> [252.516096] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [252.516142] Call Trace: <4> [252.516143] <TASK> <4> [252.516146] ? lock_acquire+0x40/0x2f0 <4> [252.516151] ? lock_release+0xd0/0x2b0 <4> [252.516156] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.516161] process_one_work+0x22e/0x740 <4> [252.516166] worker_thread+0x1e8/0x3d0 <4> [252.516169] ? __pfx_worker_thread+0x10/0x10 <4> [252.516170] kthread+0x10d/0x150 <4> [252.516173] ? __pfx_kthread+0x10/0x10 <4> [252.516176] ret_from_fork+0x3d4/0x480 <4> [252.516178] ? __pfx_kthread+0x10/0x10 <4> [252.516180] ret_from_fork_asm+0x1a/0x30 <4> [252.516187] </TASK> <4> [252.516188] irq event stamp: 292637 <4> [252.516189] hardirqs last enabled at (292643): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.516192] hardirqs last disabled at (292648): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.516194] softirqs last enabled at (290644): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.516196] softirqs last disabled at (290639): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.516198] ---[ end trace 0000000000000000 ]--- <6> [252.516199] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.516264] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.516270] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.516683] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.516890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.516972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.517057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.517135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.517212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.517285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.517359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.517429] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.517516] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.517623] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.518640] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.528837] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.529082] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.530247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.530320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.530390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.530460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.530529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.530596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.530664] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.530731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.530798] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.530877] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.530946] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.531013] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.531080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.531146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.531214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.531281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.531347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.531412] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.531477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.531552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.531625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.531694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.531764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.531837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.531908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.531976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.532043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.532111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.532181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.532247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.532316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.532385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.532458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.532530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.532606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.532675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.532744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.532812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.532893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.532962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.533032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.533103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.533171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.533239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.533310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.533377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.533445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.533513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.533584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.533650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.533716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.533786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.533865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.533933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.534001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.534069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.534136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.534202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.534271] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.534399] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.534403] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7250, lrc_seqno=7250, guc_id=0, flags=0x73 in no process [-1] <7> [252.534405] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.534461] ------------[ cut here ]------------ <4> [252.534462] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.534463] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:49/2668 <4> [252.534531] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.534589] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.534593] CPU: 8 UID: 0 PID: 2668 Comm: kworker/u64:49 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.534596] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.534597] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.534598] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.534603] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.534666] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.534668] RSP: 0018:ffffc90004827ca0 EFLAGS: 00010246 <4> [252.534670] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.534671] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.534672] RBP: ffffc90004827db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.534674] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.534675] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.534676] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [252.534677] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.534678] CR2: 0000744f00093428 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [252.534680] PKRU: 55555554 <4> [252.534681] Call Trace: <4> [252.534682] <TASK> <4> [252.534685] ? lock_acquire+0x40/0x2f0 <4> [252.534690] ? lock_release+0xd0/0x2b0 <4> [252.534695] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.534701] process_one_work+0x22e/0x740 <4> [252.534706] worker_thread+0x1e8/0x3d0 <4> [252.534709] ? __pfx_worker_thread+0x10/0x10 <4> [252.534711] kthread+0x10d/0x150 <4> [252.534713] ? __pfx_kthread+0x10/0x10 <4> [252.534717] ret_from_fork+0x3d4/0x480 <4> [252.534718] ? __pfx_kthread+0x10/0x10 <4> [252.534721] ret_from_fork_asm+0x1a/0x30 <4> [252.534728] </TASK> <4> [252.534729] irq event stamp: 295813 <4> [252.534730] hardirqs last enabled at (295819): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.534733] hardirqs last disabled at (295824): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.534735] softirqs last enabled at (294894): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.534737] softirqs last disabled at (294889): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.534739] ---[ end trace 0000000000000000 ]--- <6> [252.534740] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.534805] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.534810] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.536059] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.536155] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.536251] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.536463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.536555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.536647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.536730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.536812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.536905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.536985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.537062] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.537158] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.537273] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.538278] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.548834] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.549080] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.550334] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.550404] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.550471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.550539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.550605] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.550670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.550734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.550798] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.550872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.550942] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.551012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.551082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.551151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.551220] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.551289] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.551358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.551428] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.551500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.551571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.551650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.551730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.551806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.551890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.551963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.552037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.552108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.552181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.552256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.552332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.552406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.552479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.552552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.552631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.552710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.552790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.552875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.552950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.553025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.553098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.553171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.553248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.553324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.553397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.553469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.553544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.553615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.553687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.553759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.553834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.553908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.553978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.554052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.554123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.554194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.554266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.554337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.554409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.554479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.554551] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.554683] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.554687] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7250, lrc_seqno=7250, guc_id=0, flags=0x73 in no process [-1] <7> [252.554689] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.554748] ------------[ cut here ]------------ <4> [252.554749] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.554750] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:56/2675 <4> [252.554821] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.554884] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.554888] CPU: 6 UID: 0 PID: 2675 Comm: kworker/u64:56 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.554891] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.554892] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.554893] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.554898] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.554967] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.554969] RSP: 0018:ffffc90004847ca0 EFLAGS: 00010246 <4> [252.554971] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.554972] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.554973] RBP: ffffc90004847db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.554975] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.554976] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.554977] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [252.554979] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.554980] CR2: 00007f3a1c001098 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [252.554981] PKRU: 55555554 <4> [252.554982] Call Trace: <4> [252.554983] <TASK> <4> [252.554987] ? lock_acquire+0x40/0x2f0 <4> [252.554992] ? lock_release+0xd0/0x2b0 <4> [252.554997] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.555002] process_one_work+0x22e/0x740 <4> [252.555008] worker_thread+0x1e8/0x3d0 <4> [252.555010] ? __pfx_worker_thread+0x10/0x10 <4> [252.555012] kthread+0x10d/0x150 <4> [252.555015] ? __pfx_kthread+0x10/0x10 <4> [252.555018] ret_from_fork+0x3d4/0x480 <4> [252.555020] ? __pfx_kthread+0x10/0x10 <4> [252.555023] ret_from_fork_asm+0x1a/0x30 <4> [252.555030] </TASK> <4> [252.555031] irq event stamp: 592673 <4> [252.555032] hardirqs last enabled at (592679): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.555034] hardirqs last disabled at (592684): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.555036] softirqs last enabled at (591532): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.555039] softirqs last disabled at (591523): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.555040] ---[ end trace 0000000000000000 ]--- <5> [252.555586] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7263, lrc_seqno=7263, guc_id=0, flags=0x73 in no process [-1] <7> [252.555591] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.555693] ------------[ cut here ]------------ <4> [252.555694] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.555695] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:49/2668 <4> [252.555767] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.555839] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.555845] CPU: 8 UID: 0 PID: 2668 Comm: kworker/u64:49 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.555848] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.555849] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.555851] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.555857] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.555937] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.555939] RSP: 0018:ffffc90004827ca0 EFLAGS: 00010246 <4> [252.555941] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.555943] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.555944] RBP: ffffc90004827db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.555945] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.555946] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.555947] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [252.555948] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.555950] CR2: 0000744f00093428 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [252.555951] PKRU: 55555554 <4> [252.555952] Call Trace: <4> [252.555953] <TASK> <4> [252.555957] ? lock_acquire+0x40/0x2f0 <4> [252.555963] ? lock_release+0xd0/0x2b0 <4> [252.555968] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.555973] process_one_work+0x22e/0x740 <4> [252.555979] worker_thread+0x1e8/0x3d0 <4> [252.555981] ? __pfx_worker_thread+0x10/0x10 <4> [252.555983] kthread+0x10d/0x150 <4> [252.555986] ? __pfx_kthread+0x10/0x10 <4> [252.555989] ret_from_fork+0x3d4/0x480 <4> [252.555991] ? __pfx_kthread+0x10/0x10 <4> [252.555994] ret_from_fork_asm+0x1a/0x30 <4> [252.556002] </TASK> <4> [252.556003] irq event stamp: 297241 <4> [252.556004] hardirqs last enabled at (297247): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.556007] hardirqs last disabled at (297252): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.556009] softirqs last enabled at (294894): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.556012] softirqs last disabled at (294889): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.556014] ---[ end trace 0000000000000000 ]--- <6> [252.556016] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.556085] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.556100] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.556309] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.556413] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.556516] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.556720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.556802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.556898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.556977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.557053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.557128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.557203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.557276] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.557364] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.557471] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.558473] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.568837] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.569080] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.570339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.570413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.570482] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.570553] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.570622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.570689] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.570755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.570823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.570908] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.570975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.571042] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.571109] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.571176] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.571245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.571311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.571379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.571446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.571512] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.571578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.571653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.571726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.571799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.571882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.571949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.572017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.572084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.572151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.572220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.572290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.572359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.572428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.572495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.572568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.572641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.572714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.572786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.572864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.572932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.572998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.573064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.573132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.573200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.573268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.573334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.573404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.573470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.573537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.573602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.573667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.573732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.573797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.573915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.573983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.574050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.574116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.574184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.574249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.574313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.574380] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.574503] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.574507] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7263, lrc_seqno=7263, guc_id=0, flags=0x73 in no process [-1] <7> [252.574509] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.574566] ------------[ cut here ]------------ <4> [252.574567] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.574568] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:49/2668 <4> [252.574633] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.574691] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.574695] CPU: 8 UID: 0 PID: 2668 Comm: kworker/u64:49 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.574698] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.574699] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.574700] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.574704] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.574768] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.574769] RSP: 0018:ffffc90004827ca0 EFLAGS: 00010246 <4> [252.574771] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.574772] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.574774] RBP: ffffc90004827db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.574775] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.574776] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.574777] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [252.574778] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.574780] CR2: 0000744f00093428 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [252.574781] PKRU: 55555554 <4> [252.574782] Call Trace: <4> [252.574783] <TASK> <4> [252.574787] ? lock_acquire+0x40/0x2f0 <4> [252.574792] ? lock_release+0xd0/0x2b0 <4> [252.574796] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.574802] process_one_work+0x22e/0x740 <4> [252.574807] worker_thread+0x1e8/0x3d0 <4> [252.574810] ? __pfx_worker_thread+0x10/0x10 <4> [252.574812] kthread+0x10d/0x150 <4> [252.574814] ? __pfx_kthread+0x10/0x10 <4> [252.574817] ret_from_fork+0x3d4/0x480 <4> [252.574819] ? __pfx_kthread+0x10/0x10 <4> [252.574822] ret_from_fork_asm+0x1a/0x30 <4> [252.574835] </TASK> <4> [252.574837] irq event stamp: 300631 <4> [252.574838] hardirqs last enabled at (300637): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.574842] hardirqs last disabled at (300642): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.574845] softirqs last enabled at (299702): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.574847] softirqs last disabled at (299507): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.574849] ---[ end trace 0000000000000000 ]--- <6> [252.574851] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.574917] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.574922] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.576199] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.576294] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.576391] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.576600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.576686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.576775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.576861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.576942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.577020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.577098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.577176] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.577270] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.577385] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.578390] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.588834] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.589079] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.590180] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.590257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.590330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.590406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.590478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.590550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.590623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.590694] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.590765] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.590854] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.590926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.590998] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.591069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.591139] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.591209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.591279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.591349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.591418] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.591488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.591568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.591646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.591721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.591796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.591877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.591950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.592022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.592094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.592168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.592243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.592316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.592389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.592463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.592542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.592622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.592701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.592778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.592860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.592933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.593007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.593077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.593153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.593225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.593297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.593368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.593443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.593517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.593590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.593664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.593737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.593810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.593891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.593966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.594038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.594110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.594182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.594255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.594327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.594399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.594474] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.594605] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.594609] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7263, lrc_seqno=7263, guc_id=0, flags=0x73 in no process [-1] <7> [252.594611] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.594669] ------------[ cut here ]------------ <4> [252.594670] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.594671] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:56/2675 <4> [252.594742] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.594800] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.594804] CPU: 6 UID: 0 PID: 2675 Comm: kworker/u64:56 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.594807] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.594808] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.594809] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.594814] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.594894] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.594896] RSP: 0018:ffffc90004847ca0 EFLAGS: 00010246 <4> [252.594898] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.594900] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.594901] RBP: ffffc90004847db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.594902] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.594903] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.594905] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [252.594906] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.594908] CR2: 00007f3a1c001098 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [252.594909] PKRU: 55555554 <4> [252.594911] Call Trace: <4> [252.594912] <TASK> <4> [252.594915] ? lock_acquire+0x40/0x2f0 <4> [252.594921] ? lock_release+0xd0/0x2b0 <4> [252.594926] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.594931] process_one_work+0x22e/0x740 <4> [252.594937] worker_thread+0x1e8/0x3d0 <4> [252.594939] ? __pfx_worker_thread+0x10/0x10 <4> [252.594942] kthread+0x10d/0x150 <4> [252.594944] ? __pfx_kthread+0x10/0x10 <4> [252.594948] ret_from_fork+0x3d4/0x480 <4> [252.594950] ? __pfx_kthread+0x10/0x10 <4> [252.594953] ret_from_fork_asm+0x1a/0x30 <4> [252.594960] </TASK> <4> [252.594961] irq event stamp: 597599 <4> [252.594962] hardirqs last enabled at (597605): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.594964] hardirqs last disabled at (597610): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.594966] softirqs last enabled at (596464): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.594969] softirqs last disabled at (596457): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.594971] ---[ end trace 0000000000000000 ]--- <5> [252.595626] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7267, lrc_seqno=7267, guc_id=0, flags=0x73 in no process [-1] <7> [252.595631] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.595720] ------------[ cut here ]------------ <4> [252.595722] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.595723] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:49/2668 <4> [252.595791] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.595866] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.595871] CPU: 8 UID: 0 PID: 2668 Comm: kworker/u64:49 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.595875] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.595876] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.595877] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.595885] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.595962] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.595964] RSP: 0018:ffffc90004827ca0 EFLAGS: 00010246 <4> [252.595965] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.595967] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.595968] RBP: ffffc90004827db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.595969] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.595970] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.595971] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [252.595973] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.595974] CR2: 0000744f00093428 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [252.595975] PKRU: 55555554 <4> [252.595977] Call Trace: <4> [252.595978] <TASK> <4> [252.595983] ? lock_acquire+0x40/0x2f0 <4> [252.595990] ? lock_release+0xd0/0x2b0 <4> [252.595995] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.596000] process_one_work+0x22e/0x740 <4> [252.596006] worker_thread+0x1e8/0x3d0 <4> [252.596008] ? __pfx_worker_thread+0x10/0x10 <4> [252.596010] kthread+0x10d/0x150 <4> [252.596012] ? __pfx_kthread+0x10/0x10 <4> [252.596016] ret_from_fork+0x3d4/0x480 <4> [252.596017] ? __pfx_kthread+0x10/0x10 <4> [252.596020] ret_from_fork_asm+0x1a/0x30 <4> [252.596027] </TASK> <4> [252.596028] irq event stamp: 301745 <4> [252.596029] hardirqs last enabled at (301751): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.596031] hardirqs last disabled at (301756): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.596033] softirqs last enabled at (299702): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.596035] softirqs last disabled at (299507): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.596037] ---[ end trace 0000000000000000 ]--- <6> [252.596039] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.596103] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.596114] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.596093] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.596196] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.596297] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.596499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.596582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.596668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.596750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.596833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.596909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.596984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.597058] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.597145] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.597254] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.598256] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.608837] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.609081] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.610094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.610169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.610238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.610307] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.610376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.610443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.610510] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.610577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.610644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.610712] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.610780] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.610857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.610925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.610992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.611058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.611123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.611188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.611254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.611321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.611396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.611471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.611544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.611616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.611685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.611751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.611816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.611895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.611963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.612034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.612100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.612167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.612234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.612309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.612382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.612456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.612524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.612591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.612658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.612725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.612790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.612868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.612935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.613004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.613071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.613142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.613207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.613273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.613340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.613411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.613477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.613543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.613613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.613680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.613749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.613815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.613894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.613960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.614027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.614095] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.614219] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.614223] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7267, lrc_seqno=7267, guc_id=0, flags=0x73 in no process [-1] <7> [252.614225] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.614281] ------------[ cut here ]------------ <4> [252.614282] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.614283] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:49/2668 <4> [252.614349] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.614406] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.614410] CPU: 8 UID: 0 PID: 2668 Comm: kworker/u64:49 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.614413] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.614414] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.614415] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.614420] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.614483] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.614485] RSP: 0018:ffffc90004827ca0 EFLAGS: 00010246 <4> [252.614487] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.614488] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.614489] RBP: ffffc90004827db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.614490] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.614491] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.614492] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [252.614494] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.614495] CR2: 0000744f00093428 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [252.614496] PKRU: 55555554 <4> [252.614497] Call Trace: <4> [252.614498] <TASK> <4> [252.614502] ? lock_acquire+0x40/0x2f0 <4> [252.614507] ? lock_release+0xd0/0x2b0 <4> [252.614512] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.614517] process_one_work+0x22e/0x740 <4> [252.614523] worker_thread+0x1e8/0x3d0 <4> [252.614525] ? __pfx_worker_thread+0x10/0x10 <4> [252.614527] kthread+0x10d/0x150 <4> [252.614530] ? __pfx_kthread+0x10/0x10 <4> [252.614533] ret_from_fork+0x3d4/0x480 <4> [252.614535] ? __pfx_kthread+0x10/0x10 <4> [252.614538] ret_from_fork_asm+0x1a/0x30 <4> [252.614545] </TASK> <4> [252.614545] irq event stamp: 304957 <4> [252.614547] hardirqs last enabled at (304963): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.614549] hardirqs last disabled at (304968): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.614551] softirqs last enabled at (303842): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.614553] softirqs last disabled at (303835): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.614555] ---[ end trace 0000000000000000 ]--- <6> [252.614556] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.614620] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.614625] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.615640] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.615735] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.615836] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.616046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.616131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.616219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.616302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.616387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.616468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.616549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.616625] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.616717] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.616832] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.617836] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.627836] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.628084] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.629084] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.629162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.629235] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.629308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.629380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.629451] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.629522] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.629594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.629667] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.629737] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.629806] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.629885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.629955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.630026] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.630095] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.630164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.630234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.630302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.630371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.630449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.630525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.630598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.630675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.630749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.630821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.630908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.630982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.631055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.631130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.631203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.631274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.631347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.631425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.631502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.631579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.631654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.631727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.631799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.631878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.631950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.632024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.632097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.632172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.632243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.632317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.632388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.632460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.632532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.632605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.632675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.632746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.632819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.632903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.632977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.633049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.633122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.633193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.633264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.633338] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.633464] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.633468] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7267, lrc_seqno=7267, guc_id=0, flags=0x73 in no process [-1] <7> [252.633470] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.633528] ------------[ cut here ]------------ <4> [252.633529] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.633530] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:56/2675 <4> [252.633603] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.633660] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.633664] CPU: 6 UID: 0 PID: 2675 Comm: kworker/u64:56 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.633667] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.633668] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.633669] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.633674] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.633745] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.633746] RSP: 0018:ffffc90004847ca0 EFLAGS: 00010246 <4> [252.633748] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.633750] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.633751] RBP: ffffc90004847db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.633752] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.633753] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.633754] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [252.633756] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.633757] CR2: 00007f3a1c001098 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [252.633758] PKRU: 55555554 <4> [252.633759] Call Trace: <4> [252.633760] <TASK> <4> [252.633764] ? lock_acquire+0x40/0x2f0 <4> [252.633769] ? lock_release+0xd0/0x2b0 <4> [252.633774] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.633780] process_one_work+0x22e/0x740 <4> [252.633785] worker_thread+0x1e8/0x3d0 <4> [252.633788] ? __pfx_worker_thread+0x10/0x10 <4> [252.633790] kthread+0x10d/0x150 <4> [252.633792] ? __pfx_kthread+0x10/0x10 <4> [252.633796] ret_from_fork+0x3d4/0x480 <4> [252.633797] ? __pfx_kthread+0x10/0x10 <4> [252.633800] ret_from_fork_asm+0x1a/0x30 <4> [252.633807] </TASK> <4> [252.633808] irq event stamp: 601221 <4> [252.633809] hardirqs last enabled at (601227): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.633812] hardirqs last disabled at (601232): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.633814] softirqs last enabled at (600100): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.633816] softirqs last disabled at (600095): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.633818] ---[ end trace 0000000000000000 ]--- <5> [252.634374] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7274, lrc_seqno=7274, guc_id=0, flags=0x73 in no process [-1] <7> [252.634382] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.634484] ------------[ cut here ]------------ <4> [252.634485] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.634487] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:25/2644 <4> [252.634557] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.634625] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.634630] CPU: 9 UID: 0 PID: 2644 Comm: kworker/u64:25 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.634633] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.634634] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.634637] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.634644] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.634719] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.634720] RSP: 0018:ffffc90004767ca0 EFLAGS: 00010246 <4> [252.634722] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.634724] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.634725] RBP: ffffc90004767db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.634726] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.634727] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.634729] FS: 0000000000000000(0000) GS:ffff8888db11b000(0000) knlGS:0000000000000000 <4> [252.634730] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.634731] CR2: 00007f3a51545c60 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [252.634733] PKRU: 55555554 <4> [252.634734] Call Trace: <4> [252.634735] <TASK> <4> [252.634739] ? lock_acquire+0x40/0x2f0 <4> [252.634746] ? lock_release+0xd0/0x2b0 <4> [252.634751] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.634756] process_one_work+0x22e/0x740 <4> [252.634762] worker_thread+0x1e8/0x3d0 <4> [252.634764] ? __pfx_worker_thread+0x10/0x10 <4> [252.634767] kthread+0x10d/0x150 <4> [252.634770] ? __pfx_kthread+0x10/0x10 <4> [252.634773] ret_from_fork+0x3d4/0x480 <4> [252.634775] ? __pfx_kthread+0x10/0x10 <4> [252.634778] ret_from_fork_asm+0x1a/0x30 <4> [252.634785] </TASK> <4> [252.634786] irq event stamp: 1585903 <4> [252.634787] hardirqs last enabled at (1585909): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.634789] hardirqs last disabled at (1585914): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.634791] softirqs last enabled at (1584448): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.634794] softirqs last disabled at (1584443): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.634796] ---[ end trace 0000000000000000 ]--- <6> [252.634798] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.634883] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.634889] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.634952] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.635057] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.635160] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.635367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.635452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.635540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.635622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.635704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.635785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.635879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.635956] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.636050] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.636164] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.637171] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.647835] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.648082] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.649071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.649149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.649221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.649295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.649368] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.649440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.649513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.649584] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.649657] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.649727] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.649798] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.649879] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.649952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.650023] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.650093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.650163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.650233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.650304] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.650373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.650452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.650531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.650605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.650680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.650752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.650822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.650907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.650979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.651053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.651130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.651204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.651279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.651353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.651433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.651511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.651589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.651664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.651738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.651811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.651892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.651963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.652036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.652109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.652181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.652253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.652330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.652402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.652476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.652549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.652624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.652695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.652765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.652843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.652917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.652988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.653057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.653128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.653198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.653269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.653344] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.653474] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.653478] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7274, lrc_seqno=7274, guc_id=0, flags=0x73 in no process [-1] <7> [252.653480] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.653539] ------------[ cut here ]------------ <4> [252.653540] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.653541] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:56/2675 <4> [252.653612] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.653670] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.653674] CPU: 6 UID: 0 PID: 2675 Comm: kworker/u64:56 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.653676] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.653677] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.653678] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.653683] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.653751] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.653753] RSP: 0018:ffffc90004847ca0 EFLAGS: 00010246 <4> [252.653755] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.653756] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.653757] RBP: ffffc90004847db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.653758] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.653760] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.653761] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [252.653762] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.653764] CR2: 00007f3a1c001098 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [252.653765] PKRU: 55555554 <4> [252.653766] Call Trace: <4> [252.653767] <TASK> <4> [252.653771] ? lock_acquire+0x40/0x2f0 <4> [252.653776] ? lock_release+0xd0/0x2b0 <4> [252.653780] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.653786] process_one_work+0x22e/0x740 <4> [252.653791] worker_thread+0x1e8/0x3d0 <4> [252.653794] ? __pfx_worker_thread+0x10/0x10 <4> [252.653796] kthread+0x10d/0x150 <4> [252.653799] ? __pfx_kthread+0x10/0x10 <4> [252.653802] ret_from_fork+0x3d4/0x480 <4> [252.653804] ? __pfx_kthread+0x10/0x10 <4> [252.653807] ret_from_fork_asm+0x1a/0x30 <4> [252.653814] </TASK> <4> [252.653815] irq event stamp: 604661 <4> [252.653816] hardirqs last enabled at (604667): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.653818] hardirqs last disabled at (604672): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.653820] softirqs last enabled at (603436): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.653822] softirqs last disabled at (603427): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.653824] ---[ end trace 0000000000000000 ]--- <6> [252.653826] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.653908] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.653914] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.655151] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.655252] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.655354] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.655565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.655652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.655739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.655820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.655915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.655992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.656068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.656141] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.656231] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.656338] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.657341] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.667835] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.668079] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.669038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.669114] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.669186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.669257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.669327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.669397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.669465] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.669533] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.669601] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.669668] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.669734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.669799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.669876] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.669942] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.670007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.670072] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.670139] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.670206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.670270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.670344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.670416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.670486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.670556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.670624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.670702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.670804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.670923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.671027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.671129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.671231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.671334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.671438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.671546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.671655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.671748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.671822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.671907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.671977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.672045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.672111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.672182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.672249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.672315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.672380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.672450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.672515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.672582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.672646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.672712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.672776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.672845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.672914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.672979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.673045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.673109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.673174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.673236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.673299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.673364] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.673486] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.673490] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7274, lrc_seqno=7274, guc_id=0, flags=0x73 in no process [-1] <7> [252.673493] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.673548] ------------[ cut here ]------------ <4> [252.673549] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.673550] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:10/211 <4> [252.673616] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.673676] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.673680] CPU: 10 UID: 0 PID: 211 Comm: kworker/u64:10 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.673683] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.673684] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.673686] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.673690] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.673754] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.673756] RSP: 0018:ffffc90001657ca0 EFLAGS: 00010246 <4> [252.673758] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.673759] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.673761] RBP: ffffc90001657db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.673762] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.673763] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.673764] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [252.673766] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.673767] CR2: 0000744f0c339000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [252.673768] PKRU: 55555554 <4> [252.673769] Call Trace: <4> [252.673770] <TASK> <4> [252.673774] ? lock_acquire+0x40/0x2f0 <4> [252.673779] ? lock_release+0xd0/0x2b0 <4> [252.673784] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.673790] process_one_work+0x22e/0x740 <4> [252.673795] worker_thread+0x1e8/0x3d0 <4> [252.673798] ? __pfx_worker_thread+0x10/0x10 <4> [252.673800] kthread+0x10d/0x150 <4> [252.673802] ? __pfx_kthread+0x10/0x10 <4> [252.673806] ret_from_fork+0x3d4/0x480 <4> [252.673807] ? __pfx_kthread+0x10/0x10 <4> [252.673811] ret_from_fork_asm+0x1a/0x30 <4> [252.673818] </TASK> <4> [252.673819] irq event stamp: 822913 <4> [252.673820] hardirqs last enabled at (822919): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.673822] hardirqs last disabled at (822924): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.673824] softirqs last enabled at (821798): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.673830] softirqs last disabled at (821791): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.673832] ---[ end trace 0000000000000000 ]--- <5> [252.674212] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7278, lrc_seqno=7278, guc_id=0, flags=0x73 in no process [-1] <7> [252.674216] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.674381] ------------[ cut here ]------------ <4> [252.674382] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.674383] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:56/2675 <4> [252.674454] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.674517] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.674522] CPU: 6 UID: 0 PID: 2675 Comm: kworker/u64:56 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.674524] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.674525] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.674527] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.674534] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.674605] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.674607] RSP: 0018:ffffc90004847ca0 EFLAGS: 00010246 <4> [252.674609] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.674610] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.674611] RBP: ffffc90004847db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.674612] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.674614] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.674615] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [252.674616] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.674617] CR2: 00007f3a1c001098 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [252.674619] PKRU: 55555554 <4> [252.674620] Call Trace: <4> [252.674621] <TASK> <4> [252.674625] ? lock_acquire+0x40/0x2f0 <4> [252.674631] ? lock_release+0xd0/0x2b0 <4> [252.674635] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.674641] process_one_work+0x22e/0x740 <4> [252.674647] worker_thread+0x1e8/0x3d0 <4> [252.674650] ? __pfx_worker_thread+0x10/0x10 <4> [252.674652] kthread+0x10d/0x150 <4> [252.674655] ? __pfx_kthread+0x10/0x10 <4> [252.674658] ret_from_fork+0x3d4/0x480 <4> [252.674660] ? __pfx_kthread+0x10/0x10 <4> [252.674663] ret_from_fork_asm+0x1a/0x30 <4> [252.674670] </TASK> <4> [252.674671] irq event stamp: 605775 <4> [252.674673] hardirqs last enabled at (605781): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.674676] hardirqs last disabled at (605786): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.674678] softirqs last enabled at (603436): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.674681] softirqs last disabled at (603427): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.674683] ---[ end trace 0000000000000000 ]--- <6> [252.674685] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.674757] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.674772] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.674983] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.675080] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.675177] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.675385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.675472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.675559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.675641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.675723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.675803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.675893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.675974] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.676066] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.676179] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.677183] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.687835] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.688083] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.689073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.689151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.689227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.689302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.689376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.689449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.689521] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.689593] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.689666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.689738] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.689810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.689892] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.689965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.690036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.690107] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.690178] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.690247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.690317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.690389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.690467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.690545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.690620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.690698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.690773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.690849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.690923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.690996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.691070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.691144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.691217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.691291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.691365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.691442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.691521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.691599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.691673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.691746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.691819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.691904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.691975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.692049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.692121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.692194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.692266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.692341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.692411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.692482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.692551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.692621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.692690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.692760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.692836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.692909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.692981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.693052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.693123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.693193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.693264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.693338] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.693467] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.693470] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7278, lrc_seqno=7278, guc_id=0, flags=0x73 in no process [-1] <7> [252.693472] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.693531] ------------[ cut here ]------------ <4> [252.693532] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.693533] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:56/2675 <4> [252.693605] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.693662] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.693666] CPU: 6 UID: 0 PID: 2675 Comm: kworker/u64:56 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.693669] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.693670] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.693671] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.693676] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.693745] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.693746] RSP: 0018:ffffc90004847ca0 EFLAGS: 00010246 <4> [252.693748] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.693750] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.693751] RBP: ffffc90004847db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.693752] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.693753] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.693754] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [252.693756] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.693757] CR2: 00007f3a1c001098 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [252.693759] PKRU: 55555554 <4> [252.693760] Call Trace: <4> [252.693760] <TASK> <4> [252.693764] ? lock_acquire+0x40/0x2f0 <4> [252.693769] ? lock_release+0xd0/0x2b0 <4> [252.693774] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.693779] process_one_work+0x22e/0x740 <4> [252.693785] worker_thread+0x1e8/0x3d0 <4> [252.693787] ? __pfx_worker_thread+0x10/0x10 <4> [252.693789] kthread+0x10d/0x150 <4> [252.693792] ? __pfx_kthread+0x10/0x10 <4> [252.693795] ret_from_fork+0x3d4/0x480 <4> [252.693797] ? __pfx_kthread+0x10/0x10 <4> [252.693800] ret_from_fork_asm+0x1a/0x30 <4> [252.693807] </TASK> <4> [252.693808] irq event stamp: 608975 <4> [252.693809] hardirqs last enabled at (608981): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.693811] hardirqs last disabled at (608986): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.693813] softirqs last enabled at (607750): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.693815] softirqs last disabled at (607745): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.693817] ---[ end trace 0000000000000000 ]--- <6> [252.693819] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.693903] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.693909] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.695143] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.695250] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.695361] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.695573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.695660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.695751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.695837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.695916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.695992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.696067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.696141] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.696232] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.696341] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.697343] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.707842] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.708087] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.709098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.709170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.709239] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.709308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.709377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.709446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.709513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.709580] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.709649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.709714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.709783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.709857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.709926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.709995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.710066] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.710134] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.710202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.710271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.710339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.710416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.710488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.710559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.710631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.710702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.710769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.710841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.710908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.710980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.711053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.711123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.711191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.711260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.711334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.711409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.711484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.711555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.711625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.711693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.711760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.711826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.711910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.711977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.712044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.712109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.712180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.712247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.712314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.712384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.712453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.712520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.712586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.712655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.712723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.712789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.712863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.712933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.712997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.713062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.713130] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.713257] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.713261] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7278, lrc_seqno=7278, guc_id=0, flags=0x73 in no process [-1] <7> [252.713263] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.713320] ------------[ cut here ]------------ <4> [252.713321] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.713322] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:49/2668 <4> [252.713389] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.713448] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.713452] CPU: 2 UID: 0 PID: 2668 Comm: kworker/u64:49 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.713455] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.713456] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.713458] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.713463] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.713527] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.713529] RSP: 0018:ffffc90004827ca0 EFLAGS: 00010246 <4> [252.713531] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.713532] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.713533] RBP: ffffc90004827db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.713534] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.713536] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.713537] FS: 0000000000000000(0000) GS:ffff8888dad9b000(0000) knlGS:0000000000000000 <4> [252.713538] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.713539] CR2: 00007f3a4ec227fd CR3: 000000011de45006 CR4: 0000000000f72ef0 <4> [252.713541] PKRU: 55555554 <4> [252.713542] Call Trace: <4> [252.713543] <TASK> <4> [252.713547] ? lock_acquire+0x40/0x2f0 <4> [252.713552] ? lock_release+0xd0/0x2b0 <4> [252.713557] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.713562] process_one_work+0x22e/0x740 <4> [252.713568] worker_thread+0x1e8/0x3d0 <4> [252.713570] ? __pfx_worker_thread+0x10/0x10 <4> [252.713572] kthread+0x10d/0x150 <4> [252.713575] ? __pfx_kthread+0x10/0x10 <4> [252.713578] ret_from_fork+0x3d4/0x480 <4> [252.713580] ? __pfx_kthread+0x10/0x10 <4> [252.713583] ret_from_fork_asm+0x1a/0x30 <4> [252.713590] </TASK> <4> [252.713591] irq event stamp: 308993 <4> [252.713592] hardirqs last enabled at (308999): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.713594] hardirqs last disabled at (309004): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.713596] softirqs last enabled at (307872): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.713599] softirqs last disabled at (307865): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.713601] ---[ end trace 0000000000000000 ]--- <5> [252.714656] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7286, lrc_seqno=7286, guc_id=0, flags=0x73 in no process [-1] <7> [252.714659] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.714717] ------------[ cut here ]------------ <4> [252.714718] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.714725] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:10/211 <7> [252.714739] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [252.714792] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.714857] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.714861] CPU: 10 UID: 0 PID: 211 Comm: kworker/u64:10 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.714864] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.714865] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.714867] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [252.714839] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [252.714871] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.714936] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.714937] RSP: 0018:ffffc90001657ca0 EFLAGS: 00010246 <4> [252.714939] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.714940] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.714941] RBP: ffffc90001657db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.714942] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.714943] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.714945] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [252.714946] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.714947] CR2: 0000744f0c339000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [252.714949] PKRU: 55555554 <4> [252.714950] Call Trace: <4> [252.714951] <TASK> <4> [252.714954] ? lock_acquire+0x40/0x2f0 <4> [252.714959] ? lock_release+0xd0/0x2b0 <4> [252.714964] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.714969] process_one_work+0x22e/0x740 <4> [252.714975] worker_thread+0x1e8/0x3d0 <4> [252.714977] ? __pfx_worker_thread+0x10/0x10 <4> [252.714979] kthread+0x10d/0x150 <4> [252.714982] ? __pfx_kthread+0x10/0x10 <4> [252.714985] ret_from_fork+0x3d4/0x480 <4> [252.714987] ? __pfx_kthread+0x10/0x10 <4> [252.714990] ret_from_fork_asm+0x1a/0x30 <4> [252.714997] </TASK> <4> [252.714998] irq event stamp: 824019 <4> [252.714999] hardirqs last enabled at (824025): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.715001] hardirqs last disabled at (824030): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.715003] softirqs last enabled at (823580): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.715005] softirqs last disabled at (823571): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.715007] ---[ end trace 0000000000000000 ]--- <6> [252.715009] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.715074] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.715079] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.715615] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.715820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.715918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.716005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.716085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.716168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.716247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.716326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.716399] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.716488] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.716598] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.717600] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.727835] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.728079] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.729081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.729154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.729224] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.729296] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.729366] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.729435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.729504] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.729573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.729643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.729710] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.729777] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.729847] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.729917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.729985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.730054] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.730121] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.730186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.730251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.730318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.730392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.730465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.730536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.730607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.730676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.730745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.730813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.730898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.730968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.731038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.731109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.731180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.731248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.731321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.731393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.731466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.731535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.731601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.731667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.731734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.731799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.731876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.731943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.732008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.732075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.732145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.732209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.732274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.732338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.732406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.732470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.732537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.732605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.732671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.732736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.732802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.732879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.732945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.733011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.733080] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.733204] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.733208] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7286, lrc_seqno=7286, guc_id=0, flags=0x73 in no process [-1] <7> [252.733210] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.733266] ------------[ cut here ]------------ <4> [252.733267] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.733268] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:56/2675 <4> [252.733334] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.733393] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.733397] CPU: 8 UID: 0 PID: 2675 Comm: kworker/u64:56 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.733400] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.733401] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.733402] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.733407] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.733471] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.733472] RSP: 0018:ffffc90004847ca0 EFLAGS: 00010246 <4> [252.733474] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.733476] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.733477] RBP: ffffc90004847db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.733478] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.733479] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.733480] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [252.733482] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.733483] CR2: 0000744f00093428 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [252.733484] PKRU: 55555554 <4> [252.733485] Call Trace: <4> [252.733486] <TASK> <4> [252.733490] ? lock_acquire+0x40/0x2f0 <4> [252.733495] ? lock_release+0xd0/0x2b0 <4> [252.733500] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.733505] process_one_work+0x22e/0x740 <4> [252.733511] worker_thread+0x1e8/0x3d0 <4> [252.733513] ? __pfx_worker_thread+0x10/0x10 <4> [252.733515] kthread+0x10d/0x150 <4> [252.733518] ? __pfx_kthread+0x10/0x10 <4> [252.733521] ret_from_fork+0x3d4/0x480 <4> [252.733523] ? __pfx_kthread+0x10/0x10 <4> [252.733526] ret_from_fork_asm+0x1a/0x30 <4> [252.733533] </TASK> <4> [252.733534] irq event stamp: 612555 <4> [252.733535] hardirqs last enabled at (612561): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.733537] hardirqs last disabled at (612566): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.733539] softirqs last enabled at (611552): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.733541] softirqs last disabled at (611545): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.733543] ---[ end trace 0000000000000000 ]--- <6> [252.733545] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.733609] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.733615] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.734636] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.734732] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.734833] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.735048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.735136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.735222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.735302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.735378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.735453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.735530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.735603] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.735692] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.735802] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.736813] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.746837] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.747083] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.748358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.748437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.748509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.748580] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.748651] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.748721] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.748789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.748867] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.748937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.749004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.749071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.749138] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.749206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.749273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.749340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.749406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.749472] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.749538] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.749603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.749680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.749755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.749833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.749913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.749983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.750052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.750122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.750190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.750261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.750331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.750400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.750467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.750535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.750608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.750683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.750757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.750831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.750903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.750970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.751038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.751104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.751174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.751242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.751309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.751378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.751449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.751517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.751583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.751648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.751715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.751781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.751862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.751932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.752000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.752069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.752134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.752202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.752268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.752331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.752398] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.752520] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.752524] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7286, lrc_seqno=7286, guc_id=0, flags=0x73 in no process [-1] <7> [252.752527] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.752582] ------------[ cut here ]------------ <4> [252.752583] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.752585] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:2/121 <4> [252.752653] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.752712] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.752716] CPU: 4 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.752719] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.752720] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.752721] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.752726] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.752790] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.752792] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [252.752794] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.752795] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.752797] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.752798] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.752799] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.752800] FS: 0000000000000000(0000) GS:ffff8888dae9b000(0000) knlGS:0000000000000000 <4> [252.752802] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.752803] CR2: 0000744f0c33a000 CR3: 000000011c098006 CR4: 0000000000f72ef0 <4> [252.752804] PKRU: 55555554 <4> [252.752805] Call Trace: <4> [252.752806] <TASK> <4> [252.752810] ? lock_acquire+0x40/0x2f0 <4> [252.752815] ? lock_release+0xd0/0x2b0 <4> [252.752820] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.752826] process_one_work+0x22e/0x740 <4> [252.752835] worker_thread+0x1e8/0x3d0 <4> [252.752837] ? __pfx_worker_thread+0x10/0x10 <4> [252.752839] kthread+0x10d/0x150 <4> [252.752842] ? __pfx_kthread+0x10/0x10 <4> [252.752846] ret_from_fork+0x3d4/0x480 <4> [252.752847] ? __pfx_kthread+0x10/0x10 <4> [252.752851] ret_from_fork_asm+0x1a/0x30 <4> [252.752858] </TASK> <4> [252.752859] irq event stamp: 1775455 <4> [252.752860] hardirqs last enabled at (1775461): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.752862] hardirqs last disabled at (1775466): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.752864] softirqs last enabled at (1774520): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.752866] softirqs last disabled at (1774467): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.752868] ---[ end trace 0000000000000000 ]--- <5> [252.753604] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7290, lrc_seqno=7290, guc_id=0, flags=0x73 in no process [-1] <7> [252.753610] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.753699] ------------[ cut here ]------------ <4> [252.753700] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.753702] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:49/2668 <4> [252.753772] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.753845] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.753853] CPU: 2 UID: 0 PID: 2668 Comm: kworker/u64:49 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.753857] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.753859] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.753860] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.753867] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.753946] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.753948] RSP: 0018:ffffc90004827ca0 EFLAGS: 00010246 <4> [252.753950] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.753951] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.753952] RBP: ffffc90004827db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.753953] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.753954] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.753956] FS: 0000000000000000(0000) GS:ffff8888dad9b000(0000) knlGS:0000000000000000 <4> [252.753957] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.753958] CR2: 00007f3a4ec227fd CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [252.753960] PKRU: 55555554 <4> [252.753961] Call Trace: <4> [252.753962] <TASK> <4> [252.753965] ? lock_acquire+0x40/0x2f0 <4> [252.753971] ? lock_release+0xd0/0x2b0 <4> [252.753976] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.753981] process_one_work+0x22e/0x740 <4> [252.753987] worker_thread+0x1e8/0x3d0 <4> [252.753989] ? __pfx_worker_thread+0x10/0x10 <4> [252.753991] kthread+0x10d/0x150 <4> [252.753994] ? __pfx_kthread+0x10/0x10 <4> [252.753997] ret_from_fork+0x3d4/0x480 <4> [252.753999] ? __pfx_kthread+0x10/0x10 <4> [252.754002] ret_from_fork_asm+0x1a/0x30 <4> [252.754008] </TASK> <4> [252.754010] irq event stamp: 310311 <4> [252.754011] hardirqs last enabled at (310317): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.754013] hardirqs last disabled at (310322): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.754015] softirqs last enabled at (309990): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.754017] softirqs last disabled at (309985): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.754019] ---[ end trace 0000000000000000 ]--- <6> [252.754021] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.754089] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.754098] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.754058] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.754161] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.754430] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.754634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.754716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.754800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.754888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.754966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.755041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.755117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.755191] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.755278] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.755385] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.756387] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.766839] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.767104] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.768219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.768302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.768378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.768453] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.768526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.768600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.768672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.768744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.768816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.768901] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.768974] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.769045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.769116] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.769186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.769257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.769330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.769400] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.769471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.769542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.769622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.769701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.769777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.769860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.769934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.770007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.770079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.770151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.770229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.770304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.770377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.770451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.770523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.770601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.770679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.770758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.770836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.770910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.770983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.771056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.771126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.771198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.771273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.771346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.771416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.771489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.771560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.771632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.771702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.771772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.771845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.771915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.771987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.772059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.772130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.772202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.772272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.772343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.772412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.772485] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.772619] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.772623] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7290, lrc_seqno=7290, guc_id=0, flags=0x73 in no process [-1] <7> [252.772626] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.772685] ------------[ cut here ]------------ <4> [252.772686] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.772687] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:49/2668 <4> [252.772760] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.772820] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.772824] CPU: 2 UID: 0 PID: 2668 Comm: kworker/u64:49 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.772832] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.772833] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.772834] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.772839] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.772909] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.772911] RSP: 0018:ffffc90004827ca0 EFLAGS: 00010246 <4> [252.772913] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.772914] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.772915] RBP: ffffc90004827db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.772916] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.772917] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.772919] FS: 0000000000000000(0000) GS:ffff8888dad9b000(0000) knlGS:0000000000000000 <4> [252.772920] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.772921] CR2: 00007f3a4ec227fd CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [252.772923] PKRU: 55555554 <4> [252.772924] Call Trace: <4> [252.772925] <TASK> <4> [252.772929] ? lock_acquire+0x40/0x2f0 <4> [252.772934] ? lock_release+0xd0/0x2b0 <4> [252.772939] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.772944] process_one_work+0x22e/0x740 <4> [252.772950] worker_thread+0x1e8/0x3d0 <4> [252.772953] ? __pfx_worker_thread+0x10/0x10 <4> [252.772955] kthread+0x10d/0x150 <4> [252.772958] ? __pfx_kthread+0x10/0x10 <4> [252.772961] ret_from_fork+0x3d4/0x480 <4> [252.772963] ? __pfx_kthread+0x10/0x10 <4> [252.772966] ret_from_fork_asm+0x1a/0x30 <4> [252.772972] </TASK> <4> [252.772973] irq event stamp: 313531 <4> [252.772974] hardirqs last enabled at (313537): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.772977] hardirqs last disabled at (313542): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.772979] softirqs last enabled at (313344): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.772981] softirqs last disabled at (313339): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.772983] ---[ end trace 0000000000000000 ]--- <6> [252.772985] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.773051] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.773057] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.774295] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.774391] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.774487] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.774691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.774773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.774862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.774942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.775019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.775096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.775173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.775248] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.775336] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.775444] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.776470] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.787183] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.787427] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.788443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.788516] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.788585] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.788655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.788724] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.788792] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.788869] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.788936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.789004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.789072] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.789141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.789208] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.789274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.789340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.789408] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.789476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.789544] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.789611] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.789676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.789750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.789824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.789909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.789983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.790051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.790120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.790187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.790254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.790325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.790397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.790465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.790534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.790603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.790680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.790753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.790832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.790903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.790973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.791042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.791112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.791180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.791252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.791323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.791392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.791459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.791533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.791599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.791667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.791733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.791802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.791878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.791943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.792012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.792079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.792147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.792213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.792280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.792346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.792413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.792484] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.792609] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.792613] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7290, lrc_seqno=7290, guc_id=0, flags=0x73 in no process [-1] <7> [252.792615] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.792671] ------------[ cut here ]------------ <4> [252.792672] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.792673] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:10/211 <4> [252.792740] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.792799] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.792804] CPU: 10 UID: 0 PID: 211 Comm: kworker/u64:10 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.792806] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.792807] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.792809] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.792813] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.792892] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.792894] RSP: 0018:ffffc90001657ca0 EFLAGS: 00010246 <4> [252.792896] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.792898] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.792899] RBP: ffffc90001657db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.792900] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.792901] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.792903] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [252.792905] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.792906] CR2: 0000744f0c339000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [252.792907] PKRU: 55555554 <4> [252.792908] Call Trace: <4> [252.792909] <TASK> <4> [252.792913] ? lock_acquire+0x40/0x2f0 <4> [252.792918] ? lock_release+0xd0/0x2b0 <4> [252.792923] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.792928] process_one_work+0x22e/0x740 <4> [252.792934] worker_thread+0x1e8/0x3d0 <4> [252.792937] ? __pfx_worker_thread+0x10/0x10 <4> [252.792939] kthread+0x10d/0x150 <4> [252.792941] ? __pfx_kthread+0x10/0x10 <4> [252.792945] ret_from_fork+0x3d4/0x480 <4> [252.792946] ? __pfx_kthread+0x10/0x10 <4> [252.792950] ret_from_fork_asm+0x1a/0x30 <4> [252.792956] </TASK> <4> [252.792958] irq event stamp: 827647 <4> [252.792959] hardirqs last enabled at (827653): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.792961] hardirqs last disabled at (827658): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.792963] softirqs last enabled at (827486): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.792965] softirqs last disabled at (827475): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.792967] ---[ end trace 0000000000000000 ]--- <5> [252.793328] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7299, lrc_seqno=7299, guc_id=0, flags=0x73 in no process [-1] <7> [252.793339] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.793568] ------------[ cut here ]------------ <4> [252.793570] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.793572] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#13: kworker/u64:2/121 <4> [252.793688] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.793780] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.793787] CPU: 13 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.793791] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.793793] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.793795] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.793804] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.793941] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.793944] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [252.793948] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.793951] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.793953] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.793955] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.793957] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.793959] FS: 0000000000000000(0000) GS:ffff8888db31b000(0000) knlGS:0000000000000000 <4> [252.793962] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.793964] CR2: 0000744f0c333000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [252.793966] PKRU: 55555554 <4> [252.793968] Call Trace: <4> [252.793972] <TASK> <4> [252.793979] ? lock_acquire+0x40/0x2f0 <4> [252.793989] ? lock_release+0xd0/0x2b0 <4> [252.793997] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.794008] process_one_work+0x22e/0x740 <4> [252.794019] worker_thread+0x1e8/0x3d0 <4> [252.794023] ? __pfx_worker_thread+0x10/0x10 <4> [252.794026] kthread+0x10d/0x150 <4> [252.794029] ? __pfx_kthread+0x10/0x10 <4> [252.794034] ret_from_fork+0x3d4/0x480 <4> [252.794037] ? __pfx_kthread+0x10/0x10 <4> [252.794042] ret_from_fork_asm+0x1a/0x30 <4> [252.794054] </TASK> <4> [252.794055] irq event stamp: 1776941 <4> [252.794057] hardirqs last enabled at (1776947): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.794060] hardirqs last disabled at (1776952): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.794063] softirqs last enabled at (1776780): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.794066] softirqs last disabled at (1776725): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.794069] ---[ end trace 0000000000000000 ]--- <6> [252.794071] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.794181] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.794190] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.794159] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.794253] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.794353] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.794608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.794738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.794879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.795009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.795138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.795265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.795394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.795520] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.795659] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.795820] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.797142] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.807838] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.808144] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.809267] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.809384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.809499] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.809617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.809734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.809857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.809974] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.810091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.810207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.810324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.810440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.810557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.810673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.810790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.810912] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.811030] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.811146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.811263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.811380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.811501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.811623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.811743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.811869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.811989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.812109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.812228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.812347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.812470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.812594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.812717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.812843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.812968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.813096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.813223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.813351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.813476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.813600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.813721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.813849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.813970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.814094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.814216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.814337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.814457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.814582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.814702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.814823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.814950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.815073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.815193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.815312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.815436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.815557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.815678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.815797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.815923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.816043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.816162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.816286] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.816459] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.816465] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7299, lrc_seqno=7299, guc_id=0, flags=0x73 in no process [-1] <7> [252.816468] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.816567] ------------[ cut here ]------------ <4> [252.816568] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.816570] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#13: kworker/u64:2/121 <4> [252.816679] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.816762] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.816768] CPU: 13 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.816771] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.816773] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.816774] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.816781] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.816894] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.816896] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [252.816900] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.816902] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.816904] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.816906] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.816907] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.816909] FS: 0000000000000000(0000) GS:ffff8888db31b000(0000) knlGS:0000000000000000 <4> [252.816911] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.816913] CR2: 0000744f0c333000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [252.816915] PKRU: 55555554 <4> [252.816916] Call Trace: <4> [252.816918] <TASK> <4> [252.816924] ? lock_acquire+0x40/0x2f0 <4> [252.816932] ? lock_release+0xd0/0x2b0 <4> [252.816940] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.816949] process_one_work+0x22e/0x740 <4> [252.816959] worker_thread+0x1e8/0x3d0 <4> [252.816962] ? __pfx_worker_thread+0x10/0x10 <4> [252.816965] kthread+0x10d/0x150 <4> [252.816969] ? __pfx_kthread+0x10/0x10 <4> [252.816974] ret_from_fork+0x3d4/0x480 <4> [252.816976] ? __pfx_kthread+0x10/0x10 <4> [252.816980] ret_from_fork_asm+0x1a/0x30 <4> [252.816992] </TASK> <4> [252.816994] irq event stamp: 1780165 <4> [252.816995] hardirqs last enabled at (1780171): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.816998] hardirqs last disabled at (1780176): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.817001] softirqs last enabled at (1779210): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.817004] softirqs last disabled at (1779203): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.817007] ---[ end trace 0000000000000000 ]--- <6> [252.817009] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.817118] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.817125] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.817534] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.817786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.817921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.818055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.818182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.818310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.818436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.818565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.818691] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.818833] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.819004] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.820008] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.830725] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.830959] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.831960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.832033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.832101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.832169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.832239] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.832304] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.832369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.832434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.832499] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.832564] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.832630] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.832696] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.832763] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.832835] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.832903] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.832970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.833036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.833102] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.833168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.833243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.833316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.833389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.833461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.833531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.833602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.833672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.833740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.833810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.833893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.833964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.834033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.834102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.834177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.834250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.834324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.834394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.834462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.834527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.834594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.834659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.834728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.834796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.834871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.834939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.835010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.835077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.835144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.835210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.835276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.835342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.835410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.835479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.835546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.835611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.835677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.835744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.835810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.835886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.835955] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.836079] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.836082] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7299, lrc_seqno=7299, guc_id=0, flags=0x73 in no process [-1] <7> [252.836085] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.836140] ------------[ cut here ]------------ <4> [252.836141] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.836142] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [252.836209] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.836270] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.836274] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.836277] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.836278] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.836279] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.836284] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.836349] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.836351] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [252.836353] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.836354] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.836355] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.836356] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.836357] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.836359] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [252.836360] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.836361] CR2: 0000744f0c339000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [252.836363] PKRU: 55555554 <4> [252.836364] Call Trace: <4> [252.836365] <TASK> <4> [252.836368] ? lock_acquire+0x40/0x2f0 <4> [252.836373] ? lock_release+0xd0/0x2b0 <4> [252.836378] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.836384] process_one_work+0x22e/0x740 <4> [252.836390] worker_thread+0x1e8/0x3d0 <4> [252.836392] ? __pfx_worker_thread+0x10/0x10 <4> [252.836394] kthread+0x10d/0x150 <4> [252.836397] ? __pfx_kthread+0x10/0x10 <4> [252.836400] ret_from_fork+0x3d4/0x480 <4> [252.836402] ? __pfx_kthread+0x10/0x10 <4> [252.836405] ret_from_fork_asm+0x1a/0x30 <4> [252.836412] </TASK> <4> [252.836413] irq event stamp: 1783375 <4> [252.836414] hardirqs last enabled at (1783381): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.836416] hardirqs last disabled at (1783386): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.836418] softirqs last enabled at (1782488): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.836421] softirqs last disabled at (1782483): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.836423] ---[ end trace 0000000000000000 ]--- <5> [252.836803] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7310, lrc_seqno=7310, guc_id=0, flags=0x73 in no process [-1] <7> [252.836808] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.837018] ------------[ cut here ]------------ <4> [252.837020] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.837022] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:56/2675 <4> [252.837130] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.837195] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.837201] CPU: 6 UID: 0 PID: 2675 Comm: kworker/u64:56 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.837204] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.837205] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.837207] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.837214] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.837289] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.837291] RSP: 0018:ffffc90004847ca0 EFLAGS: 00010246 <4> [252.837293] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.837295] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.837296] RBP: ffffc90004847db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.837297] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.837298] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.837300] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [252.837301] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.837302] CR2: 0000744efc01e040 CR3: 000000011c098006 CR4: 0000000000f72ef0 <4> [252.837304] PKRU: 55555554 <4> [252.837305] Call Trace: <4> [252.837307] <TASK> <4> [252.837312] ? lock_acquire+0x40/0x2f0 <4> [252.837318] ? lock_release+0xd0/0x2b0 <4> [252.837323] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.837328] process_one_work+0x22e/0x740 <4> [252.837335] worker_thread+0x1e8/0x3d0 <4> [252.837338] ? __pfx_worker_thread+0x10/0x10 <4> [252.837340] kthread+0x10d/0x150 <4> [252.837343] ? __pfx_kthread+0x10/0x10 <4> [252.837347] ret_from_fork+0x3d4/0x480 <4> [252.837349] ? __pfx_kthread+0x10/0x10 <4> [252.837353] ret_from_fork_asm+0x1a/0x30 <4> [252.837360] </TASK> <4> [252.837361] irq event stamp: 614291 <4> [252.837362] hardirqs last enabled at (614297): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.837365] hardirqs last disabled at (614302): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.837367] softirqs last enabled at (613524): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.837370] softirqs last disabled at (613509): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.837372] ---[ end trace 0000000000000000 ]--- <6> [252.837374] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.837446] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.837456] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.837846] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.837950] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.838050] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.838255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.838340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.838426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.838505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.838583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.838659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.838736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.838810] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.838935] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.839051] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.840065] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.849837] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.850106] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.851091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.851165] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.851236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.851304] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.851373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.851442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.851509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.851578] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.851645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.851713] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.851780] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.851855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.851933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.852002] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.852069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.852135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.852199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.852264] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.852328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.852404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.852478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.852548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.852619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.852687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.852754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.852819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.852906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.852990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.853059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.853128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.853196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.853265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.853339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.853412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.853484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.853555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.853624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.853692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.853759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.853822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.853911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.853990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.854057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.854122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.854190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.854257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.854321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.854384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.854450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.854513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.854580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.854649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.854715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.854781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.854857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.854938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.855003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.855068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.855136] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.855261] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.855265] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7310, lrc_seqno=7310, guc_id=0, flags=0x73 in no process [-1] <7> [252.855267] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.855324] ------------[ cut here ]------------ <4> [252.855325] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.855326] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:56/2675 <4> [252.855392] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.855451] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.855455] CPU: 6 UID: 0 PID: 2675 Comm: kworker/u64:56 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.855457] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.855459] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.855460] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.855465] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.855529] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.855531] RSP: 0018:ffffc90004847ca0 EFLAGS: 00010246 <4> [252.855533] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.855534] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.855535] RBP: ffffc90004847db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.855536] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.855537] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.855539] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [252.855540] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.855541] CR2: 0000744efc01e040 CR3: 000000011c098006 CR4: 0000000000f72ef0 <4> [252.855543] PKRU: 55555554 <4> [252.855544] Call Trace: <4> [252.855545] <TASK> <4> [252.855548] ? lock_acquire+0x40/0x2f0 <4> [252.855554] ? lock_release+0xd0/0x2b0 <4> [252.855558] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.855564] process_one_work+0x22e/0x740 <4> [252.855569] worker_thread+0x1e8/0x3d0 <4> [252.855572] ? __pfx_worker_thread+0x10/0x10 <4> [252.855574] kthread+0x10d/0x150 <4> [252.855577] ? __pfx_kthread+0x10/0x10 <4> [252.855580] ret_from_fork+0x3d4/0x480 <4> [252.855582] ? __pfx_kthread+0x10/0x10 <4> [252.855585] ret_from_fork_asm+0x1a/0x30 <4> [252.855591] </TASK> <4> [252.855592] irq event stamp: 617473 <4> [252.855593] hardirqs last enabled at (617479): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.855596] hardirqs last disabled at (617484): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.855598] softirqs last enabled at (616568): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.855600] softirqs last disabled at (616563): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.855602] ---[ end trace 0000000000000000 ]--- <6> [252.855604] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.855668] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.855673] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.856086] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.856319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.856398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.856480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.856557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.856634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.856710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.856786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.856877] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.856973] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.857082] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.858087] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.868805] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.869062] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.870273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.870348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.870419] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.870488] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.870557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.870625] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.870693] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.870759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.870832] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.870910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.870976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.871043] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.871109] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.871176] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.871242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.871306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.871373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.871438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.871503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.871578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.871652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.871722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.871794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.871887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.871969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.872037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.872105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.872174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.872245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.872312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.872379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.872446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.872519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.872592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.872665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.872735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.872803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.872886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.872967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.873034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.873106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.873177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.873244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.873310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.873380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.873447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.873515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.873583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.873652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.873717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.873782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.873884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.873961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.874028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.874093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.874159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.874223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.874290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.874359] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.874481] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.874495] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7310, lrc_seqno=7310, guc_id=0, flags=0x73 in no process [-1] <7> [252.874497] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.874553] ------------[ cut here ]------------ <4> [252.874554] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.874555] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:56/2675 <4> [252.874621] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.874679] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.874683] CPU: 6 UID: 0 PID: 2675 Comm: kworker/u64:56 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.874686] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.874687] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.874689] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.874693] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.874756] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.874758] RSP: 0018:ffffc90004847ca0 EFLAGS: 00010246 <4> [252.874760] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.874761] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.874762] RBP: ffffc90004847db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.874763] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.874765] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.874766] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [252.874767] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.874769] CR2: 0000744efc01e040 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [252.874770] PKRU: 55555554 <4> [252.874771] Call Trace: <4> [252.874772] <TASK> <4> [252.874775] ? lock_acquire+0x40/0x2f0 <4> [252.874780] ? lock_release+0xd0/0x2b0 <4> [252.874785] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.874791] process_one_work+0x22e/0x740 <4> [252.874796] worker_thread+0x1e8/0x3d0 <4> [252.874799] ? __pfx_worker_thread+0x10/0x10 <4> [252.874801] kthread+0x10d/0x150 <4> [252.874803] ? __pfx_kthread+0x10/0x10 <4> [252.874807] ret_from_fork+0x3d4/0x480 <4> [252.874808] ? __pfx_kthread+0x10/0x10 <4> [252.874811] ret_from_fork_asm+0x1a/0x30 <4> [252.874818] </TASK> <4> [252.874819] irq event stamp: 620675 <4> [252.874820] hardirqs last enabled at (620681): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.874822] hardirqs last disabled at (620686): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.874824] softirqs last enabled at (619738): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.874832] softirqs last disabled at (619733): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.874836] ---[ end trace 0000000000000000 ]--- <7> [252.875892] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.875990] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [252.876116] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7315, lrc_seqno=7315, guc_id=0, flags=0x73 in no process [-1] <7> [252.876119] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.876177] ------------[ cut here ]------------ <4> [252.876178] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.876180] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [252.876251] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.876309] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.876313] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.876316] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.876317] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.876318] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.876323] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.876389] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.876391] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [252.876393] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.876394] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.876396] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.876397] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.876398] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.876399] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [252.876400] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.876402] CR2: 0000744f0c339000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [252.876403] PKRU: 55555554 <4> [252.876404] Call Trace: <4> [252.876405] <TASK> <4> [252.876409] ? lock_acquire+0x40/0x2f0 <4> [252.876414] ? lock_release+0xd0/0x2b0 <4> [252.876419] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.876424] process_one_work+0x22e/0x740 <4> [252.876430] worker_thread+0x1e8/0x3d0 <4> [252.876432] ? __pfx_worker_thread+0x10/0x10 <4> [252.876434] kthread+0x10d/0x150 <4> [252.876437] ? __pfx_kthread+0x10/0x10 <4> [252.876440] ret_from_fork+0x3d4/0x480 <4> [252.876442] ? __pfx_kthread+0x10/0x10 <4> [252.876445] ret_from_fork_asm+0x1a/0x30 <4> [252.876452] </TASK> <4> [252.876453] irq event stamp: 1784697 <4> [252.876454] hardirqs last enabled at (1784703): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.876457] hardirqs last disabled at (1784708): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.876459] softirqs last enabled at (1782488): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.876461] softirqs last disabled at (1782483): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.876463] ---[ end trace 0000000000000000 ]--- <6> [252.876465] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.876532] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.876537] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.876816] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.877037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.877121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.877206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.877284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.877359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.877433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.877508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.877579] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.877666] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.877773] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.878776] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.889499] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.889744] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.890761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.890838] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.890907] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.890975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.891044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.891112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.891180] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.891247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.891316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.891385] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.891450] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.891518] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.891584] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.891649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.891716] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.891781] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.891854] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.891922] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.891989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.892063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.892137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.892207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.892280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.892349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.892417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.892485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.892552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.892620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.892690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.892760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.892835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.892905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.892980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.893054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.893126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.893196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.893265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.893332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.893399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.893465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.893535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.893603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.893671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.893737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.893807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.893883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.893951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.894016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.894082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.894147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.894212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.894280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.894345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.894410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.894476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.894542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.894605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.894669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.894738] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.894870] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.894874] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7315, lrc_seqno=7315, guc_id=0, flags=0x73 in no process [-1] <7> [252.894876] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.894933] ------------[ cut here ]------------ <4> [252.894934] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.894935] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [252.895001] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.895059] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.895063] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.895066] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.895067] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.895068] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.895073] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.895136] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.895138] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [252.895140] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.895141] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.895142] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.895143] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.895144] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.895146] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [252.895147] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.895148] CR2: 0000744f0c339000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [252.895150] PKRU: 55555554 <4> [252.895151] Call Trace: <4> [252.895152] <TASK> <4> [252.895155] ? lock_acquire+0x40/0x2f0 <4> [252.895160] ? lock_release+0xd0/0x2b0 <4> [252.895165] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.895171] process_one_work+0x22e/0x740 <4> [252.895176] worker_thread+0x1e8/0x3d0 <4> [252.895179] ? __pfx_worker_thread+0x10/0x10 <4> [252.895181] kthread+0x10d/0x150 <4> [252.895183] ? __pfx_kthread+0x10/0x10 <4> [252.895187] ret_from_fork+0x3d4/0x480 <4> [252.895188] ? __pfx_kthread+0x10/0x10 <4> [252.895191] ret_from_fork_asm+0x1a/0x30 <4> [252.895198] </TASK> <4> [252.895199] irq event stamp: 1787911 <4> [252.895200] hardirqs last enabled at (1787917): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.895203] hardirqs last disabled at (1787922): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.895204] softirqs last enabled at (1786824): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.895207] softirqs last disabled at (1786817): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.895208] ---[ end trace 0000000000000000 ]--- <6> [252.895210] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.895275] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.895281] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.895619] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.895823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.895916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.895997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.896073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.896147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.896219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.896292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.896362] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.896448] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.896555] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.897554] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.908183] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.908419] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.909462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.909530] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.909594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.909658] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.909723] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.909787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.909857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.909927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.909994] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.910062] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.910132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.910199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.910266] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.910332] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.910398] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.910465] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.910531] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.910597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.910663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.910738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.910812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.910894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.910966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.911035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.911102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.911168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.911234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.911303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.911373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.911441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.911509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.911577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.911651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.911727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.911800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.911879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.911948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.912014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.912081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.912147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.912216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.912282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.912348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.912413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.912481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.912547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.912613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.912679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.912748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.912816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.912893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.912961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.913028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.913094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.913158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.913224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.913288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.913353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.913421] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.913546] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.913549] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7315, lrc_seqno=7315, guc_id=0, flags=0x73 in no process [-1] <7> [252.913552] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.913608] ------------[ cut here ]------------ <4> [252.913609] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.913610] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [252.913677] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.913735] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.913739] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.913742] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.913743] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.913744] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.913749] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.913813] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.913814] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [252.913816] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.913818] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.913819] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.913820] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.913821] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.913822] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [252.913824] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.913825] CR2: 0000744f0c339000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [252.913829] PKRU: 55555554 <4> [252.913830] Call Trace: <4> [252.913831] <TASK> <4> [252.913835] ? lock_acquire+0x40/0x2f0 <4> [252.913840] ? lock_release+0xd0/0x2b0 <4> [252.913845] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.913851] process_one_work+0x22e/0x740 <4> [252.913857] worker_thread+0x1e8/0x3d0 <4> [252.913859] ? __pfx_worker_thread+0x10/0x10 <4> [252.913861] kthread+0x10d/0x150 <4> [252.913864] ? __pfx_kthread+0x10/0x10 <4> [252.913867] ret_from_fork+0x3d4/0x480 <4> [252.913869] ? __pfx_kthread+0x10/0x10 <4> [252.913872] ret_from_fork_asm+0x1a/0x30 <4> [252.913879] </TASK> <4> [252.913880] irq event stamp: 1791105 <4> [252.913881] hardirqs last enabled at (1791111): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.913883] hardirqs last disabled at (1791116): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.913885] softirqs last enabled at (1790170): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.913887] softirqs last disabled at (1790165): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.913890] ---[ end trace 0000000000000000 ]--- <7> [252.914910] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.915036] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [252.915107] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7320, lrc_seqno=7320, guc_id=0, flags=0x73 in no process [-1] <7> [252.915112] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.915216] ------------[ cut here ]------------ <4> [252.915218] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.915220] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:10/211 <4> [252.915334] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.915419] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.915425] CPU: 12 UID: 0 PID: 211 Comm: kworker/u64:10 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.915429] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.915430] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.915432] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.915439] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.915550] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.915552] RSP: 0018:ffffc90001657ca0 EFLAGS: 00010246 <4> [252.915555] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.915557] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.915558] RBP: ffffc90001657db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.915560] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.915562] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.915563] FS: 0000000000000000(0000) GS:ffff8888db29b000(0000) knlGS:0000000000000000 <4> [252.915566] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.915567] CR2: 0000744f0c338000 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [252.915569] PKRU: 55555554 <4> [252.915571] Call Trace: <4> [252.915572] <TASK> <4> [252.915579] ? lock_acquire+0x40/0x2f0 <4> [252.915587] ? lock_release+0xd0/0x2b0 <4> [252.915595] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.915604] process_one_work+0x22e/0x740 <4> [252.915614] worker_thread+0x1e8/0x3d0 <4> [252.915618] ? __pfx_worker_thread+0x10/0x10 <4> [252.915621] kthread+0x10d/0x150 <4> [252.915624] ? __pfx_kthread+0x10/0x10 <4> [252.915629] ret_from_fork+0x3d4/0x480 <4> [252.915632] ? __pfx_kthread+0x10/0x10 <4> [252.915636] ret_from_fork_asm+0x1a/0x30 <4> [252.915648] </TASK> <4> [252.915649] irq event stamp: 829491 <4> [252.915651] hardirqs last enabled at (829497): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.915654] hardirqs last disabled at (829502): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.915657] softirqs last enabled at (827486): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.915660] softirqs last disabled at (827475): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.915663] ---[ end trace 0000000000000000 ]--- <6> [252.915665] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.915775] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.915783] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.915895] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.916190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.916322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.916456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.916584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.916713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.916913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.917040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.917145] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.917243] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.917359] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.918373] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.929146] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.929411] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.930431] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.930514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.930590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.930667] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.930741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.930813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.930899] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.930971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.931042] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.931113] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.931183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.931253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.931324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.931394] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.931466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.931536] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.931607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.931676] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.931746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.931834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.931914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.931991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.932069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.932144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.932216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.932288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.932360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.932434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.932509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.932582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.932655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.932729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.932807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.932897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.932977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.933053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.933129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.933201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.933273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.933345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.933418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.933488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.933559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.933630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.933705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.933777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.933855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.933926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.933998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.934068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.934140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.934213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.934285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.934358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.934431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.934504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.934576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.934647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.934719] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.934844] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.934849] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7320, lrc_seqno=7320, guc_id=0, flags=0x73 in no process [-1] <7> [252.934852] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.934912] ------------[ cut here ]------------ <4> [252.934913] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.934914] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:10/211 <4> [252.934988] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.935047] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.935052] CPU: 2 UID: 0 PID: 211 Comm: kworker/u64:10 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.935055] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.935056] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.935057] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.935062] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.935130] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.935132] RSP: 0018:ffffc90001657ca0 EFLAGS: 00010246 <4> [252.935134] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.935135] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.935136] RBP: ffffc90001657db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.935138] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.935139] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.935140] FS: 0000000000000000(0000) GS:ffff8888dad9b000(0000) knlGS:0000000000000000 <4> [252.935141] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.935143] CR2: 00007f3a4ec227fd CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [252.935144] PKRU: 55555554 <4> [252.935145] Call Trace: <4> [252.935146] <TASK> <4> [252.935150] ? lock_acquire+0x40/0x2f0 <4> [252.935155] ? lock_release+0xd0/0x2b0 <4> [252.935160] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.935165] process_one_work+0x22e/0x740 <4> [252.935171] worker_thread+0x1e8/0x3d0 <4> [252.935173] ? __pfx_worker_thread+0x10/0x10 <4> [252.935175] kthread+0x10d/0x150 <4> [252.935178] ? __pfx_kthread+0x10/0x10 <4> [252.935181] ret_from_fork+0x3d4/0x480 <4> [252.935183] ? __pfx_kthread+0x10/0x10 <4> [252.935186] ret_from_fork_asm+0x1a/0x30 <4> [252.935193] </TASK> <4> [252.935194] irq event stamp: 832641 <4> [252.935195] hardirqs last enabled at (832647): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.935198] hardirqs last disabled at (832652): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.935200] softirqs last enabled at (831596): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.935202] softirqs last disabled at (831591): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.935204] ---[ end trace 0000000000000000 ]--- <6> [252.935205] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.935274] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.935280] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.935686] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.935894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.935985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.936074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.936158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.936240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.936320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.936403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.936481] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.936574] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.936689] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.937699] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.948422] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.948670] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.949692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.949771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.949848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.949923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.949997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.950070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.950142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.950214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.950286] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.950357] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.950428] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.950500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.950571] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.950642] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.950714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.950785] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.950865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.950936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.951005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.951083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.951162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.951239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.951313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.951387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.951458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.951528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.951598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.951673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.951747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.951819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.951910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.951984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.952063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.952143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.952221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.952299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.952375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.952450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.952523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.952592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.952667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.952739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.952811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.952891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.952966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.953037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.953110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.953180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.953254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.953325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.953395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.953468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.953540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.953612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.953684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.953757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.953830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.953902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.953977] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.954095] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.954099] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7320, lrc_seqno=7320, guc_id=0, flags=0x73 in no process [-1] <7> [252.954101] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.954160] ------------[ cut here ]------------ <4> [252.954161] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.954162] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:10/211 <4> [252.954232] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.954290] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.954294] CPU: 2 UID: 0 PID: 211 Comm: kworker/u64:10 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.954297] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.954298] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.954300] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.954304] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.954373] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.954374] RSP: 0018:ffffc90001657ca0 EFLAGS: 00010246 <4> [252.954376] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.954378] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.954379] RBP: ffffc90001657db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.954380] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.954381] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.954382] FS: 0000000000000000(0000) GS:ffff8888dad9b000(0000) knlGS:0000000000000000 <4> [252.954384] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.954385] CR2: 00007f3a4ec227fd CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [252.954387] PKRU: 55555554 <4> [252.954388] Call Trace: <4> [252.954388] <TASK> <4> [252.954392] ? lock_acquire+0x40/0x2f0 <4> [252.954397] ? lock_release+0xd0/0x2b0 <4> [252.954402] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.954408] process_one_work+0x22e/0x740 <4> [252.954413] worker_thread+0x1e8/0x3d0 <4> [252.954416] ? __pfx_worker_thread+0x10/0x10 <4> [252.954418] kthread+0x10d/0x150 <4> [252.954420] ? __pfx_kthread+0x10/0x10 <4> [252.954424] ret_from_fork+0x3d4/0x480 <4> [252.954425] ? __pfx_kthread+0x10/0x10 <4> [252.954428] ret_from_fork_asm+0x1a/0x30 <4> [252.954435] </TASK> <4> [252.954436] irq event stamp: 835799 <4> [252.954437] hardirqs last enabled at (835805): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.954440] hardirqs last disabled at (835810): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.954442] softirqs last enabled at (834926): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.954444] softirqs last disabled at (834921): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.954446] ---[ end trace 0000000000000000 ]--- <5> [252.954862] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7323, lrc_seqno=7323, guc_id=0, flags=0x73 in no process [-1] <7> [252.954871] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.955043] ------------[ cut here ]------------ <4> [252.955046] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.955047] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:34/2653 <4> [252.955121] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.955191] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.955195] CPU: 8 UID: 0 PID: 2653 Comm: kworker/u64:34 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.955200] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.955201] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.955203] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.955209] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.955284] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.955286] RSP: 0018:ffffc900047afca0 EFLAGS: 00010246 <4> [252.955288] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.955290] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.955291] RBP: ffffc900047afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.955292] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.955293] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.955294] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [252.955296] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.955297] CR2: 0000744f00093428 CR3: 000000011c098003 CR4: 0000000000f72ef0 <4> [252.955298] PKRU: 55555554 <4> [252.955299] Call Trace: <4> [252.955300] <TASK> <4> [252.955304] ? lock_acquire+0x40/0x2f0 <4> [252.955311] ? lock_release+0xd0/0x2b0 <4> [252.955316] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.955321] process_one_work+0x22e/0x740 <4> [252.955328] worker_thread+0x1e8/0x3d0 <4> [252.955330] ? __pfx_worker_thread+0x10/0x10 <4> [252.955332] kthread+0x10d/0x150 <4> [252.955335] ? __pfx_kthread+0x10/0x10 <4> [252.955339] ret_from_fork+0x3d4/0x480 <4> [252.955340] ? __pfx_kthread+0x10/0x10 <4> [252.955343] ret_from_fork_asm+0x1a/0x30 <4> [252.955350] </TASK> <4> [252.955351] irq event stamp: 1365201 <4> [252.955353] hardirqs last enabled at (1365207): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.955355] hardirqs last disabled at (1365212): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.955357] softirqs last enabled at (1364262): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.955359] softirqs last disabled at (1364253): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.955361] ---[ end trace 0000000000000000 ]--- <6> [252.955364] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.955439] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.955452] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.955592] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.955699] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.955804] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.956120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.956255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.956391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.956522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.956651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.956779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.956914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.957042] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.957182] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.957344] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.958713] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.968838] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.969145] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.970242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.970322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.970396] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.970469] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.970540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.970609] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.970678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.970747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.970815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.970897] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.970965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.971032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.971101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.971170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.971238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.971304] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.971370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.971437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.971504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.971579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.971653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.971724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.971796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.971876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.971947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.972018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.972087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.972159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.972233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.972303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.972374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.972444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.972520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.972595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.972668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.972739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.972809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.972886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.972953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.973019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.973091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.973160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.973228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.973296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.973368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.973436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.973503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.973571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.973639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.973705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.973771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.973843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.973912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.973980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.974046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.974116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.974181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.974248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.974319] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.974433] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.974437] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7323, lrc_seqno=7323, guc_id=0, flags=0x73 in no process [-1] <7> [252.974439] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.974495] ------------[ cut here ]------------ <4> [252.974496] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.974498] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:25/2644 <4> [252.974565] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.974623] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.974627] CPU: 10 UID: 0 PID: 2644 Comm: kworker/u64:25 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.974630] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.974631] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.974632] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.974637] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.974701] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.974703] RSP: 0018:ffffc90004767ca0 EFLAGS: 00010246 <4> [252.974705] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.974706] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.974707] RBP: ffffc90004767db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.974708] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.974709] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.974710] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [252.974712] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.974713] CR2: 0000744f0c339000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [252.974714] PKRU: 55555554 <4> [252.974715] Call Trace: <4> [252.974716] <TASK> <4> [252.974720] ? lock_acquire+0x40/0x2f0 <4> [252.974725] ? lock_release+0xd0/0x2b0 <4> [252.974730] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.974735] process_one_work+0x22e/0x740 <4> [252.974741] worker_thread+0x1e8/0x3d0 <4> [252.974743] ? __pfx_worker_thread+0x10/0x10 <4> [252.974745] kthread+0x10d/0x150 <4> [252.974748] ? __pfx_kthread+0x10/0x10 <4> [252.974751] ret_from_fork+0x3d4/0x480 <4> [252.974753] ? __pfx_kthread+0x10/0x10 <4> [252.974756] ret_from_fork_asm+0x1a/0x30 <4> [252.974763] </TASK> <4> [252.974764] irq event stamp: 1589963 <4> [252.974765] hardirqs last enabled at (1589969): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.974767] hardirqs last disabled at (1589974): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.974769] softirqs last enabled at (1588956): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.974771] softirqs last disabled at (1588951): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.974773] ---[ end trace 0000000000000000 ]--- <6> [252.974774] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.974843] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.974849] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.975031] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.975231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.975315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.975399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.975478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.975554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.975652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.975732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.975805] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.975901] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.976009] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.977012] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [252.986836] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [252.987082] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [252.988308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [252.988381] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [252.988451] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [252.988523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [252.988592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [252.988663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [252.988730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [252.988798] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [252.988875] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [252.988943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [252.989011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [252.989077] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [252.989144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [252.989213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [252.989280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [252.989345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [252.989413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [252.989479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [252.989544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [252.989618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [252.989693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [252.989764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [252.989839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [252.989910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [252.989979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [252.990046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [252.990114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [252.990183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [252.990253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [252.990321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [252.990391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [252.990459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [252.990532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [252.990604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [252.990677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [252.990749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [252.990820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [252.990902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [252.990971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [252.991039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [252.991110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [252.991180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [252.991248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [252.991315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [252.991385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [252.991452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [252.991521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [252.991587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [252.991653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [252.991720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [252.991785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [252.991859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [252.991926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [252.991991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [252.992057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [252.992125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [252.992190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [252.992257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [252.992326] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [252.992434] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [252.992441] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7323, lrc_seqno=7323, guc_id=0, flags=0x73 in no process [-1] <7> [252.992443] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.992498] ------------[ cut here ]------------ <4> [252.992499] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.992500] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:25/2644 <4> [252.992567] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.992624] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.992628] CPU: 10 UID: 0 PID: 2644 Comm: kworker/u64:25 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.992631] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.992632] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.992633] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.992638] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.992703] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.992705] RSP: 0018:ffffc90004767ca0 EFLAGS: 00010246 <4> [252.992707] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.992708] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.992709] RBP: ffffc90004767db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.992710] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.992711] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.992712] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [252.992714] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.992715] CR2: 0000744f0c339000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [252.992716] PKRU: 55555554 <4> [252.992717] Call Trace: <4> [252.992718] <TASK> <4> [252.992722] ? lock_acquire+0x40/0x2f0 <4> [252.992727] ? lock_release+0xd0/0x2b0 <4> [252.992732] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.992737] process_one_work+0x22e/0x740 <4> [252.992743] worker_thread+0x1e8/0x3d0 <4> [252.992745] ? __pfx_worker_thread+0x10/0x10 <4> [252.992747] kthread+0x10d/0x150 <4> [252.992750] ? __pfx_kthread+0x10/0x10 <4> [252.992753] ret_from_fork+0x3d4/0x480 <4> [252.992755] ? __pfx_kthread+0x10/0x10 <4> [252.992758] ret_from_fork_asm+0x1a/0x30 <4> [252.992765] </TASK> <4> [252.992766] irq event stamp: 1593117 <4> [252.992767] hardirqs last enabled at (1593123): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.992769] hardirqs last disabled at (1593128): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.992771] softirqs last enabled at (1592206): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.992773] softirqs last disabled at (1592199): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.992775] ---[ end trace 0000000000000000 ]--- <5> [252.993125] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7327, lrc_seqno=7327, guc_id=0, flags=0x73 in no process [-1] <7> [252.993130] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [252.993310] ------------[ cut here ]------------ <4> [252.993311] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [252.993313] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:10/211 <4> [252.993389] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [252.993457] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [252.993461] CPU: 2 UID: 0 PID: 211 Comm: kworker/u64:10 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [252.993465] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [252.993466] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [252.993468] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [252.993475] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [252.993551] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [252.993552] RSP: 0018:ffffc90001657ca0 EFLAGS: 00010246 <4> [252.993554] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [252.993555] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [252.993557] RBP: ffffc90001657db0 R08: 0000000000000000 R09: 0000000000000000 <4> [252.993558] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [252.993559] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [252.993560] FS: 0000000000000000(0000) GS:ffff8888dad9b000(0000) knlGS:0000000000000000 <4> [252.993562] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [252.993563] CR2: 00007f3a4ec227fd CR3: 000000011c098004 CR4: 0000000000f72ef0 <4> [252.993565] PKRU: 55555554 <4> [252.993566] Call Trace: <4> [252.993567] <TASK> <4> [252.993571] ? lock_acquire+0x40/0x2f0 <4> [252.993578] ? lock_release+0xd0/0x2b0 <4> [252.993583] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [252.993588] process_one_work+0x22e/0x740 <4> [252.993596] worker_thread+0x1e8/0x3d0 <4> [252.993602] ? __pfx_worker_thread+0x10/0x10 <4> [252.993604] kthread+0x10d/0x150 <4> [252.993606] ? __pfx_kthread+0x10/0x10 <4> [252.993610] ret_from_fork+0x3d4/0x480 <4> [252.993612] ? __pfx_kthread+0x10/0x10 <4> [252.993615] ret_from_fork_asm+0x1a/0x30 <4> [252.993621] </TASK> <4> [252.993622] irq event stamp: 836887 <4> [252.993624] hardirqs last enabled at (836893): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [252.993626] hardirqs last disabled at (836898): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [252.993628] softirqs last enabled at (835984): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.993631] softirqs last disabled at (835979): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [252.993633] ---[ end trace 0000000000000000 ]--- <6> [252.993635] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [252.993708] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [252.993717] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [252.993952] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [252.994058] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [252.994155] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [252.994357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [252.994441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [252.994527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [252.994605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [252.994683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [252.994758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [252.994838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [252.994913] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [252.995001] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [252.995108] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [252.996114] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [253.006835] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [253.007079] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [253.008094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [253.008167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [253.008236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [253.008306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [253.008375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [253.008445] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [253.008514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [253.008581] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [253.008648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [253.008715] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [253.008784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [253.008860] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [253.008926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [253.008992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [253.009059] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [253.009126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [253.009193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [253.009260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [253.009326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [253.009401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [253.009477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [253.009547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [253.009620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [253.009689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [253.009757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [253.009825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [253.009909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [253.009982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [253.010054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [253.010123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [253.010193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [253.010263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [253.010338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [253.010415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [253.010490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [253.010562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [253.010633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [253.010702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [253.010770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [253.010840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [253.010909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [253.010976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [253.011044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [253.011112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [253.011183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [253.011251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [253.011317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [253.011383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [253.011450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [253.011514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [253.011578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [253.011645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [253.011710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [253.011776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [253.011843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [253.011909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [253.011975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [253.012040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [253.012110] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [253.012227] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [253.012231] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7327, lrc_seqno=7327, guc_id=0, flags=0x73 in no process [-1] <7> [253.012233] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [253.012290] ------------[ cut here ]------------ <4> [253.012291] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [253.012292] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:10/211 <4> [253.012359] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [253.012416] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [253.012420] CPU: 2 UID: 0 PID: 211 Comm: kworker/u64:10 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [253.012423] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [253.012424] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [253.012425] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [253.012430] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [253.012495] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [253.012497] RSP: 0018:ffffc90001657ca0 EFLAGS: 00010246 <4> [253.012498] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [253.012500] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [253.012501] RBP: ffffc90001657db0 R08: 0000000000000000 R09: 0000000000000000 <4> [253.012502] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [253.012503] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [253.012504] FS: 0000000000000000(0000) GS:ffff8888dad9b000(0000) knlGS:0000000000000000 <4> [253.012506] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [253.012507] CR2: 00007f3a4ec227fd CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [253.012508] PKRU: 55555554 <4> [253.012509] Call Trace: <4> [253.012510] <TASK> <4> [253.012514] ? lock_acquire+0x40/0x2f0 <4> [253.012519] ? lock_release+0xd0/0x2b0 <4> [253.012524] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [253.012529] process_one_work+0x22e/0x740 <4> [253.012535] worker_thread+0x1e8/0x3d0 <4> [253.012537] ? __pfx_worker_thread+0x10/0x10 <4> [253.012539] kthread+0x10d/0x150 <4> [253.012542] ? __pfx_kthread+0x10/0x10 <4> [253.012545] ret_from_fork+0x3d4/0x480 <4> [253.012547] ? __pfx_kthread+0x10/0x10 <4> [253.012550] ret_from_fork_asm+0x1a/0x30 <4> [253.012556] </TASK> <4> [253.012557] irq event stamp: 840025 <4> [253.012558] hardirqs last enabled at (840031): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [253.012561] hardirqs last disabled at (840036): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [253.012563] softirqs last enabled at (837354): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.012565] softirqs last disabled at (837349): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.012567] ---[ end trace 0000000000000000 ]--- <6> [253.012568] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [253.012631] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [253.012637] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [253.013648] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [253.013746] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [253.013850] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [253.014062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [253.014151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [253.014239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [253.014323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [253.014404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [253.014483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [253.014561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [253.014636] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [253.014729] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [253.014852] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [253.015862] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [253.024762] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 8ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [253.025015] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [253.026032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [253.026107] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [253.026177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [253.026248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [253.026318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [253.026388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [253.026456] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [253.026525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [253.026592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [253.026661] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [253.026728] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [253.026795] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [253.026872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [253.026940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [253.027006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [253.027073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [253.027141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [253.027206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [253.027272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [253.027349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [253.027424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [253.027496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [253.027569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [253.027639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [253.027708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [253.027777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [253.027853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [253.027928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [253.028001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [253.028073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [253.028144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [253.028215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [253.028291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [253.028366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [253.028440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [253.028511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [253.028581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [253.028648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [253.028714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [253.028780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [253.028855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [253.028922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [253.028989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [253.029056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [253.029127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [253.029193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [253.029258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [253.029326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [253.029392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [253.029458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [253.029523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [253.029592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [253.029656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [253.029724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [253.029789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [253.029864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [253.029930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [253.029994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [253.030062] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [253.030178] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [253.030182] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7327, lrc_seqno=7327, guc_id=0, flags=0x73 in no process [-1] <7> [253.030184] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [253.030240] ------------[ cut here ]------------ <4> [253.030241] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [253.030243] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:34/2653 <4> [253.030309] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [253.030367] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [253.030371] CPU: 8 UID: 0 PID: 2653 Comm: kworker/u64:34 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [253.030374] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [253.030375] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [253.030377] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [253.030381] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [253.030447] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [253.030449] RSP: 0018:ffffc900047afca0 EFLAGS: 00010246 <4> [253.030451] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [253.030452] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [253.030453] RBP: ffffc900047afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [253.030454] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [253.030455] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [253.030457] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [253.030458] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [253.030459] CR2: 0000744f00093428 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [253.030460] PKRU: 55555554 <4> [253.030461] Call Trace: <4> [253.030462] <TASK> <4> [253.030466] ? lock_acquire+0x40/0x2f0 <4> [253.030471] ? lock_release+0xd0/0x2b0 <4> [253.030476] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [253.030482] process_one_work+0x22e/0x740 <4> [253.030487] worker_thread+0x1e8/0x3d0 <4> [253.030490] ? __pfx_worker_thread+0x10/0x10 <4> [253.030492] kthread+0x10d/0x150 <4> [253.030494] ? __pfx_kthread+0x10/0x10 <4> [253.030498] ret_from_fork+0x3d4/0x480 <4> [253.030499] ? __pfx_kthread+0x10/0x10 <4> [253.030502] ret_from_fork_asm+0x1a/0x30 <4> [253.030509] </TASK> <4> [253.030510] irq event stamp: 1368847 <4> [253.030511] hardirqs last enabled at (1368853): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [253.030514] hardirqs last disabled at (1368858): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [253.030516] softirqs last enabled at (1367748): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.030518] softirqs last disabled at (1367737): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.030520] ---[ end trace 0000000000000000 ]--- <5> [253.031567] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7330, lrc_seqno=7330, guc_id=0, flags=0x73 in no process [-1] <7> [253.031571] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [253.031629] ------------[ cut here ]------------ <4> [253.031630] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [253.031631] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:10/211 <4> [253.031701] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb <7> [253.031658] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [253.031705] mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [253.031765] CPU: 4 UID: 0 PID: 211 Comm: kworker/u64:10 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [253.031767] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [253.031768] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [253.031770] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [253.031754] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [253.031775] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [253.031854] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [253.031856] RSP: 0018:ffffc90001657ca0 EFLAGS: 00010246 <4> [253.031858] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [253.031859] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [253.031860] RBP: ffffc90001657db0 R08: 0000000000000000 R09: 0000000000000000 <4> [253.031862] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [253.031863] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [253.031864] FS: 0000000000000000(0000) GS:ffff8888dae9b000(0000) knlGS:0000000000000000 <4> [253.031865] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [253.031867] CR2: 0000744f0c33a000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [253.031868] PKRU: 55555554 <4> [253.031869] Call Trace: <4> [253.031870] <TASK> <4> [253.031874] ? lock_acquire+0x40/0x2f0 <4> [253.031880] ? lock_release+0xd0/0x2b0 <4> [253.031885] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [253.031890] process_one_work+0x22e/0x740 <4> [253.031896] worker_thread+0x1e8/0x3d0 <4> [253.031899] ? __pfx_worker_thread+0x10/0x10 <4> [253.031901] kthread+0x10d/0x150 <4> [253.031904] ? __pfx_kthread+0x10/0x10 <4> [253.031907] ret_from_fork+0x3d4/0x480 <4> [253.031909] ? __pfx_kthread+0x10/0x10 <4> [253.031912] ret_from_fork_asm+0x1a/0x30 <4> [253.031919] </TASK> <4> [253.031920] irq event stamp: 841191 <4> [253.031921] hardirqs last enabled at (841197): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [253.031924] hardirqs last disabled at (841202): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [253.031926] softirqs last enabled at (841030): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.031928] softirqs last disabled at (841011): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.031930] ---[ end trace 0000000000000000 ]--- <6> [253.031932] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [253.031997] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [253.032003] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [253.032413] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [253.032614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [253.032694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [253.032776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [253.032860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [253.032939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [253.033016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [253.033093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [253.033167] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [253.033257] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [253.033364] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [253.034382] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [253.044834] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [253.045078] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [253.046096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [253.046169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [253.046238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [253.046309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [253.046377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [253.046446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [253.046513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [253.046581] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [253.046647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [253.046714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [253.046780] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [253.046851] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [253.046918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [253.046983] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [253.047051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [253.047115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [253.047182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [253.047248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [253.047314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [253.047389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [253.047464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [253.047535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [253.047608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [253.047680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [253.047749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [253.047818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [253.047900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [253.047974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [253.048045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [253.048113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [253.048184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [253.048255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [253.048332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [253.048408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [253.048484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [253.048557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [253.048627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [253.048696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [253.048764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [253.048834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [253.048904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [253.048975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [253.049043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [253.049110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [253.049183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [253.049250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [253.049319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [253.049387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [253.049455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [253.049521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [253.049588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [253.049657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [253.049727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [253.049798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [253.049874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [253.049942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [253.050008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [253.050073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [253.050143] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [253.050256] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [253.050260] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7330, lrc_seqno=7330, guc_id=0, flags=0x73 in no process [-1] <7> [253.050262] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [253.050318] ------------[ cut here ]------------ <4> [253.050319] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [253.050320] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:34/2653 <4> [253.050386] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [253.050443] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [253.050447] CPU: 8 UID: 0 PID: 2653 Comm: kworker/u64:34 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [253.050450] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [253.050451] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [253.050453] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [253.050457] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [253.050521] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [253.050523] RSP: 0018:ffffc900047afca0 EFLAGS: 00010246 <4> [253.050525] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [253.050526] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [253.050527] RBP: ffffc900047afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [253.050528] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [253.050529] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [253.050531] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [253.050532] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [253.050533] CR2: 0000744f00093428 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [253.050535] PKRU: 55555554 <4> [253.050536] Call Trace: <4> [253.050537] <TASK> <4> [253.050540] ? lock_acquire+0x40/0x2f0 <4> [253.050545] ? lock_release+0xd0/0x2b0 <4> [253.050550] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [253.050555] process_one_work+0x22e/0x740 <4> [253.050561] worker_thread+0x1e8/0x3d0 <4> [253.050564] ? __pfx_worker_thread+0x10/0x10 <4> [253.050566] kthread+0x10d/0x150 <4> [253.050568] ? __pfx_kthread+0x10/0x10 <4> [253.050571] ret_from_fork+0x3d4/0x480 <4> [253.050573] ? __pfx_kthread+0x10/0x10 <4> [253.050576] ret_from_fork_asm+0x1a/0x30 <4> [253.050583] </TASK> <4> [253.050584] irq event stamp: 1372095 <4> [253.050585] hardirqs last enabled at (1372101): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [253.050587] hardirqs last disabled at (1372106): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [253.050589] softirqs last enabled at (1370996): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.050592] softirqs last disabled at (1370989): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.050593] ---[ end trace 0000000000000000 ]--- <6> [253.050595] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [253.050660] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [253.050665] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [253.051674] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [253.051770] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [253.051876] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [253.052083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [253.052170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [253.052257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [253.052338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [253.052416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [253.052491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [253.052567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [253.052639] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [253.052725] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [253.052839] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [253.053858] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [253.064576] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [253.064819] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [253.065858] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [253.065930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [253.065999] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [253.066070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [253.066140] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [253.066208] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [253.066275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [253.066342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [253.066411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [253.066477] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [253.066544] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [253.066611] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [253.066679] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [253.066746] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [253.066814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [253.066897] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [253.066980] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [253.067050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [253.067118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [253.067194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [253.067266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [253.067337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [253.067407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [253.067475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [253.067542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [253.067610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [253.067679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [253.067749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [253.067819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [253.067909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [253.067991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [253.068062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [253.068136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [253.068209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [253.068281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [253.068351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [253.068419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [253.068485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [253.068553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [253.068619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [253.068686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [253.068755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [253.068821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [253.068905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [253.068991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [253.069060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [253.069127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [253.069191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [253.069259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [253.069322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [253.069387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [253.069455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [253.069520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [253.069588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [253.069655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [253.069722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [253.069786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [253.069865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [253.069948] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [253.070066] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [253.070070] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7330, lrc_seqno=7330, guc_id=0, flags=0x73 in no process [-1] <7> [253.070072] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [253.070128] ------------[ cut here ]------------ <4> [253.070129] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [253.070130] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:56/2675 <4> [253.070196] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [253.070255] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [253.070259] CPU: 6 UID: 0 PID: 2675 Comm: kworker/u64:56 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [253.070262] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [253.070263] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [253.070264] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [253.070269] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [253.070336] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [253.070337] RSP: 0018:ffffc90004847ca0 EFLAGS: 00010246 <4> [253.070339] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [253.070341] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [253.070342] RBP: ffffc90004847db0 R08: 0000000000000000 R09: 0000000000000000 <4> [253.070343] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [253.070344] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [253.070345] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [253.070347] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [253.070348] CR2: 0000744efc01e040 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [253.070350] PKRU: 55555554 <4> [253.070351] Call Trace: <4> [253.070352] <TASK> <4> [253.070355] ? lock_acquire+0x40/0x2f0 <4> [253.070360] ? lock_release+0xd0/0x2b0 <4> [253.070365] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [253.070370] process_one_work+0x22e/0x740 <4> [253.070376] worker_thread+0x1e8/0x3d0 <4> [253.070379] ? __pfx_worker_thread+0x10/0x10 <4> [253.070381] kthread+0x10d/0x150 <4> [253.070383] ? __pfx_kthread+0x10/0x10 <4> [253.070387] ret_from_fork+0x3d4/0x480 <4> [253.070388] ? __pfx_kthread+0x10/0x10 <4> [253.070391] ret_from_fork_asm+0x1a/0x30 <4> [253.070398] </TASK> <4> [253.070399] irq event stamp: 624709 <4> [253.070400] hardirqs last enabled at (624715): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [253.070403] hardirqs last disabled at (624720): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [253.070405] softirqs last enabled at (623838): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.070407] softirqs last disabled at (623827): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.070409] ---[ end trace 0000000000000000 ]--- <5> [253.070962] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7335, lrc_seqno=7335, guc_id=0, flags=0x73 in no process [-1] <7> [253.070970] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [253.071102] ------------[ cut here ]------------ <4> [253.071104] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [253.071105] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:10/211 <4> [253.071176] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [253.071240] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [253.071245] CPU: 4 UID: 0 PID: 211 Comm: kworker/u64:10 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [253.071249] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [253.071250] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [253.071251] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [253.071258] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [253.071326] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [253.071327] RSP: 0018:ffffc90001657ca0 EFLAGS: 00010246 <4> [253.071329] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [253.071331] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [253.071332] RBP: ffffc90001657db0 R08: 0000000000000000 R09: 0000000000000000 <4> [253.071333] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [253.071334] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [253.071335] FS: 0000000000000000(0000) GS:ffff8888dae9b000(0000) knlGS:0000000000000000 <4> [253.071337] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [253.071338] CR2: 0000744f0c33a000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [253.071340] PKRU: 55555554 <4> [253.071341] Call Trace: <4> [253.071343] <TASK> <4> [253.071348] ? lock_acquire+0x40/0x2f0 <4> [253.071354] ? lock_release+0xd0/0x2b0 <4> [253.071359] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [253.071364] process_one_work+0x22e/0x740 <4> [253.071370] worker_thread+0x1e8/0x3d0 <4> [253.071373] ? __pfx_worker_thread+0x10/0x10 <4> [253.071375] kthread+0x10d/0x150 <4> [253.071378] ? __pfx_kthread+0x10/0x10 <4> [253.071382] ret_from_fork+0x3d4/0x480 <4> [253.071384] ? __pfx_kthread+0x10/0x10 <4> [253.071387] ret_from_fork_asm+0x1a/0x30 <4> [253.071394] </TASK> <4> [253.071395] irq event stamp: 842363 <4> [253.071396] hardirqs last enabled at (842369): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [253.071399] hardirqs last disabled at (842374): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [253.071401] softirqs last enabled at (841030): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.071403] softirqs last disabled at (841011): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.071405] ---[ end trace 0000000000000000 ]--- <6> [253.071408] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [253.071477] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [253.071483] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [253.071561] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [253.071662] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [253.071760] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [253.071989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [253.072074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [253.072161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [253.072240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [253.072319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [253.072397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [253.072474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [253.072548] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [253.072635] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [253.072744] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [253.073740] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [253.083834] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [253.084081] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [253.085087] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [253.085162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [253.085232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [253.085305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [253.085373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [253.085443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [253.085512] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [253.085582] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [253.085650] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [253.085718] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [253.085786] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [253.085869] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [253.085938] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [253.086007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [253.086075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [253.086142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [253.086208] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [253.086274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [253.086343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [253.086418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [253.086492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [253.086565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [253.086637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [253.086706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [253.086773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [253.086860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [253.086926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [253.086995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [253.087064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [253.087132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [253.087201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [253.087270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [253.087344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [253.087417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [253.087490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [253.087562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [253.087631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [253.087699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [253.087768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [253.087836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [253.087908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [253.087975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [253.088041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [253.088107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [253.088179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [253.088248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [253.088318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [253.088385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [253.088454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [253.088519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [253.088585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [253.088654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [253.088721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [253.088786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [253.088858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [253.088926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [253.088992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [253.089059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [253.089129] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [253.089244] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [253.089248] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7335, lrc_seqno=7335, guc_id=0, flags=0x73 in no process [-1] <7> [253.089251] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [253.089306] ------------[ cut here ]------------ <4> [253.089307] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [253.089309] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:10/211 <4> [253.089374] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [253.089432] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [253.089436] CPU: 4 UID: 0 PID: 211 Comm: kworker/u64:10 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [253.089439] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [253.089440] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [253.089441] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [253.089446] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [253.089510] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [253.089511] RSP: 0018:ffffc90001657ca0 EFLAGS: 00010246 <4> [253.089513] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [253.089514] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [253.089516] RBP: ffffc90001657db0 R08: 0000000000000000 R09: 0000000000000000 <4> [253.089517] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [253.089518] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [253.089519] FS: 0000000000000000(0000) GS:ffff8888dae9b000(0000) knlGS:0000000000000000 <4> [253.089520] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [253.089522] CR2: 0000744f0c33a000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [253.089523] PKRU: 55555554 <4> [253.089524] Call Trace: <4> [253.089525] <TASK> <4> [253.089529] ? lock_acquire+0x40/0x2f0 <4> [253.089534] ? lock_release+0xd0/0x2b0 <4> [253.089539] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [253.089544] process_one_work+0x22e/0x740 <4> [253.089550] worker_thread+0x1e8/0x3d0 <4> [253.089552] ? __pfx_worker_thread+0x10/0x10 <4> [253.089554] kthread+0x10d/0x150 <4> [253.089557] ? __pfx_kthread+0x10/0x10 <4> [253.089560] ret_from_fork+0x3d4/0x480 <4> [253.089562] ? __pfx_kthread+0x10/0x10 <4> [253.089565] ret_from_fork_asm+0x1a/0x30 <4> [253.089572] </TASK> <4> [253.089573] irq event stamp: 845499 <4> [253.089574] hardirqs last enabled at (845505): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [253.089577] hardirqs last disabled at (845510): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [253.089579] softirqs last enabled at (844610): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.089581] softirqs last disabled at (844605): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.089583] ---[ end trace 0000000000000000 ]--- <6> [253.089584] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [253.089648] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [253.089654] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [253.090907] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [253.091002] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [253.091099] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [253.091320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [253.091404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [253.091490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [253.091571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [253.091651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [253.091729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [253.091808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [253.091914] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [253.092004] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [253.092114] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [253.093122] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [253.103839] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [253.104084] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [253.105067] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [253.105142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [253.105214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [253.105284] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [253.105369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [253.105438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [253.105509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [253.105576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [253.105642] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [253.105709] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [253.105775] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [253.105869] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [253.105941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [253.106009] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [253.106074] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [253.106139] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [253.106204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [253.106269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [253.106334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [253.106410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [253.106484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [253.106557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [253.106628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [253.106696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [253.106766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [253.106843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [253.106924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [253.106994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [253.107066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [253.107137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [253.107207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [253.107275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [253.107348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [253.107422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [253.107495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [253.107565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [253.107636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [253.107705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [253.107773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [253.107847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [253.107930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [253.107998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [253.108068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [253.108134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [253.108204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [253.108271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [253.108336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [253.108404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [253.108478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [253.108544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [253.108609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [253.108678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [253.108743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [253.108809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [253.108889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [253.108971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [253.109038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [253.109103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [253.109174] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [253.109289] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [253.109293] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7335, lrc_seqno=7335, guc_id=0, flags=0x73 in no process [-1] <7> [253.109295] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [253.109351] ------------[ cut here ]------------ <4> [253.109352] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [253.109353] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:56/2675 <4> [253.109419] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [253.109478] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [253.109482] CPU: 6 UID: 0 PID: 2675 Comm: kworker/u64:56 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [253.109485] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [253.109486] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [253.109487] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [253.109492] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [253.109556] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [253.109557] RSP: 0018:ffffc90004847ca0 EFLAGS: 00010246 <4> [253.109559] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [253.109561] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [253.109562] RBP: ffffc90004847db0 R08: 0000000000000000 R09: 0000000000000000 <4> [253.109563] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [253.109564] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [253.109565] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [253.109567] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [253.109568] CR2: 0000744efc01e040 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [253.109569] PKRU: 55555554 <4> [253.109570] Call Trace: <4> [253.109571] <TASK> <4> [253.109575] ? lock_acquire+0x40/0x2f0 <4> [253.109580] ? lock_release+0xd0/0x2b0 <4> [253.109585] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [253.109590] process_one_work+0x22e/0x740 <4> [253.109596] worker_thread+0x1e8/0x3d0 <4> [253.109599] ? __pfx_worker_thread+0x10/0x10 <4> [253.109601] kthread+0x10d/0x150 <4> [253.109603] ? __pfx_kthread+0x10/0x10 <4> [253.109607] ret_from_fork+0x3d4/0x480 <4> [253.109608] ? __pfx_kthread+0x10/0x10 <4> [253.109611] ret_from_fork_asm+0x1a/0x30 <4> [253.109618] </TASK> <4> [253.109619] irq event stamp: 627995 <4> [253.109620] hardirqs last enabled at (628001): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [253.109623] hardirqs last disabled at (628006): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [253.109625] softirqs last enabled at (627002): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.109627] softirqs last disabled at (626997): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.109629] ---[ end trace 0000000000000000 ]--- <5> [253.110701] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7342, lrc_seqno=7342, guc_id=0, flags=0x73 in no process [-1] <7> [253.110707] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [253.110784] ------------[ cut here ]------------ <4> [253.110785] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [253.110787] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:25/2644 <7> [253.110798] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [253.110873] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [253.110934] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [253.110939] CPU: 10 UID: 0 PID: 2644 Comm: kworker/u64:25 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [253.110942] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [253.110943] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [253.110944] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [253.110913] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [253.110949] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [253.111022] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [253.111023] RSP: 0018:ffffc90004767ca0 EFLAGS: 00010246 <4> [253.111026] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [253.111027] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [253.111028] RBP: ffffc90004767db0 R08: 0000000000000000 R09: 0000000000000000 <4> [253.111029] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [253.111030] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [253.111031] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [253.111033] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [253.111034] CR2: 0000744f0c339000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [253.111036] PKRU: 55555554 <4> [253.111037] Call Trace: <4> [253.111038] <TASK> <4> [253.111041] ? lock_acquire+0x40/0x2f0 <4> [253.111047] ? lock_release+0xd0/0x2b0 <4> [253.111052] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [253.111057] process_one_work+0x22e/0x740 <4> [253.111063] worker_thread+0x1e8/0x3d0 <4> [253.111065] ? __pfx_worker_thread+0x10/0x10 <4> [253.111067] kthread+0x10d/0x150 <4> [253.111070] ? __pfx_kthread+0x10/0x10 <4> [253.111073] ret_from_fork+0x3d4/0x480 <4> [253.111075] ? __pfx_kthread+0x10/0x10 <4> [253.111078] ret_from_fork_asm+0x1a/0x30 <4> [253.111085] </TASK> <4> [253.111086] irq event stamp: 1594737 <4> [253.111087] hardirqs last enabled at (1594743): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [253.111090] hardirqs last disabled at (1594748): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [253.111092] softirqs last enabled at (1593984): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.111094] softirqs last disabled at (1593977): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.111096] ---[ end trace 0000000000000000 ]--- <6> [253.111097] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [253.111168] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [253.111173] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [253.111580] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [253.111780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [253.111892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [253.111988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [253.112068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [253.112146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [253.112220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [253.112297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [253.112370] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [253.112457] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [253.112564] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [253.113590] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [253.123846] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [253.124090] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [253.125100] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [253.125171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [253.125240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [253.125309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [253.125376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [253.125444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [253.125512] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [253.125580] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [253.125647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [253.125715] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [253.125781] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [253.125861] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [253.125940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [253.126010] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [253.126076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [253.126144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [253.126210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [253.126275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [253.126341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [253.126414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [253.126487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [253.126557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [253.126628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [253.126696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [253.126764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [253.126838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [253.126920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [253.126991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [253.127063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [253.127130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [253.127199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [253.127268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [253.127340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [253.127412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [253.127483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [253.127553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [253.127621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [253.127687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [253.127753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [253.127818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [253.127906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [253.127984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [253.128050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [253.128115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [253.128186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [253.128250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [253.128315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [253.128381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [253.128447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [253.128512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [253.128576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [253.128645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [253.128710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [253.128774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [253.128846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [253.128931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [253.129003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [253.129071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [253.129140] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [253.129257] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [253.129261] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7342, lrc_seqno=7342, guc_id=0, flags=0x73 in no process [-1] <7> [253.129263] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [253.129320] ------------[ cut here ]------------ <4> [253.129321] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [253.129322] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:56/2675 <4> [253.129389] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [253.129447] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [253.129452] CPU: 6 UID: 0 PID: 2675 Comm: kworker/u64:56 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [253.129454] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [253.129455] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [253.129457] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [253.129461] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [253.129525] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [253.129527] RSP: 0018:ffffc90004847ca0 EFLAGS: 00010246 <4> [253.129529] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [253.129530] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [253.129531] RBP: ffffc90004847db0 R08: 0000000000000000 R09: 0000000000000000 <4> [253.129532] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [253.129534] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [253.129535] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [253.129536] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [253.129538] CR2: 0000744efc01e040 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [253.129539] PKRU: 55555554 <4> [253.129540] Call Trace: <4> [253.129541] <TASK> <4> [253.129544] ? lock_acquire+0x40/0x2f0 <4> [253.129549] ? lock_release+0xd0/0x2b0 <4> [253.129554] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [253.129560] process_one_work+0x22e/0x740 <4> [253.129565] worker_thread+0x1e8/0x3d0 <4> [253.129568] ? __pfx_worker_thread+0x10/0x10 <4> [253.129570] kthread+0x10d/0x150 <4> [253.129572] ? __pfx_kthread+0x10/0x10 <4> [253.129575] ret_from_fork+0x3d4/0x480 <4> [253.129577] ? __pfx_kthread+0x10/0x10 <4> [253.129580] ret_from_fork_asm+0x1a/0x30 <4> [253.129587] </TASK> <4> [253.129588] irq event stamp: 631317 <4> [253.129589] hardirqs last enabled at (631323): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [253.129591] hardirqs last disabled at (631328): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [253.129593] softirqs last enabled at (630428): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.129595] softirqs last disabled at (630421): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.129597] ---[ end trace 0000000000000000 ]--- <6> [253.129599] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [253.129665] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [253.129671] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [253.130911] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [253.130999] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [253.131087] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [253.131285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [253.131365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [253.131444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [253.131517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [253.131590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [253.131660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [253.131730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [253.131797] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [253.131889] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [253.131989] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [253.132985] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [253.143697] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [253.143933] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [253.144864] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [253.144934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [253.144997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [253.145061] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [253.145124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [253.145188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [253.145251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [253.145315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [253.145375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [253.145435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [253.145495] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [253.145557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [253.145617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [253.145678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [253.145738] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [253.145800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [253.145870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [253.145930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [253.145990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [253.146057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [253.146125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [253.146189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [253.146254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [253.146318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [253.146381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [253.146443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [253.146504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [253.146568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [253.146633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [253.146697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [253.146759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [253.146823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [253.146905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [253.146973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [253.147040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [253.147106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [253.147169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [253.147231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [253.147292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [253.147352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [253.147414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [253.147476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [253.147540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [253.147599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [253.147662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [253.147723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [253.147783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [253.147846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [253.147908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [253.147970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [253.148031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [253.148095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [253.148156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [253.148220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [253.148279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [253.148340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [253.148399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [253.148461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [253.148524] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [253.148636] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [253.148639] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7342, lrc_seqno=7342, guc_id=0, flags=0x73 in no process [-1] <7> [253.148641] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [253.148692] ------------[ cut here ]------------ <4> [253.148693] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [253.148694] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:10/211 <4> [253.148754] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [253.148807] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [253.148811] CPU: 4 UID: 0 PID: 211 Comm: kworker/u64:10 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [253.148814] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [253.148815] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [253.148816] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [253.148820] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [253.148898] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [253.148899] RSP: 0018:ffffc90001657ca0 EFLAGS: 00010246 <4> [253.148901] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [253.148903] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [253.148904] RBP: ffffc90001657db0 R08: 0000000000000000 R09: 0000000000000000 <4> [253.148905] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [253.148906] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [253.148907] FS: 0000000000000000(0000) GS:ffff8888dae9b000(0000) knlGS:0000000000000000 <4> [253.148909] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [253.148910] CR2: 0000744f0c33a000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [253.148912] PKRU: 55555554 <4> [253.148913] Call Trace: <4> [253.148914] <TASK> <4> [253.148917] ? lock_acquire+0x40/0x2f0 <4> [253.148922] ? lock_release+0xd0/0x2b0 <4> [253.148927] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [253.148932] process_one_work+0x22e/0x740 <4> [253.148937] worker_thread+0x1e8/0x3d0 <4> [253.148940] ? __pfx_worker_thread+0x10/0x10 <4> [253.148942] kthread+0x10d/0x150 <4> [253.148944] ? __pfx_kthread+0x10/0x10 <4> [253.148947] ret_from_fork+0x3d4/0x480 <4> [253.148949] ? __pfx_kthread+0x10/0x10 <4> [253.148952] ret_from_fork_asm+0x1a/0x30 <4> [253.148958] </TASK> <4> [253.148959] irq event stamp: 848961 <4> [253.148960] hardirqs last enabled at (848967): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [253.148963] hardirqs last disabled at (848972): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [253.148964] softirqs last enabled at (847906): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.148966] softirqs last disabled at (847897): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.148968] ---[ end trace 0000000000000000 ]--- <5> [253.149863] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7343, lrc_seqno=7343, guc_id=0, flags=0x73 in no process [-1] <7> [253.149869] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [253.149957] ------------[ cut here ]------------ <4> [253.149958] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [253.149959] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:25/2644 <4> [253.150025] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [253.150077] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [253.150081] CPU: 10 UID: 0 PID: 2644 Comm: kworker/u64:25 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [253.150083] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [253.150084] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [253.150085] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [253.150089] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [253.150164] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [253.150166] RSP: 0018:ffffc90004767ca0 EFLAGS: 00010246 <4> [253.150167] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [253.150168] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [253.150170] RBP: ffffc90004767db0 R08: 0000000000000000 R09: 0000000000000000 <4> [253.150171] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [253.150172] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [253.150173] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [253.150174] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [253.150175] CR2: 0000744f0c339000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [253.150176] PKRU: 55555554 <4> [253.150177] Call Trace: <4> [253.150178] <TASK> <4> [253.150181] ? lock_acquire+0x40/0x2f0 <4> [253.150186] ? lock_release+0xd0/0x2b0 <4> [253.150190] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [253.150195] process_one_work+0x22e/0x740 <4> [253.150200] worker_thread+0x1e8/0x3d0 <4> [253.150202] ? __pfx_worker_thread+0x10/0x10 <4> [253.150204] kthread+0x10d/0x150 <4> [253.150207] ? __pfx_kthread+0x10/0x10 <4> [253.150210] ret_from_fork+0x3d4/0x480 <4> [253.150211] ? __pfx_kthread+0x10/0x10 <4> [253.150214] ret_from_fork_asm+0x1a/0x30 <7> [253.150177] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [253.150220] </TASK> <4> [253.150221] irq event stamp: 1595851 <4> [253.150222] hardirqs last enabled at (1595857): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [253.150224] hardirqs last disabled at (1595862): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [253.150226] softirqs last enabled at (1593984): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.150228] softirqs last disabled at (1593977): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.150229] ---[ end trace 0000000000000000 ]--- <6> [253.150231] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [253.150292] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [253.150300] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [253.150266] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [253.150469] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [253.150669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [253.150754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [253.150841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [253.150919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [253.150991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [253.151061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [253.151130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [253.151197] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [253.151278] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [253.151380] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [253.152373] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [253.162834] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [253.163071] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [253.164054] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [253.164120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [253.164183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [253.164245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [253.164308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [253.164370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [253.164432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [253.164495] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [253.164557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [253.164618] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [253.164679] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [253.164740] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [253.164801] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [253.164872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [253.164934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [253.164994] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [253.165053] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [253.165113] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [253.165173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [253.165241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [253.165307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [253.165373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [253.165438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [253.165502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [253.165564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [253.165626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [253.165686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [253.165750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [253.165815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [253.165891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [253.165954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [253.166017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [253.166085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [253.166153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [253.166221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [253.166291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [253.166356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [253.166419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [253.166480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [253.166541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [253.166604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [253.166666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [253.166727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [253.166788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [253.166858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [253.166919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [253.166981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [253.167043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [253.167105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [253.167166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [253.167226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [253.167289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [253.167349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [253.167409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [253.167469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [253.167531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [253.167591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [253.167651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [253.167713] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [253.167820] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [253.167824] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7343, lrc_seqno=7343, guc_id=0, flags=0x73 in no process [-1] <7> [253.167829] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [253.167880] ------------[ cut here ]------------ <4> [253.167881] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [253.167882] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:25/2644 <4> [253.167943] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [253.167996] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [253.168000] CPU: 10 UID: 0 PID: 2644 Comm: kworker/u64:25 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [253.168002] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [253.168003] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [253.168004] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [253.168009] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [253.168067] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [253.168069] RSP: 0018:ffffc90004767ca0 EFLAGS: 00010246 <4> [253.168071] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [253.168072] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [253.168073] RBP: ffffc90004767db0 R08: 0000000000000000 R09: 0000000000000000 <4> [253.168074] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [253.168075] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [253.168076] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [253.168077] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [253.168078] CR2: 0000744f0c339000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [253.168080] PKRU: 55555554 <4> [253.168081] Call Trace: <4> [253.168081] <TASK> <4> [253.168085] ? lock_acquire+0x40/0x2f0 <4> [253.168089] ? lock_release+0xd0/0x2b0 <4> [253.168094] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [253.168099] process_one_work+0x22e/0x740 <4> [253.168104] worker_thread+0x1e8/0x3d0 <4> [253.168106] ? __pfx_worker_thread+0x10/0x10 <4> [253.168108] kthread+0x10d/0x150 <4> [253.168110] ? __pfx_kthread+0x10/0x10 <4> [253.168113] ret_from_fork+0x3d4/0x480 <4> [253.168115] ? __pfx_kthread+0x10/0x10 <4> [253.168117] ret_from_fork_asm+0x1a/0x30 <4> [253.168124] </TASK> <4> [253.168125] irq event stamp: 1599003 <4> [253.168125] hardirqs last enabled at (1599009): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [253.168128] hardirqs last disabled at (1599014): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [253.168130] softirqs last enabled at (1598044): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.168131] softirqs last disabled at (1598037): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.168133] ---[ end trace 0000000000000000 ]--- <6> [253.168134] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [253.168193] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [253.168198] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [253.168380] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [253.168572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [253.168643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [253.168717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [253.168787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [253.168864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [253.168931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [253.169000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [253.169066] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [253.169144] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [253.169244] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [253.170232] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [253.180834] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [253.181070] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [253.182183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [253.182252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [253.182314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [253.182376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [253.182437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [253.182497] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [253.182558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [253.182620] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [253.182679] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [253.182741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [253.182799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [253.182867] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [253.182929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [253.182993] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [253.183055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [253.183113] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [253.183171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [253.183230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [253.183290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [253.183358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [253.183424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [253.183486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [253.183550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [253.183611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [253.183672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [253.183734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [253.183796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [253.183869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [253.183938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [253.184005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [253.184068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [253.184131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [253.184198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [253.184265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [253.184333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [253.184398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [253.184460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [253.184522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [253.184583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [253.184642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [253.184706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [253.184767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [253.184833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [253.184901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [253.184975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [253.185036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [253.185098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [253.185158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [253.185219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [253.185278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [253.185337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [253.185399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [253.185461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [253.185522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [253.185582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [253.185642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [253.185702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [253.185761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [253.185822] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [253.185945] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [253.185952] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7343, lrc_seqno=7343, guc_id=0, flags=0x73 in no process [-1] <7> [253.185954] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [253.186009] ------------[ cut here ]------------ <4> [253.186010] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [253.186011] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:25/2644 <4> [253.186077] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [253.186130] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [253.186134] CPU: 10 UID: 0 PID: 2644 Comm: kworker/u64:25 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [253.186136] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [253.186137] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [253.186138] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [253.186143] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [253.186201] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [253.186203] RSP: 0018:ffffc90004767ca0 EFLAGS: 00010246 <4> [253.186204] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [253.186206] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [253.186207] RBP: ffffc90004767db0 R08: 0000000000000000 R09: 0000000000000000 <4> [253.186208] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [253.186208] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [253.186210] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [253.186211] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [253.186212] CR2: 0000744f0c339000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [253.186213] PKRU: 55555554 <4> [253.186214] Call Trace: <4> [253.186215] <TASK> <4> [253.186218] ? lock_acquire+0x40/0x2f0 <4> [253.186223] ? lock_release+0xd0/0x2b0 <4> [253.186227] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [253.186232] process_one_work+0x22e/0x740 <4> [253.186237] worker_thread+0x1e8/0x3d0 <4> [253.186239] ? __pfx_worker_thread+0x10/0x10 <4> [253.186241] kthread+0x10d/0x150 <4> [253.186244] ? __pfx_kthread+0x10/0x10 <4> [253.186247] ret_from_fork+0x3d4/0x480 <4> [253.186248] ? __pfx_kthread+0x10/0x10 <4> [253.186251] ret_from_fork_asm+0x1a/0x30 <4> [253.186257] </TASK> <4> [253.186258] irq event stamp: 1602141 <4> [253.186259] hardirqs last enabled at (1602147): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [253.186261] hardirqs last disabled at (1602152): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [253.186263] softirqs last enabled at (1601162): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.186265] softirqs last disabled at (1601155): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.186267] ---[ end trace 0000000000000000 ]--- <5> [253.186609] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7344, lrc_seqno=7344, guc_id=0, flags=0x73 in no process [-1] <7> [253.186618] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [253.186857] ------------[ cut here ]------------ <4> [253.186859] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [253.186862] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#13: kworker/u64:2/121 <4> [253.186979] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [253.187076] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [253.187081] CPU: 13 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [253.187086] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [253.187087] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [253.187090] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [253.187100] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [253.187210] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [253.187212] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [253.187215] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [253.187217] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [253.187219] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [253.187221] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [253.187223] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [253.187225] FS: 0000000000000000(0000) GS:ffff8888db31b000(0000) knlGS:0000000000000000 <4> [253.187227] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [253.187228] CR2: 0000744f0c333000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [253.187230] PKRU: 55555554 <4> [253.187232] Call Trace: <4> [253.187234] <TASK> <4> [253.187241] ? lock_acquire+0x40/0x2f0 <4> [253.187250] ? lock_release+0xd0/0x2b0 <4> [253.187258] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [253.187267] process_one_work+0x22e/0x740 <4> [253.187277] worker_thread+0x1e8/0x3d0 <4> [253.187281] ? __pfx_worker_thread+0x10/0x10 <4> [253.187284] kthread+0x10d/0x150 <4> [253.187287] ? __pfx_kthread+0x10/0x10 <4> [253.187292] ret_from_fork+0x3d4/0x480 <4> [253.187295] ? __pfx_kthread+0x10/0x10 <4> [253.187299] ret_from_fork_asm+0x1a/0x30 <4> [253.187311] </TASK> <4> [253.187312] irq event stamp: 1793133 <4> [253.187314] hardirqs last enabled at (1793139): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [253.187318] hardirqs last disabled at (1793144): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [253.187321] softirqs last enabled at (1792366): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.187326] softirqs last disabled at (1792357): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.187328] ---[ end trace 0000000000000000 ]--- <6> [253.187331] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [253.187440] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [253.187451] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [253.187440] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [253.187527] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [253.187619] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [253.187876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [253.188007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [253.188142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [253.188271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [253.188400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [253.188527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [253.188656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [253.188782] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [253.188964] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [253.189127] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [253.190477] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [253.200857] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [253.201164] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [253.202347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [253.202464] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [253.202579] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [253.202696] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [253.202813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [253.202937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [253.203054] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [253.203171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [253.203287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [253.203404] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [253.203520] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [253.203637] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [253.203754] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [253.203876] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [253.203994] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [253.204111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [253.204227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [253.204344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [253.204461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [253.204582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [253.204703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [253.204823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [253.204950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [253.205070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [253.205191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [253.205311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [253.205432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [253.205556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [253.205680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [253.205801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [253.205928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [253.206052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [253.206180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [253.206307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [253.206434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [253.206559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [253.206683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [253.206805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [253.206929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [253.207051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [253.207175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [253.207298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [253.207421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [253.207541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [253.207668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [253.207790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [253.207916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [253.208037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [253.208159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [253.208279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [253.208400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [253.208524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [253.208645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [253.208767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [253.208891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [253.209014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [253.209133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [253.209252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [253.209376] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [253.209541] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [253.209547] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7344, lrc_seqno=7344, guc_id=0, flags=0x73 in no process [-1] <7> [253.209550] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [253.209648] ------------[ cut here ]------------ <4> [253.209650] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [253.209651] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#13: kworker/u64:2/121 <4> [253.209761] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [253.209851] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [253.209857] CPU: 13 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [253.209860] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [253.209862] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [253.209864] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [253.209871] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [253.209979] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [253.209981] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [253.209984] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [253.209986] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [253.209987] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [253.209989] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [253.209990] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [253.209992] FS: 0000000000000000(0000) GS:ffff8888db31b000(0000) knlGS:0000000000000000 <4> [253.209994] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [253.209996] CR2: 0000744f0c333000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [253.209998] PKRU: 55555554 <4> [253.209999] Call Trace: <4> [253.210001] <TASK> <4> [253.210007] ? lock_acquire+0x40/0x2f0 <4> [253.210015] ? lock_release+0xd0/0x2b0 <4> [253.210023] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [253.210032] process_one_work+0x22e/0x740 <4> [253.210041] worker_thread+0x1e8/0x3d0 <4> [253.210045] ? __pfx_worker_thread+0x10/0x10 <4> [253.210048] kthread+0x10d/0x150 <4> [253.210051] ? __pfx_kthread+0x10/0x10 <4> [253.210056] ret_from_fork+0x3d4/0x480 <4> [253.210058] ? __pfx_kthread+0x10/0x10 <4> [253.210063] ret_from_fork_asm+0x1a/0x30 <4> [253.210075] </TASK> <4> [253.210076] irq event stamp: 1796449 <4> [253.210077] hardirqs last enabled at (1796455): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [253.210081] hardirqs last disabled at (1796460): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [253.210083] softirqs last enabled at (1795558): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.210086] softirqs last disabled at (1795553): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.210089] ---[ end trace 0000000000000000 ]--- <6> [253.210091] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [253.210200] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [253.210207] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [253.210620] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [253.210875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [253.211001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [253.211134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [253.211262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [253.211389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [253.211516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [253.211644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [253.211770] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [253.211911] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [253.212073] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [253.213414] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [253.223839] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [253.224144] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [253.225219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [253.225289] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [253.225353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [253.225416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [253.225478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [253.225538] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [253.225598] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [253.225658] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [253.225717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [253.225777] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [253.225841] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [253.225903] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [253.225965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [253.226025] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [253.226086] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [253.226148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [253.226209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [253.226269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [253.226330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [253.226398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [253.226465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [253.226530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [253.226596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [253.226657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [253.226719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [253.226781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [253.226846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [253.226910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [253.226974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [253.227037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [253.227101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [253.227164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [253.227231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [253.227299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [253.227367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [253.227433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [253.227498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [253.227560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [253.227622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [253.227682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [253.227744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [253.227806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [253.227876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [253.227938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [253.228001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [253.228061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [253.228123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [253.228183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [253.228244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [253.228304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [253.228364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [253.228427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [253.228489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [253.228552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [253.228611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [253.228675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [253.228738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [253.228798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [253.228870] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [253.228975] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [253.228979] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=7344, lrc_seqno=7344, guc_id=0, flags=0x73 in no process [-1] <7> [253.228981] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [253.229038] ------------[ cut here ]------------ <4> [253.229039] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [253.229040] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [253.229100] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore <4> [253.229153] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [253.229157] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.0.0-rc3-lgci-xe-xe-4691-bf3ba6a508ffb5932-debug+ #1 PREEMPT(lazy) <4> [253.229159] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [253.229160] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [253.229161] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [253.229166] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [253.229224] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [253.229226] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [253.229227] RAX: ffffffffa11fd6a9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [253.229229] RDX: ffff8881042cae10 RSI: ffffffffa11fd6a9 RDI: ffffffffa1003d80 <4> [253.229230] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [253.229231] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [253.229231] R13: ffff8881042cae10 R14: ffff88810a600818 R15: 00000000ffffffc2 <4> [253.229233] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [253.229234] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [253.229235] CR2: 0000744f0c339000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [253.229236] PKRU: 55555554 <4> [253.229237] Call Trace: <4> [253.229238] <TASK> <4> [253.229241] ? lock_acquire+0x40/0x2f0 <4> [253.229246] ? lock_release+0xd0/0x2b0 <4> [253.229250] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [253.229255] process_one_work+0x22e/0x740 <4> [253.229260] worker_thread+0x1e8/0x3d0 <4> [253.229263] ? __pfx_worker_thread+0x10/0x10 <4> [253.229265] kthread+0x10d/0x150 <4> [253.229267] ? __pfx_kthread+0x10/0x10 <4> [253.229270] ret_from_fork+0x3d4/0x480 <4> [253.229271] ? __pfx_kthread+0x10/0x10 <4> [253.229274] ret_from_fork_asm+0x1a/0x30 <4> [253.229280] </TASK> <4> [253.229281] irq event stamp: 1799611 <4> [253.229282] hardirqs last enabled at (1799617): [<ffffffff814a9d69>] __up_console_sem+0x79/0xa0 <4> [253.229284] hardirqs last disabled at (1799622): [<ffffffff814a9d4e>] __up_console_sem+0x5e/0xa0 <4> [253.229286] softirqs last enabled at (1798394): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.229288] softirqs last disabled at (1798385): [<ffffffff813d0eef>] __irq_exit_rcu+0x13f/0x160 <4> [253.229290] ---[ end trace 0000000000000000 ]--- <7> [253.230599] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [253.230708] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [253.233091] xe 0000:03:00.0: [drm:drm_pagemap_dev_unhold_work [drm_gpusvm_helper]] Releasing reference on provider device and module. <7> [253.246091] xe 0000:03:00.0: [drm:drm_client_dev_restore] fbdev: ret=0

<4> [246.668385] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [246.668537] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [246.687443] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [246.687587] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [246.709357] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [246.709575] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [246.711760] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [246.711995] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [246.733890] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [246.734056] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [246.753783] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [246.753955] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [246.755685] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [246.755828] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [246.778400] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [246.778618] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [246.798305] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [246.798448] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [246.799618] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [246.799761] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [246.818908] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [246.819077] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [246.837849] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [246.838015] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.137840] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.138059] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.161557] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.161779] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.182245] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.182387] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.183075] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake

<4> [252.183333] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.201116] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.201258] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.223274] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec

<4> [252.223527] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.224306] rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel]

<4> [252.224531] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.242496] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.242636] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.263393] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.263533] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.264658] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.264825] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.287804] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.288033] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.308357] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.308504] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.309071] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.309213] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.330690] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.330928] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.349790] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.349970] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.351142] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.351378] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.371776] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.371920] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.394778] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.394999] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.396916] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.397056] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.415431] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.415569] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.435663] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.435802] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.437032] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.437168] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.455588] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.455725] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.474647] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.474783] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.476069] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.476215] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.494637] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.494776] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.514601] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.514738] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.515992] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class

<4> [252.516128] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.534531] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.534666] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.554821] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.554967] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.555767] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.555937] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.574633] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.574768] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.594742] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.594894] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.595791] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.595962] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.614349] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.614483] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.633603] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.633745] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.634557] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.634719] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.653612] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.653751] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.673616] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.673754] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.674454] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.674605] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.693605] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.693745] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.713389] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.713527] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.714792] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.714936] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.733334] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.733471] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.752653] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.752790] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.753772] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.753946] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.772760] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.772909] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.792740] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.792892] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.793688] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.793941] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.816679] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.816894] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.836209] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.836349] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.837130] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.837289] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.855392] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.855529] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.874621] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.874756] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.876251] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.876389] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.895001] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.895136] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.913677] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.913813] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.915334] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.915550] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.934988] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.935130] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.954232] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.954373] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.955121] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.955284] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.974565] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.974701] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.992567] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.992703] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [252.993389] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [252.993551] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [253.012359] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [253.012495] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [253.030309] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [253.030447] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [253.031705] mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel]

<4> [253.031854] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [253.050386] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [253.050521] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [253.070196] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [253.070336] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [253.071176] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [253.071326] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [253.089374] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [253.089510] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [253.109419] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [253.109556] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [253.110873] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [253.111022] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [253.129389] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [253.129525] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [253.148754] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [253.148898] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [253.150025] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [253.150164] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [253.167943] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [253.168067] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [253.186077] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [253.186201] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [253.186979] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [253.187210] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [253.209761] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [253.209979] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [253.229100] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart coretemp spi_nor eeepc_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg r8169 rapl snd_hda_codec binfmt_misc snd_hda_core intel_cstate snd_hwdep video snd_pcm realtek snd_timer i2c_i801 mei_me spi_intel_pci snd idma64 i2c_mux i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [253.229224] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 59 5e e1 48 89 c6 48 8d 3d ec a7 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

Results for igt@xe_exec_system_allocator@threads-many-stride-new-bo-map-nomemset