igt@xe_compute_preempt@compute-preempt-many-vram-evict@engine-drm_xe_engine_class_compute on shard-bmg@xe-4428-dc0b90be8d513256a6594095731a702287f29602 Test details

Detail	Value
Duration	unknown
Hostname	shard-bmg-4
Igt-Version	IGT-Version: 2.3-g16ce286ca (x86_64) (Linux: 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ x86_64)
Out	Using IGT_SRANDOM=1769031024 for randomisation Opened device: /dev/dri/card0 Starting subtest: compute-preempt-many-vram-evict Starting dynamic subtest: engine-DRM_XE_ENGINE_CLASS_COMPUTE Stack trace: Stack trace: Stack trace: Stack trace: Stack trace: Stack trace: Stack trace: Stack trace: Stack trace: Stack trace: #0 ../lib/igt_core.c:2075 __igt_fail_assert() #0 ../lib/igt_core.c:2075 __igt_fail_assert() #0 ../lib/igt_core.c:2075 __igt_fail_assert() #0 ../lib/igt_core.c:2075 __igt_fail_assert() #0 ../lib/igt_core.c:2075 __igt_fail_assert() #0 ../lib/igt_core.c:2075 __igt_fail_assert() #0 ../lib/igt_core.c:2075 __igt_fail_assert() #0 ../lib/igt_core.c:2075 __igt_fail_assert() #0 ../lib/igt_core.c:2075 __igt_fail_assert() #0 ../lib/igt_core.c:2075 __igt_fail_assert() #1 [xe_wait_ufence+0x57] #1 [xe_wait_ufence+0x57] #1 [xe_wait_ufence+0x57] #1 [xe_wait_ufence+0x57] #1 [xe_wait_ufence+0x57] #2 ../lib/intel_compute.c:418 bo_execenv_sync() #1 [xe_wait_ufence+0x57] #1 [xe_wait_ufence+0x57] #1 [xe_wait_ufence+0x57] #1 [xe_wait_ufence+0x57] #1 [xe_wait_ufence+0x57] #3 ../lib/intel_compute.c:2522 xe2lpg_compute_preempt_exec() #4 ../lib/intel_compute.c:2793 run_intel_compute_kernel_preempt() #2 ../lib/intel_compute.c:418 bo_execenv_sync() #2 ../lib/intel_compute.c:418 bo_execenv_sync() #3 ../lib/intel_compute.c:2522 xe2lpg_compute_preempt_exec() #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #6 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() #7 ../tests/intel/xe_compute_preempt.c:65 main() #4 ../lib/intel_compute.c:2793 run_intel_compute_kernel_preempt() #3 ../lib/intel_compute.c:2522 xe2lpg_compute_preempt_exec() #2 ../lib/intel_compute.c:418 bo_execenv_sync() #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #6 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() #7 ../tests/intel/xe_compute_preempt.c:65 main() #4 ../lib/intel_compute.c:2793 run_intel_compute_kernel_preempt() #2 ../lib/intel_compute.c:418 bo_execenv_sync() #2 ../lib/intel_compute.c:418 bo_execenv_sync() #2 ../lib/intel_compute.c:418 bo_execenv_sync() #2 ../lib/intel_compute.c:418 bo_execenv_sync() #3 ../lib/intel_compute.c:2522 xe2lpg_compute_preempt_exec() #2 ../lib/intel_compute.c:418 bo_execenv_sync() #2 ../lib/intel_compute.c:418 bo_execenv_sync() #4 ../lib/intel_compute.c:2793 run_intel_compute_kernel_preempt() #3 ../lib/intel_compute.c:2522 xe2lpg_compute_preempt_exec() #3 ../lib/intel_compute.c:2522 xe2lpg_compute_preempt_exec() #3 ../lib/intel_compute.c:2522 xe2lpg_compute_preempt_exec() #3 ../lib/intel_compute.c:2522 xe2lpg_compute_preempt_exec() #3 ../lib/intel_compute.c:2522 xe2lpg_compute_preempt_exec() #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #4 ../lib/intel_compute.c:2793 run_intel_compute_kernel_preempt() #6 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() #4 ../lib/intel_compute.c:2793 run_intel_compute_kernel_preempt() #4 ../lib/intel_compute.c:2793 run_intel_compute_kernel_preempt() #7 ../tests/intel/xe_compute_preempt.c:65 main() #4 ../lib/intel_compute.c:2793 run_intel_compute_kernel_preempt() #4 ../lib/intel_compute.c:2793 run_intel_compute_kernel_preempt() #3 ../lib/intel_compute.c:2522 xe2lpg_compute_preempt_exec() #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #4 ../lib/intel_compute.c:2793 run_intel_compute_kernel_preempt() #6 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() #7 ../tests/intel/xe_compute_preempt.c:65 main() #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #6 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() #6 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() #6 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() #7 ../tests/intel/xe_compute_preempt.c:65 main() #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #7 ../tests/intel/xe_compute_preempt.c:65 main() #7 ../tests/intel/xe_compute_preempt.c:65 main() #6 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #7 ../tests/intel/xe_compute_preempt.c:65 main() #6 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() #7 ../tests/intel/xe_compute_preempt.c:65 main() #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #6 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() #7 ../tests/intel/xe_compute_preempt.c:65 main() #8 [__libc_init_first+0x8a] #8 [__libc_init_first+0x8a] #8 [__libc_init_first+0x8a] #8 [__libc_init_first+0x8a] #8 [__libc_init_first+0x8a] #8 [__libc_init_first+0x8a] #9 [__libc_start_main+0x8b] #9 [__libc_start_main+0x8b] #9 [__libc_start_main+0x8b] #8 [__libc_init_first+0x8a] #8 [__libc_init_first+0x8a] #8 [__libc_init_first+0x8a] #8 [__libc_init_first+0x8a] #10 [_start+0x25] #10 [_start+0x25] #10 [_start+0x25] Stack trace: #0 ../lib/igt_core.c:2075 __igt_fail_assert() #1 [xe_wait_ufence+0x57] #2 ../lib/intel_compute.c:418 bo_execenv_sync() Stack trace: #0 ../lib/igt_core.c:2075 __igt_fail_assert() #1 [xe_wait_ufence+0x57] #2 ../lib/intel_compute.c:418 bo_execenv_sync() Stack trace: Stack trace: Stack trace: Stack trace: Stack trace: Stack trace: #0 ../lib/igt_core.c:2075 __igt_fail_assert() Stack trace: Stack trace: Stack trace: #1 [xe_wait_ufence+0x57] Stack trace: Stack trace: #2 ../lib/intel_compute.c:418 bo_execenv_sync() #0 ../lib/igt_core.c:2075 __igt_fail_assert() #0 ../lib/igt_core.c:2075 __igt_fail_assert() #0 ../lib/igt_core.c:2075 __igt_fail_assert() #0 ../lib/igt_core.c:2075 __igt_fail_assert() Stack trace: Stack trace: #0 ../lib/igt_core.c:2075 __igt_fail_assert() #3 ../lib/intel_compute.c:2522 xe2lpg_compute_preempt_exec() #4 ../lib/intel_compute.c:2793 run_intel_compute_kernel_preempt() #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #6 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() #7 ../tests/intel/xe_compute_preempt.c:65 main() #1 [xe_wait_ufence+0x57] #1 [xe_wait_ufence+0x57] #0 ../lib/igt_core.c:2075 __igt_fail_assert() #2 ../lib/intel_compute.c:418 bo_execenv_sync() #0 ../lib/igt_core.c:2075 __igt_fail_assert() #1 [xe_wait_ufence+0x57] #0 ../lib/igt_core.c:2075 __igt_fail_assert() #3 ../lib/intel_compute.c:2522 xe2lpg_compute_preempt_exec() #4 ../lib/intel_compute.c:2793 run_intel_compute_kernel_preempt() #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #6 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() #7 ../tests/intel/xe_compute_preempt.c:65 main() #1 [xe_wait_ufence+0x57] #1 [xe_wait_ufence+0x57] #1 [xe_wait_ufence+0x57] #2 ../lib/intel_compute.c:418 bo_execenv_sync() #3 ../lib/intel_compute.c:2522 xe2lpg_compute_preempt_exec() #4 ../lib/intel_compute.c:2793 run_intel_compute_kernel_preempt() #2 ../lib/intel_compute.c:418 bo_execenv_sync() #3 ../lib/intel_compute.c:2522 xe2lpg_compute_preempt_exec() #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #6 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() #4 ../lib/intel_compute.c:2793 run_intel_compute_kernel_preempt() #7 ../tests/intel/xe_compute_preempt.c:65 main() #2 ../lib/intel_compute.c:418 bo_execenv_sync() #0 ../lib/igt_core.c:2075 __igt_fail_assert() #3 ../lib/intel_compute.c:2522 xe2lpg_compute_preempt_exec() #4 ../lib/intel_compute.c:2793 run_intel_compute_kernel_preempt() #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #6 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() #7 ../tests/intel/xe_compute_preempt.c:65 main() #0 ../lib/igt_core.c:2075 __igt_fail_assert() #0 ../lib/igt_core.c:2075 __igt_fail_assert() #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #6 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() #7 ../tests/intel/xe_compute_preempt.c:65 main() Stack trace: #1 [xe_wait_ufence+0x57] #1 [xe_wait_ufence+0x57] #1 [xe_wait_ufence+0x57] #1 [xe_wait_ufence+0x57] #8 [__libc_init_first+0x8a] #2 ../lib/intel_compute.c:418 bo_execenv_sync() #3 ../lib/intel_compute.c:2522 xe2lpg_compute_preempt_exec() #1 [xe_wait_ufence+0x57] #4 ../lib/intel_compute.c:2793 run_intel_compute_kernel_preempt() #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #6 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() #7 ../tests/intel/xe_compute_preempt.c:65 main() #8 [__libc_init_first+0x8a] #2 ../lib/intel_compute.c:418 bo_execenv_sync() #9 [__libc_start_main+0x8b] #3 ../lib/intel_compute.c:2522 xe2lpg_compute_preempt_exec() #8 [__libc_init_first+0x8a] #4 ../lib/intel_compute.c:2793 run_intel_compute_kernel_preempt() #10 [_start+0x25] #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #6 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() #7 ../tests/intel/xe_compute_preempt.c:65 main() #0 ../lib/igt_core.c:2075 __igt_fail_assert() #9 [__libc_start_main+0x8b] Stack trace: #0 ../lib/igt_core.c:2075 __igt_fail_assert() Stack trace: Stack trace: Stack trace: Stack trace: Stack trace: #0 ../lib/igt_core.c:2075 __igt_fail_assert() #0 ../lib/igt_core.c:2075 __igt_fail_assert() #0 ../lib/igt_core.c:2075 __igt_fail_assert() #1 ../lib/intel_compute.c:2529 xe2lpg_compute_preempt_exec() #2 ../lib/intel_compute.c:2793 run_intel_compute_kernel_preempt() #3 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #4 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() #5 ../tests/intel/xe_compute_preempt.c:65 main() #0 ../lib/igt_core.c:2075 __igt_fail_assert() #0 ../lib/igt_core.c:2075 __igt_fail_assert() #1 [xe2lpg_compute_preempt_exec+0x796] #2 ../lib/intel_compute.c:2793 run_intel_compute_kernel_preempt() #1 [xe2lpg_compute_preempt_exec+0x796] #2 ../lib/intel_compute.c:2793 run_intel_compute_kernel_preempt() #3 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #4 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() #5 ../tests/intel/xe_compute_preempt.c:65 main() #3 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #4 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() #5 ../tests/intel/xe_compute_preempt.c:65 main() #6 [__libc_init_first+0x8a] #1 [xe2lpg_compute_preempt_exec+0x796] #2 ../lib/intel_compute.c:2793 run_intel_compute_kernel_preempt() #6 [__libc_init_first+0x8a] #6 [__libc_init_first+0x8a] #1 [xe2lpg_compute_preempt_exec+0x796] #7 [__libc_start_main+0x8b] #2 ../lib/intel_compute.c:2793 run_intel_compute_kernel_preempt() #3 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #4 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() #5 ../tests/intel/xe_compute_preempt.c:65 main() #8 [_start+0x25] #3 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #4 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() #5 ../tests/intel/xe_compute_preempt.c:65 main() #7 [__libc_start_main+0x8b] #7 [__libc_start_main+0x8b] #8 [_start+0x25] #8 [_start+0x25] #2 ../lib/intel_compute.c:418 bo_execenv_sync() #2 ../lib/intel_compute.c:418 bo_execenv_sync() Dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE: FAIL (7.649s) Subtest compute-preempt-many-vram-evict: FAIL (7.652s) This test caused an abort condition: Kernel badly tainted (0x244, 0x200) (check dmesg for details): TAINT_WARN: WARN_ON has happened.
Err	Starting subtest: compute-preempt-many-vram-evict Starting dynamic subtest: engine-DRM_XE_ENGINE_CLASS_COMPUTE (xe_compute_preempt:3890) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3890) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3890) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3890) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:3860) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3860) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3860) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3899) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3899) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3860) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:3899) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3899) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:3855) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3855) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3855) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3855) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:3920) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3920) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3920) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3920) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:3875) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3875) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3865) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3875) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3885) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3885) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3865) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3875) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:3850) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3910) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3850) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3910) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3885) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3865) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3850) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3910) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3885) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:3850) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:3910) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:3865) xe/xe_ioctl-CRITICAL: error: -5 != 0 Dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE failed. Dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE failed. ** DEBUG DEBUG (xe_compute_preempt:3849) DEBUG: VRAM: 12216, child count: 73 (xe_compute_preempt:3849) DEBUG: VRAM: 12216, child count: 73 (xe_compute_preempt:3890) intel_compute-DEBUG: [i: 0 name: instr state base] data: 0x7e0a01812000, addr: 83e0000, size: 1000 Dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE failed. (xe_compute_preempt:3860) intel_compute-DEBUG: [i: 0 name: instr state base] data: 0x7e0a01812000, addr: 83e0000, size: 1000 (xe_compute_preempt:3890) intel_compute-DEBUG: [i: 1 name: dynamic state base] data: 0x7e09ff3cc000, addr: 300000, size: 100000 DEBUG (xe_compute_preempt:3860) intel_compute-DEBUG: [i: 1 name: dynamic state base] data: 0x7e09ff3cc000, addr: 300000, size: 100000 (xe_compute_preempt:3890) intel_compute-DEBUG: [i: 2 name: surface state base] data: 0x7e09ff3bc000, addr: 200000, size: 10000 (xe_compute_preempt:3849) DEBUG: VRAM: 12216, child count: 73 (xe_compute_preempt:3860) intel_compute-DEBUG: [i: 2 name: surface state base] data: 0x7e09ff3bc000, addr: 200000, size: 10000 (xe_compute_preempt:3890) intel_compute-DEBUG: [i: 3 name: indirect object base] data: 0x7e09ff3ac000, addr: 63d0000, size: 10000 (xe_compute_preempt:3865) intel_compute-DEBUG: [i: 0 name: instr state base] data: 0x7e0a01812000, addr: 83e0000, size: 1000 (xe_compute_preempt:3860) intel_compute-DEBUG: [i: 3 name: indirect object base] data: 0x7e09ff3ac000, addr: 63d0000, size: 10000 (xe_compute_preempt:3890) intel_compute-DEBUG: [i: 4 name: addr input] data: 0x7e09ff39c000, addr: 40000000, size: 10000 (xe_compute_preempt:3865) intel_compute-DEBUG: [i: 1 name: dynamic state base] data: 0x7e09ff3cc000, addr: 300000, size: 100000 (xe_compute_preempt:3860) intel_compute-DEBUG: [i: 4 name: addr input] data: 0x7e09ff39c000, addr: 40000000, size: 10000 (xe_compute_preempt:3890) intel_compute-DEBUG: [i: 5 name: addr output] data: 0x7e09ff38c000, addr: 80000000, size: 10000 (xe_compute_preempt:3865) intel_compute-DEBUG: [i: 2 name: surface state base] data: 0x7e09ff3bc000, addr: 200000, size: 10000 (xe_compute_preempt:3860) intel_compute-DEBUG: [i: 5 name: addr output] data: 0x7e09ff38c000, addr: 80000000, size: 10000 (xe_compute_preempt:3890) intel_compute-DEBUG: [i: 6 name: general state base] data: 0x7e09ff28c000, addr: 6000000, size: 100000 (xe_compute_preempt:3865) intel_compute-DEBUG: [i: 3 name: indirect object base] data: 0x7e09ff3ac000, addr: 63d0000, size: 10000 (xe_compute_preempt:3860) intel_compute-DEBUG: [i: 6 name: general state base] data: 0x7e09ff28c000, addr: 6000000, size: 100000 (xe_compute_preempt:3890) intel_compute-DEBUG: [i: 7 name: binding table] data: 0x7e09ff27c000, addr: 210000, size: 10000 (xe_compute_preempt:3865) intel_compute-DEBUG: [i: 4 name: addr input] data: 0x7e09ff39c000, addr: 40000000, size: 10000 (xe_compute_preempt:3860) intel_compute-DEBUG: [i: 7 name: binding table] data: 0x7e09ff27c000, addr: 210000, size: 10000 (xe_compute_preempt:3890) intel_compute-DEBUG: [i: 8 name: batch] data: 0x7e09ff26c000, addr: 100000, size: 10000 (xe_compute_preempt:3865) intel_compute-DEBUG: [i: 5 name: addr output] data: 0x7e09ff38c000, addr: 80000000, size: 10000 (xe_compute_preempt:3860) intel_compute-DEBUG: [i: 8 name: batch] data: 0x7e09ff26c000, addr: 100000, size: 10000 (xe_compute_preempt:3890) intel_compute-DEBUG: [i: 9 name: state context data base] data: 0x7e09f8e6c000, addr: 9000000, size: 6400000 (xe_compute_preempt:3865) intel_compute-DEBUG: [i: 6 name: general state base] data: 0x7e09ff28c000, addr: 6000000, size: 100000 (xe_compute_preempt:3860) intel_compute-DEBUG: [i: 9 name: state context data base] data: 0x7e09f8e6c000, addr: 9000000, size: 6400000 (xe_compute_preempt:3890) intel_compute-DEBUG: [i: 10 name: sip kernel] data: 0x7e09f8e64000, addr: 107ff0000, size: 8000 (xe_compute_preempt:3865) intel_compute-DEBUG: [i: 7 name: binding table] data: 0x7e09ff27c000, addr: 210000, size: 10000 (xe_compute_preempt:3860) intel_compute-DEBUG: [i: 10 name: sip kernel] data: 0x7e09f8e64000, addr: 107ff0000, size: 8000 (xe_compute_preempt:3890) intel_compute-DEBUG: [i: 0 name: instr state base] data: 0x7e09f8e63000, addr: 83e0000, size: 1000 (xe_compute_preempt:3865) intel_compute-DEBUG: [i: 8 name: batch] data: 0x7e09ff26c000, addr: 100000, size: 10000 (xe_compute_preempt:3860) intel_compute-DEBUG: [i: 0 name: instr state base] data: 0x7e09f8e63000, addr: 83e0000, size: 1000 (xe_compute_preempt:3890) intel_compute-DEBUG: [i: 1 name: dynamic state base] data: 0x7e09f8d63000, addr: 300000, size: 100000 (xe_compute_preempt:3865) intel_compute-DEBUG: [i: 9 name: state context data base] data: 0x7e09f8e6c000, addr: 9000000, size: 6400000 (xe_compute_preempt:3860) intel_compute-DEBUG: [i: 1 name: dynamic state base] data: 0x7e09f8d63000, addr: 300000, size: 100000 (xe_compute_preempt:3890) intel_compute-DEBUG: [i: 2 name: surface state base] data: 0x7e09f8d53000, addr: 200000, size: 10000 (xe_compute_preempt:3865) intel_compute-DEBUG: [i: 10 name: sip kernel] data: 0x7e09f8e64000, addr: 107ff0000, size: 8000 (xe_compute_preempt:3860) intel_compute-DEBUG: [i: 2 name: surface state base] data: 0x7e09f8d53000, addr: 200000, size: 10000 (xe_compute_preempt:3890) intel_compute-DEBUG: [i: 3 name: indirect object base] data: 0x7e09f8d43000, addr: 63d0000, size: 10000 (xe_compute_preempt:3865) intel_compute-DEBUG: [i: 0 name: instr state base] data: 0x7e09f8e63000, addr: 83e0000, size: 1000 (xe_compute_preempt:3860) intel_compute-DEBUG: [i: 3 name: indirect object base] data: 0x7e09f8d43000, addr: 63d0000, size: 10000 (xe_compute_preempt:3890) intel_compute-DEBUG: [i: 4 name: addr input] data: 0x7e09f8d33000, addr: 40000000, size: 10000 (xe_compute_preempt:3865) intel_compute-DEBUG: [i: 1 name: dynamic state base] data: 0x7e09f8d63000, addr: 300000, size: 100000 (xe_compute_preempt:3860) intel_compute-DEBUG: [i: 4 name: addr input] data: 0x7e09f8d33000, addr: 40000000, size: 10000 (xe_compute_preempt:3890) intel_compute-DEBUG: [i: 5 name: addr output] data: 0x7e09f8d23000, addr: 80000000, size: 10000 (xe_compute_preempt:3865) intel_compute-DEBUG: [i: 2 name: surface state base] data: 0x7e09f8d53000, addr: 200000, size: 10000 (xe_compute_preempt:3860) intel_compute-DEBUG: [i: 5 name: addr output] data: 0x7e09f8d23000, addr: 80000000, size: 10000 (xe_compute_preempt:3890) intel_compute-DEBUG: [i: 6 name: general state base] data: 0x7e09f8c23000, addr: 6000000, size: 100000 (xe_compute_preempt:3865) intel_compute-DEBUG: [i: 3 name: indirect object base] data: 0x7e09f8d43000, addr: 63d0000, size: 10000 (xe_compute_preempt:3860) intel_compute-DEBUG: [i: 6 name: general state base] data: 0x7e09f8c23000, addr: 6000000, size: 100000 (xe_compute_preempt:3890) intel_compute-DEBUG: [i: 7 name: binding table] data: 0x7e09f8c13000, addr: 210000, size: 10000 (xe_compute_preempt:3865) intel_compute-DEBUG: [i: 4 name: addr input] data: 0x7e09f8d33000, addr: 40000000, size: 10000 (xe_compute_preempt:3860) intel_compute-DEBUG: [i: 7 name: binding table] data: 0x7e09f8c13000, addr: 210000, size: 10000 (xe_compute_preempt:3890) intel_compute-DEBUG: [i: 8 name: batch] data: 0x7e09f8c03000, addr: 100000, size: 10000 (xe_compute_preempt:3865) intel_compute-DEBUG: [i: 5 name: addr output] data: 0x7e09f8d23000, addr: 80000000, size: 10000 (xe_compute_preempt:3860) intel_compute-DEBUG: [i: 8 name: batch] data: 0x7e09f8c03000, addr: 100000, size: 10000 (xe_compute_preempt:3890) intel_compute-DEBUG: [i: 9 name: state context data base] data: 0x7e09f2803000, addr: 9000000, size: 6400000 (xe_compute_preempt:3865) intel_compute-DEBUG: [i: 6 name: general state base] data: 0x7e09f8c23000, addr: 6000000, size: 100000 (xe_compute_preempt:3860) intel_compute-DEBUG: [i: 9 name: state context data base] data: 0x7e09f2803000, addr: 9000000, size: 6400000 (xe_compute_preempt:3890) intel_compute-DEBUG: [i: 10 name: sip kernel] data: 0x7e09f27fb000, addr: 107ff0000, size: 8000 (xe_compute_preempt:3865) intel_compute-DEBUG: [i: 7 name: binding table] data: 0x7e09f8c13000, addr: 210000, size: 10000 (xe_compute_preempt:3860) intel_compute-DEBUG: [i: 10 name: sip kernel] data: 0x7e09f27fb000, addr: 107ff0000, size: 8000 (xe_compute_preempt:3890) intel_compute-DEBUG: general state base: 6000000 (xe_compute_preempt:3865) intel_compute-DEBUG: [i: 8 name: batch] data: 0x7e09f8c03000, addr: 100000, size: 10000 (xe_compute_preempt:3890) intel_compute-DEBUG: surface state base: 200000 (xe_compute_preempt:3860) intel_compute-DEBUG: general state base: 6000000 (xe_compute_preempt:3865) intel_compute-DEBUG: [i: 9 name: state context data base] data: 0x7e09f2803000, addr: 9000000, size: 6400000 (xe_compute_preempt:3890) intel_compute-DEBUG: dynamic state base: 300000 (xe_compute_preempt:3860) intel_compute-DEBUG: surface state base: 200000 (xe_compute_preempt:3865) intel_compute-DEBUG: [i: 10 name: sip kernel] data: 0x7e09f27fb000, addr: 107ff0000, size: 8000 (xe_compute_preempt:3890) intel_compute-DEBUG: instruct base addr: 8000000 (xe_compute_preempt:3860) intel_compute-DEBUG: dynamic state base: 300000 (xe_compute_preempt:3865) intel_compute-DEBUG: general state base: 6000000 (xe_compute_preempt:3890) intel_compute-DEBUG: bindless base addr: 200000 (xe_compute_preempt:3860) intel_compute-DEBUG: instruct base addr: 8000000 (xe_compute_preempt:3865) intel_compute-DEBUG: surface state base: 200000 (xe_compute_preempt:3890) intel_compute-DEBUG: state context data base addr: 9000000 (xe_compute_preempt:3860) intel_compute-DEBUG: bindless base addr: 200000 (xe_compute_preempt:3865) intel_compute-DEBUG: dynamic state base: 300000 (xe_compute_preempt:3890) intel_compute-DEBUG: offset indirect addr: 3d0000 (xe_compute_preempt:3860) intel_compute-DEBUG: state context data base addr: 9000000 (xe_compute_preempt:3890) intel_compute-DEBUG: kernel start pointer: 3e0000 (xe_compute_preempt:3865) intel_compute-DEBUG: instruct base addr: 8000000 (xe_compute_preempt:3860) intel_compute-DEBUG: offset indirect addr: 3d0000 (xe_compute_preempt:3890) intel_compute-DEBUG: sip start pointer: ffff0000 (xe_compute_preempt:3865) intel_compute-DEBUG: bindless base addr: 200000 (xe_compute_preempt:3860) intel_compute-DEBUG: kernel start pointer: 3e0000 (xe_compute_preempt:3890) intel_compute-DEBUG: general state base: 6000000 (xe_compute_preempt:3865) intel_compute-DEBUG: state context data base addr: 9000000 (xe_compute_preempt:3860) intel_compute-DEBUG: sip start pointer: ffff0000 (xe_compute_preempt:3890) intel_compute-DEBUG: surface state base: 200000 (xe_compute_preempt:3865) intel_compute-DEBUG: offset indirect addr: 3d0000 (xe_compute_preempt:3860) intel_compute-DEBUG: general state base: 6000000 (xe_compute_preempt:3890) intel_compute-DEBUG: dynamic state base: 300000 (xe_compute_preempt:3865) intel_compute-DEBUG: kernel start pointer: 3e0000 (xe_compute_preempt:3860) intel_compute-DEBUG: surface state base: 200000 (xe_compute_preempt:3890) intel_compute-DEBUG: instruct base addr: 8000000 (xe_compute_preempt:3865) intel_compute-DEBUG: sip start pointer: ffff0000 (xe_compute_preempt:3860) intel_compute-DEBUG: dynamic state base: 300000 (xe_compute_preempt:3890) intel_compute-DEBUG: bindless base addr: 200000 (xe_compute_preempt:3865) intel_compute-DEBUG: general state base: 6000000 (xe_compute_preempt:3860) intel_compute-DEBUG: instruct base addr: 8000000 (xe_compute_preempt:3890) intel_compute-DEBUG: state context data base addr: 9000000 (xe_compute_preempt:3865) intel_compute-DEBUG: surface state base: 200000 (xe_compute_preempt:3860) intel_compute-DEBUG: bindless base addr: 200000 (xe_compute_preempt:3890) intel_compute-DEBUG: offset indirect addr: 3d0000 (xe_compute_preempt:3865) intel_compute-DEBUG: dynamic state base: 300000 (xe_compute_preempt:3860) intel_compute-DEBUG: state context data base addr: 9000000 (xe_compute_preempt:3890) intel_compute-DEBUG: kernel start pointer: 3e0000 (xe_compute_preempt:3865) intel_compute-DEBUG: instruct base addr: 8000000 (xe_compute_preempt:3860) intel_compute-DEBUG: offset indirect addr: 3d0000 (xe_compute_preempt:3890) intel_compute-DEBUG: sip start pointer: ffff0000 (xe_compute_preempt:3865) intel_compute-DEBUG: bindless base addr: 200000 (xe_compute_preempt:3860) intel_compute-DEBUG: kernel start pointer: 3e0000 (xe_compute_preempt:3890) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3865) intel_compute-DEBUG: state context data base addr: 9000000 (xe_compute_preempt:3860) intel_compute-DEBUG: sip start pointer: ffff0000 (xe_compute_preempt:3890) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3865) intel_compute-DEBUG: offset indirect addr: 3d0000 (xe_compute_preempt:3860) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3890) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3865) intel_compute-DEBUG: kernel start pointer: 3e0000 (xe_compute_preempt:3860) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3890) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:3865) intel_compute-DEBUG: sip start pointer: ffff0000 (xe_compute_preempt:3860) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3890) igt_core-INFO: Stack trace: (xe_compute_preempt:3944) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3944) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3940) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3940) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3947) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3947) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3940) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3940) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:3947) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3932) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3932) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:4006) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:4006) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:4006) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3880) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3880) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3880) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3957) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3957) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3957) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3989) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3989) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3989) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3989) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:4013) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:4013) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3905) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3905) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:4013) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:4015) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:4015) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:4015) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:4015) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:3895) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3895) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3965) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3965) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3965) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3965) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:4127) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:4127) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:4127) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:4127) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:4079) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:4079) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:4079) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:4079) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:3950) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3950) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3950) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3950) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:4049) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:4090) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:4090) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:4049) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:4090) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:4049) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:4090) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:4049) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:3925) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3925) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3983) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3983) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3983) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3983) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:4070) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:4070) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:4070) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:4070) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:4004) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:4004) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3925) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:4004) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3925) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:4004) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:3970) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3915) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3970) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3915) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3915) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3970) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3915) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:3970) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:4137) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:4137) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3964) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:4137) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3964) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:4137) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:3964) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3964) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:3930) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:3930) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:3930) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:3930) xe/xe_ioctl-CRITICAL: error: -5 != 0 Dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE failed. DEBUG ** (xe_compute_preempt:3849) DEBUG: VRAM: 12216, child count: 73 (xe_compute_preempt:4079) intel_compute-DEBUG: [i: 0 name: instr state base] data: 0x7e0a01812000, addr: 83e0000, size: 1000 (xe_compute_preempt:4079) intel_compute-DEBUG: [i: 1 name: dynamic state base] data: 0x7e09ff3cc000, addr: 300000, size: 100000 (xe_compute_preempt:4079) intel_compute-DEBUG: [i: 2 name: surface state base] data: 0x7e09ff3bc000, addr: 200000, size: 10000 (xe_compute_preempt:4079) intel_compute-DEBUG: [i: 3 name: indirect object base] data: 0x7e09ff3ac000, addr: 63d0000, size: 10000 (xe_compute_preempt:4079) intel_compute-DEBUG: [i: 4 name: addr input] data: 0x7e09ff39c000, addr: 40000000, size: 10000 (xe_compute_preempt:4079) intel_compute-DEBUG: [i: 5 name: addr output] data: 0x7e09ff38c000, addr: 80000000, size: 10000 (xe_compute_preempt:4079) intel_compute-DEBUG: [i: 6 name: general state base] data: 0x7e09ff28c000, addr: 6000000, size: 100000 (xe_compute_preempt:4079) intel_compute-DEBUG: [i: 7 name: binding table] data: 0x7e09ff27c000, addr: 210000, size: 10000 (xe_compute_preempt:4079) intel_compute-DEBUG: [i: 8 name: batch] data: 0x7e09ff26c000, addr: 100000, size: 10000 (xe_compute_preempt:4079) intel_compute-DEBUG: [i: 9 name: state context data base] data: 0x7e09f8e6c000, addr: 9000000, size: 6400000 (xe_compute_preempt:4079) intel_compute-DEBUG: [i: 10 name: sip kernel] data: 0x7e09f8e64000, addr: 107ff0000, size: 8000 (xe_compute_preempt:4079) intel_compute-DEBUG: [i: 0 name: instr state base] data: 0x7e09f8e63000, addr: 83e0000, size: 1000 (xe_compute_preempt:4079) intel_compute-DEBUG: [i: 1 name: dynamic state base] data: 0x7e09f8d63000, addr: 300000, size: 100000 (xe_compute_preempt:4079) intel_compute-DEBUG: [i: 2 name: surface state base] data: 0x7e09f8d53000, addr: 200000, size: 10000 (xe_compute_preempt:4079) intel_compute-DEBUG: [i: 3 name: indirect object base] data: 0x7e09f8d43000, addr: 63d0000, size: 10000 (xe_compute_preempt:4079) intel_compute-DEBUG: [i: 4 name: addr input] data: 0x7e09f8d33000, addr: 40000000, size: 10000 (xe_compute_preempt:4079) intel_compute-DEBUG: [i: 5 name: addr output] data: 0x7e09f8d23000, addr: 80000000, size: 10000 (xe_compute_preempt:4079) intel_compute-DEBUG: [i: 6 name: general state base] data: 0x7e09f8c23000, addr: 6000000, size: 100000 (xe_compute_preempt:4079) intel_compute-DEBUG: [i: 7 name: binding table] data: 0x7e09f8c13000, addr: 210000, size: 10000 (xe_compute_preempt:4079) intel_compute-DEBUG: [i: 8 name: batch] data: 0x7e09f8c03000, addr: 100000, size: 10000 (xe_compute_preempt:4079) intel_compute-DEBUG: [i: 9 name: state context data base] data: 0x7e09f2803000, addr: 9000000, size: 6400000 (xe_compute_preempt:4079) intel_compute-DEBUG: [i: 10 name: sip kernel] data: 0x7e09f27fb000, addr: 107ff0000, size: 8000 (xe_compute_preempt:4079) intel_compute-DEBUG: general state base: 6000000 (xe_compute_preempt:4079) intel_compute-DEBUG: surface state base: 200000 (xe_compute_preempt:4079) intel_compute-DEBUG: dynamic state base: 300000 (xe_compute_preempt:4079) intel_compute-DEBUG: instruct base addr: 8000000 (xe_compute_preempt:4079) intel_compute-DEBUG: bindless base addr: 200000 (xe_compute_preempt:4079) intel_compute-DEBUG: state context data base addr: 9000000 (xe_compute_preempt:4079) intel_compute-DEBUG: offset indirect addr: 3d0000 (xe_compute_preempt:4079) intel_compute-DEBUG: kernel start pointer: 3e0000 (xe_compute_preempt:4079) intel_compute-DEBUG: sip start pointer: ffff0000 (xe_compute_preempt:4079) intel_compute-DEBUG: general state base: 6000000 (xe_compute_preempt:4079) intel_compute-DEBUG: surface state base: 200000 (xe_compute_preempt:4079) intel_compute-DEBUG: dynamic state base: 300000 (xe_compute_preempt:4079) intel_compute-DEBUG: instruct base addr: 8000000 (xe_compute_preempt:4079) intel_compute-DEBUG: bindless base addr: 200000 (xe_compute_preempt:4079) intel_compute-DEBUG: state context data base addr: 9000000 (xe_compute_preempt:4079) intel_compute-DEBUG: offset indirect addr: 3d0000 (xe_compute_preempt:4079) intel_compute-DEBUG: kernel start pointer: 3e0000 (xe_compute_preempt:4079) intel_compute-DEBUG: sip start pointer: ffff0000 (xe_compute_preempt:4079) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:4079) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:4079) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:4079) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:4079) igt_core-INFO: Stack trace: (xe_compute_preempt:4079) igt_core-INFO: #0 ../lib/igt_core.c:2075 __igt_fail_assert() (xe_compute_preempt:4079) igt_core-INFO: #1 [xe_wait_ufence+0x57] (xe_compute_preempt:4047) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:4047) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:4047) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:4047) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:4151) intel_compute-CRITICAL: Test assertion failure function xe2lpg_compute_preempt_exec, file ../lib/intel_compute.c:2513: (xe_compute_preempt:4151) intel_compute-CRITICAL: Failed assertion: 0 != __xe_wait_ufence(fd, &execenv_long.bo_sync->sync, 0xdeadbeefdeadbeefull, execenv_long.exec_queue, &timeout_one_ns) (xe_compute_preempt:4151) intel_compute-CRITICAL: error: 0 == 0 (xe_compute_preempt:4109) intel_compute-CRITICAL: Test assertion failure function xe2lpg_compute_preempt_exec, file ../lib/intel_compute.c:2513: (xe_compute_preempt:4109) intel_compute-CRITICAL: Failed assertion: 0 != __xe_wait_ufence(fd, &execenv_long.bo_sync->sync, 0xdeadbeefdeadbeefull, execenv_long.exec_queue, &timeout_one_ns) (xe_compute_preempt:4000) intel_compute-CRITICAL: Test assertion failure function xe2lpg_compute_preempt_exec, file ../lib/intel_compute.c:2513: (xe_compute_preempt:4000) intel_compute-CRITICAL: Failed assertion: 0 != __xe_wait_ufence(fd, &execenv_long.bo_sync->sync, 0xdeadbeefdeadbeefull, execenv_long.exec_queue, &timeout_one_ns) (xe_compute_preempt:4109) intel_compute-CRITICAL: error: 0 == 0 (xe_compute_preempt:4000) intel_compute-CRITICAL: error: 0 == 0 (xe_compute_preempt:4044) intel_compute-CRITICAL: Test assertion failure function xe2lpg_compute_preempt_exec, file ../lib/intel_compute.c:2510: (xe_compute_preempt:4044) intel_compute-CRITICAL: Failed assertion: 0xabcdabcdcdefcdefull != post_data (xe_compute_preempt:4044) intel_compute-CRITICAL: error: 0xabcdabcdcdefcdef == 0xabcdabcdcdefcdef (xe_compute_preempt:4012) intel_compute-CRITICAL: Test assertion failure function xe2lpg_compute_preempt_exec, file ../lib/intel_compute.c:2513: (xe_compute_preempt:4012) intel_compute-CRITICAL: Failed assertion: 0 != __xe_wait_ufence(fd, &execenv_long.bo_sync->sync, 0xdeadbeefdeadbeefull, execenv_long.exec_queue, &timeout_one_ns) (xe_compute_preempt:4012) intel_compute-CRITICAL: error: 0 == 0 Dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE failed. * DEBUG ** (xe_compute_preempt:3849) DEBUG: VRAM: 12216, child count: 73 (xe_compute_preempt:4044) intel_compute-DEBUG: [i: 0 name: instr state base] data: 0x7e0a01812000, addr: 83e0000, size: 1000 (xe_compute_preempt:4044) intel_compute-DEBUG: [i: 1 name: dynamic state base] data: 0x7e09ff3cc000, addr: 300000, size: 100000 (xe_compute_preempt:4044) intel_compute-DEBUG: [i: 2 name: surface state base] data: 0x7e09ff3bc000, addr: 200000, size: 10000 (xe_compute_preempt:4044) intel_compute-DEBUG: [i: 3 name: indirect object base] data: 0x7e09ff3ac000, addr: 63d0000, size: 10000 (xe_compute_preempt:4044) intel_compute-DEBUG: [i: 4 name: addr input] data: 0x7e09ff39c000, addr: 40000000, size: 10000 (xe_compute_preempt:4044) intel_compute-DEBUG: [i: 5 name: addr output] data: 0x7e09ff38c000, addr: 80000000, size: 10000 (xe_compute_preempt:4044) intel_compute-DEBUG: [i: 6 name: general state base] data: 0x7e09ff28c000, addr: 6000000, size: 100000 (xe_compute_preempt:4044) intel_compute-DEBUG: [i: 7 name: binding table] data: 0x7e09ff27c000, addr: 210000, size: 10000 (xe_compute_preempt:4044) intel_compute-DEBUG: [i: 8 name: batch] data: 0x7e09ff26c000, addr: 100000, size: 10000 (xe_compute_preempt:4044) intel_compute-DEBUG: [i: 9 name: state context data base] data: 0x7e09f8e6c000, addr: 9000000, size: 6400000 (xe_compute_preempt:4044) intel_compute-DEBUG: [i: 10 name: sip kernel] data: 0x7e09f8e64000, addr: 107ff0000, size: 8000 (xe_compute_preempt:4044) intel_compute-DEBUG: [i: 0 name: instr state base] data: 0x7e09f8e63000, addr: 83e0000, size: 1000 (xe_compute_preempt:4044) intel_compute-DEBUG: [i: 1 name: dynamic state base] data: 0x7e09f8d63000, addr: 300000, size: 100000 (xe_compute_preempt:4044) intel_compute-DEBUG: [i: 2 name: surface state base] data: 0x7e09f8d53000, addr: 200000, size: 10000 (xe_compute_preempt:4044) intel_compute-DEBUG: [i: 3 name: indirect object base] data: 0x7e09f8d43000, addr: 63d0000, size: 10000 (xe_compute_preempt:4044) intel_compute-DEBUG: [i: 4 name: addr input] data: 0x7e09f8d33000, addr: 40000000, size: 10000 (xe_compute_preempt:4044) intel_compute-DEBUG: [i: 5 name: addr output] data: 0x7e09f8d23000, addr: 80000000, size: 10000 (xe_compute_preempt:4044) intel_compute-DEBUG: [i: 6 name: general state base] data: 0x7e09f8c23000, addr: 6000000, size: 100000 (xe_compute_preempt:4044) intel_compute-DEBUG: [i: 7 name: binding table] data: 0x7e09f8c13000, addr: 210000, size: 10000 (xe_compute_preempt:4044) intel_compute-DEBUG: [i: 8 name: batch] data: 0x7e09f8c03000, addr: 100000, size: 10000 (xe_compute_preempt:4044) intel_compute-DEBUG: [i: 9 name: state context data base] data: 0x7e09f2803000, addr: 9000000, size: 6400000 (xe_compute_preempt:4044) intel_compute-DEBUG: [i: 10 name: sip kernel] data: 0x7e09f27fb000, addr: 107ff0000, size: 8000 (xe_compute_preempt:4044) intel_compute-DEBUG: general state base: 6000000 (xe_compute_preempt:4044) intel_compute-DEBUG: surface state base: 200000 (xe_compute_preempt:4044) intel_compute-DEBUG: dynamic state base: 300000 (xe_compute_preempt:4044) intel_compute-DEBUG: instruct base addr: 8000000 (xe_compute_preempt:4044) intel_compute-DEBUG: bindless base addr: 200000 (xe_compute_preempt:4044) intel_compute-DEBUG: state context data base addr: 9000000 (xe_compute_preempt:4044) intel_compute-DEBUG: offset indirect addr: 3d0000 (xe_compute_preempt:4044) intel_compute-DEBUG: kernel start pointer: 3e0000 (xe_compute_preempt:4044) intel_compute-DEBUG: sip start pointer: ffff0000 (xe_compute_preempt:4044) intel_compute-DEBUG: general state base: 6000000 (xe_compute_preempt:4044) intel_compute-DEBUG: surface state base: 200000 (xe_compute_preempt:4044) intel_compute-DEBUG: dynamic state base: 300000 (xe_compute_preempt:4044) intel_compute-DEBUG: instruct base addr: 8000000 (xe_compute_preempt:4044) intel_compute-DEBUG: bindless base addr: 200000 (xe_compute_preempt:4044) intel_compute-DEBUG: state context data base addr: 9000000 (xe_compute_preempt:4044) intel_compute-DEBUG: offset indirect addr: 3d0000 (xe_compute_preempt:4044) intel_compute-DEBUG: kernel start pointer: 3e0000 (xe_compute_preempt:4044) intel_compute-DEBUG: sip start pointer: ffff0000 (xe_compute_preempt:4044) intel_compute-CRITICAL: Test assertion failure function xe2lpg_compute_preempt_exec, file ../lib/intel_compute.c:2510: (xe_compute_preempt:4044) intel_compute-CRITICAL: Failed assertion: 0xabcdabcdcdefcdefull != post_data (xe_compute_preempt:4044) intel_compute-CRITICAL: error: 0xabcdabcdcdefcdef == 0xabcdabcdcdefcdef (xe_compute_preempt:4044) igt_core-INFO: Stack trace: (xe_compute_preempt:4044) igt_core-INFO: #0 ../lib/igt_core.c:2075 __igt_fail_assert() (xe_compute_preempt:4044) igt_core-INFO: #1 ../lib/intel_compute.c:2529 xe2lpg_compute_preempt_exec() (xe_compute_preempt:4044) igt_core-INFO: #2 ../lib/intel_compute.c:2793 run_intel_compute_kernel_preempt() (xe_compute_preempt:4044) igt_core-INFO: #3 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() (xe_compute_preempt:4044) igt_core-INFO: #4 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() (xe_compute_preempt:4044) igt_core-INFO: #5 ../tests/intel/xe_compute_preempt.c:65 main() (xe_compute_preempt:4044) igt_core-INFO: #6 [__libc_init_first+0x8a] (xe_compute_preempt:4044) igt_core-INFO: #7 [__libc_start_main+0x8b] (xe_compute_preempt:4044) igt_core-INFO: #8 [_start+0x25] * END Dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE failed. DEBUG (xe_compute_preempt:3849) DEBUG: VRAM: 12216, child count: 73 (xe_compute_preempt:4000) intel_compute-DEBUG: [i: 0 name: instr state base] data: 0x7e0a01812000, addr: 83e0000, size: 1000 (xe_compute_preempt:4000) intel_compute-DEBUG: [i: 1 name: dynamic state base] data: 0x7e09ff3cc000, addr: 300000, size: 100000 (xe_compute_preempt:4000) intel_compute-DEBUG: [i: 2 name: surface state base] data: 0x7e09ff3bc000, addr: 200000, size: 10000 (xe_compute_preempt:4000) intel_compute-DEBUG: [i: 3 name: indirect object base] data: 0x7e09ff3ac000, addr: 63d0000, size: 10000 (xe_compute_preempt:4000) intel_compute-DEBUG: [i: 4 name: addr input] data: 0x7e09ff39c000, addr: 40000000, size: 10000 (xe_compute_preempt:4000) intel_compute-DEBUG: [i: 5 name: addr output] data: 0x7e09ff38c000, addr: 80000000, size: 10000 (xe_compute_preempt:4000) intel_compute-DEBUG: [i: 6 name: general state base] data: 0x7e09ff28c000, addr: 6000000, size: 100000 (xe_compute_preempt:4000) intel_compute-DEBUG: [i: 7 name: binding table] data: 0x7e09ff27c000, addr: 210000, size: 10000 (xe_compute_preempt:4000) intel_compute-DEBUG: [i: 8 name: batch] data: 0x7e09ff26c000, addr: 100000, size: 10000 (xe_compute_preempt:4000) intel_compute-DEBUG: [i: 9 name: state context data base] data: 0x7e09f8e6c000, addr: 9000000, size: 6400000 (xe_compute_preempt:4000) intel_compute-DEBUG: [i: 10 name: sip kernel] data: 0x7e09f8e64000, addr: 107ff0000, size: 8000 (xe_compute_preempt:4000) intel_compute-DEBUG: [i: 0 name: instr state base] data: 0x7e09f8e63000, addr: 83e0000, size: 1000 (xe_compute_preempt:4000) intel_compute-DEBUG: [i: 1 name: dynamic state base] data: 0x7e09f8d63000, addr: 300000, size: 100000 (xe_compute_preempt:4000) intel_compute-DEBUG: [i: 2 name: surface state base] data: 0x7e09f8d53000, addr: 200000, size: 10000 (xe_compute_preempt:4000) intel_compute-DEBUG: [i: 3 name: indirect object base] data: 0x7e09f8d43000, addr: 63d0000, size: 10000 (xe_compute_preempt:4000) intel_compute-DEBUG: [i: 4 name: addr input] data: 0x7e09f8d33000, addr: 40000000, size: 10000 (xe_compute_preempt:4000) intel_compute-DEBUG: [i: 5 name: addr output] data: 0x7e09f8d23000, addr: 80000000, size: 10000 (xe_compute_preempt:4000) intel_compute-DEBUG: [i: 6 name: general state base] data: 0x7e09f8c23000, addr: 6000000, size: 100000 (xe_compute_preempt:4000) intel_compute-DEBUG: [i: 7 name: binding table] data: 0x7e09f8c13000, addr: 210000, size: 10000 (xe_compute_preempt:4000) intel_compute-DEBUG: [i: 8 name: batch] data: 0x7e09f8c03000, addr: 100000, size: 10000 Dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE failed. (xe_compute_preempt:4000) intel_compute-DEBUG: [i: 9 name: state context data base] data: 0x7e09f2803000, addr: 9000000, size: 6400000 DEBUG (xe_compute_preempt:4000) intel_compute-DEBUG: [i: 10 name: sip kernel] data: 0x7e09f27fb000, addr: 107ff0000, size: 8000 (xe_compute_preempt:3849) DEBUG: VRAM: 12216, child count: 73 (xe_compute_preempt:4000) intel_compute-DEBUG: general state base: 6000000 (xe_compute_preempt:4012) intel_compute-DEBUG: [i: 0 name: instr state base] data: 0x7e0a01812000, addr: 83e0000, size: 1000 (xe_compute_preempt:4000) intel_compute-DEBUG: surface state base: 200000 (xe_compute_preempt:4012) intel_compute-DEBUG: [i: 1 name: dynamic state base] data: 0x7e09ff3cc000, addr: 300000, size: 100000 (xe_compute_preempt:4000) intel_compute-DEBUG: dynamic state base: 300000 (xe_compute_preempt:4012) intel_compute-DEBUG: [i: 2 name: surface state base] data: 0x7e09ff3bc000, addr: 200000, size: 10000 (xe_compute_preempt:4000) intel_compute-DEBUG: instruct base addr: 8000000 (xe_compute_preempt:4012) intel_compute-DEBUG: [i: 3 name: indirect object base] data: 0x7e09ff3ac000, addr: 63d0000, size: 10000 (xe_compute_preempt:4000) intel_compute-DEBUG: bindless base addr: 200000 (xe_compute_preempt:4012) intel_compute-DEBUG: [i: 4 name: addr input] data: 0x7e09ff39c000, addr: 40000000, size: 10000 (xe_compute_preempt:4000) intel_compute-DEBUG: state context data base addr: 9000000 (xe_compute_preempt:4012) intel_compute-DEBUG: [i: 5 name: addr output] data: 0x7e09ff38c000, addr: 80000000, size: 10000 (xe_compute_preempt:4000) intel_compute-DEBUG: offset indirect addr: 3d0000 (xe_compute_preempt:4012) intel_compute-DEBUG: [i: 6 name: general state base] data: 0x7e09ff28c000, addr: 6000000, size: 100000 (xe_compute_preempt:4000) intel_compute-DEBUG: kernel start pointer: 3e0000 (xe_compute_preempt:4012) intel_compute-DEBUG: [i: 7 name: binding table] data: 0x7e09ff27c000, addr: 210000, size: 10000 (xe_compute_preempt:4000) intel_compute-DEBUG: sip start pointer: ffff0000 (xe_compute_preempt:4012) intel_compute-DEBUG: [i: 8 name: batch] data: 0x7e09ff26c000, addr: 100000, size: 10000 (xe_compute_preempt:4000) intel_compute-DEBUG: general state base: 6000000 (xe_compute_preempt:4012) intel_compute-DEBUG: [i: 9 name: state context data base] data: 0x7e09f8e6c000, addr: 9000000, size: 6400000 (xe_compute_preempt:4000) intel_compute-DEBUG: surface state base: 200000 (xe_compute_preempt:4012) intel_compute-DEBUG: [i: 10 name: sip kernel] data: 0x7e09f8e64000, addr: 107ff0000, size: 8000 (xe_compute_preempt:4000) intel_compute-DEBUG: dynamic state base: 300000 (xe_compute_preempt:4012) intel_compute-DEBUG: [i: 0 name: instr state base] data: 0x7e09f8e63000, addr: 83e0000, size: 1000 (xe_compute_preempt:4000) intel_compute-DEBUG: instruct base addr: 8000000 (xe_compute_preempt:4012) intel_compute-DEBUG: [i: 1 name: dynamic state base] data: 0x7e09f8d63000, addr: 300000, size: 100000 (xe_compute_preempt:4000) intel_compute-DEBUG: bindless base addr: 200000 (xe_compute_preempt:4000) intel_compute-DEBUG: state context data base addr: 9000000 (xe_compute_preempt:4012) intel_compute-DEBUG: [i: 2 name: surface state base] data: 0x7e09f8d53000, addr: 200000, size: 10000 (xe_compute_preempt:4000) intel_compute-DEBUG: offset indirect addr: 3d0000 (xe_compute_preempt:4012) intel_compute-DEBUG: [i: 3 name: indirect object base] data: 0x7e09f8d43000, addr: 63d0000, size: 10000 (xe_compute_preempt:4000) intel_compute-DEBUG: kernel start pointer: 3e0000 (xe_compute_preempt:4012) intel_compute-DEBUG: [i: 4 name: addr input] data: 0x7e09f8d33000, addr: 40000000, size: 10000 (xe_compute_preempt:4000) intel_compute-DEBUG: sip start pointer: ffff0000 (xe_compute_preempt:4012) intel_compute-DEBUG: [i: 5 name: addr output] data: 0x7e09f8d23000, addr: 80000000, size: 10000 (xe_compute_preempt:4000) intel_compute-CRITICAL: Test assertion failure function xe2lpg_compute_preempt_exec, file ../lib/intel_compute.c:2513: (xe_compute_preempt:4012) intel_compute-DEBUG: [i: 6 name: general state base] data: 0x7e09f8c23000, addr: 6000000, size: 100000 (xe_compute_preempt:4012) intel_compute-DEBUG: [i: 7 name: binding table] data: 0x7e09f8c13000, addr: 210000, size: 10000 (xe_compute_preempt:4000) intel_compute-CRITICAL: Failed assertion: 0 != __xe_wait_ufence(fd, &execenv_long.bo_sync->sync, 0xdeadbeefdeadbeefull, execenv_long.exec_queue, &timeout_one_ns) (xe_compute_preempt:4012) intel_compute-DEBUG: [i: 8 name: batch] data: 0x7e09f8c03000, addr: 100000, size: 10000 (xe_compute_preempt:4000) intel_compute-CRITICAL: error: 0 == 0 (xe_compute_preempt:3978) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:4079) igt_core-INFO: #2 ../lib/intel_compute.c:418 bo_execenv_sync() Dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE failed. DEBUG (xe_compute_preempt:3849) DEBUG: VRAM: 12216, child count: 73 END ** Dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE: FAIL (7.649s) Subtest compute-preempt-many-vram-evict: FAIL (7.652s)
Dmesg Scroll to first warning	<6> [161.790943] Console: switching to colour dummy device 80x25 <6> [161.791216] [IGT] xe_compute_preempt: executing <7> [161.847184] xe 0000:03:00.0: [drm:drm_pagemap_shrinker_scan [drm_gpusvm_helper]] Shrinking dpagemap ffff8881666e4ad0. <6> [161.863000] [IGT] xe_compute_preempt: starting subtest compute-preempt-many-vram-evict <6> [161.863775] [IGT] xe_compute_preempt: starting dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE <6> [162.717757] xe 0000:03:00.0: [drm] Tile0: GT0: Engine memory CAT error [5]: class=bcs, logical_mask: 0x2, guc_id=0 <5> [162.719642] xe 0000:03:00.0: [drm] Tile0: GT0: log buffer overflow <7> [163.275607] xe 0000:03:00.0: [drm:xe_guc_capture_process [xe]] Tile0: GT0: Capture extraction failed:-5 <6> [163.275775] xe 0000:03:00.0: [drm] Tile0: GT0: Engine reset: engine_class=bcs, logical_mask: 0x2, guc_id=0, state=0x249 <5> [163.276011] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10315, lrc_seqno=10315, guc_id=0, flags=0x73 in no process [-1] <7> [163.276018] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [163.276134] ------------[ cut here ]------------ <4> [163.276136] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [163.276138] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#15: kworker/u64:9/197 <4> [163.276252] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [163.276357] efi_pstore nfnetlink autofs4 <4> [163.276364] CPU: 15 UID: 0 PID: 197 Comm: kworker/u64:9 Tainted: G S U 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [163.276368] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER <4> [163.276369] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [163.276372] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [163.276380] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [163.276488] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [163.276491] RSP: 0018:ffffc900015f3c98 EFLAGS: 00010246 <4> [163.276494] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [163.276496] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [163.276497] RBP: ffffc900015f3da8 R08: 0000000000000000 R09: 0000000000000000 <4> [163.276499] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [163.276500] R13: ffff888104048490 R14: ffff88810ce70000 R15: 00000000fffffffb <4> [163.276502] FS: 0000000000000000(0000) GS:ffff8888db45d000(0000) knlGS:0000000000000000 <4> [163.276504] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [163.276506] CR2: 00007e09ff4cc000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [163.276508] PKRU: 55555554 <4> [163.276509] Call Trace: <4> [163.276511] <TASK> <4> [163.276522] ? __pfx_autoremove_wake_function+0x10/0x10 <4> [163.276532] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [163.276540] process_one_work+0x22e/0x6b0 <4> [163.276551] worker_thread+0x1e8/0x3d0 <4> [163.276555] ? __pfx_worker_thread+0x10/0x10 <4> [163.276557] kthread+0x11f/0x250 <4> [163.276562] ? __pfx_kthread+0x10/0x10 <4> [163.276567] ret_from_fork+0x344/0x3a0 <4> [163.276570] ? __pfx_kthread+0x10/0x10 <4> [163.276574] ret_from_fork_asm+0x1a/0x30 <4> [163.276586] </TASK> <4> [163.276588] irq event stamp: 107855 <4> [163.276589] hardirqs last enabled at (107861): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [163.276593] hardirqs last disabled at (107866): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [163.276596] softirqs last enabled at (107056): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [163.276599] softirqs last disabled at (107039): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [163.276602] ---[ end trace 0000000000000000 ]--- <6> [163.276604] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [163.276713] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [163.276767] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [163.276786] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [163.277586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [163.277675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [163.277759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [163.277836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [163.277912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [163.278004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [163.278082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [163.278153] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [163.278239] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [163.278344] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [163.279350] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [163.290107] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [163.290395] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [163.291807] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [163.291884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [163.291970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [163.292042] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [163.292110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [163.292177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [163.292243] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [163.292308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [163.292373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [163.292438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [163.292503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [163.292567] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [163.292631] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [163.292694] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [163.292757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [163.292820] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [163.292882] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [163.292959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [163.293027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [163.293101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [163.293171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [163.293239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [163.293308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [163.293374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [163.293440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [163.293508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [163.293578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [163.293646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [163.293712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [163.293778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [163.293843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [163.293918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [163.293998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [163.294071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [163.294140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [163.294209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [163.294276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [163.294341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [163.294405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [163.294472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [163.294538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [163.294609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [163.294681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [163.294755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [163.294825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [163.294901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [163.294972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [163.295042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [163.295111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [163.295179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [163.295251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [163.295321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [163.295390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [163.295458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [163.295529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [163.295599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [163.295666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [163.295737] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [163.297368] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [163.298229] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=4, flags=0x0 in xe_compute_pree [3849] <7> [163.298232] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [163.298422] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=8, flags=0x0 in xe_compute_pree [3849] <7> [163.298429] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [163.298440] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [163.298565] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [163.298881] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=12, flags=0x0 in xe_compute_pree [3849] <7> [163.298885] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [163.299297] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=16, flags=0x0 in xe_compute_pree [3849] <7> [163.299300] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [163.299563] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=20, flags=0x0 in xe_compute_pree [3849] <7> [163.299565] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [163.299821] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=24, flags=0x0 in xe_compute_pree [3849] <7> [163.299823] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [163.299914] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=28, flags=0x0 in xe_compute_pree [3849] <7> [163.299916] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [163.300149] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=32, flags=0x0 in xe_compute_pree [3849] <7> [163.300150] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [163.300411] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=36, flags=0x0 in xe_compute_pree [3849] <7> [163.300413] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [163.300668] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=40, flags=0x0 in xe_compute_pree [3849] <7> [163.300675] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [163.300947] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=44, flags=0x0 in xe_compute_pree [3849] <7> [163.300951] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [163.301215] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=48, flags=0x0 in xe_compute_pree [3849] <7> [163.301218] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [163.301481] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=52, flags=0x0 in xe_compute_pree [3849] <7> [163.301484] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [163.301744] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=60, flags=0x0 in xe_compute_pree [3849] <7> [163.301746] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [163.302020] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=71, flags=0x0 in xe_compute_pree [3849] <7> [163.302022] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [163.302276] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=76, flags=0x0 in xe_compute_pree [3849] <7> [163.302278] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [163.302538] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=84, flags=0x0 in xe_compute_pree [3849] <7> [163.302540] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [163.302797] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=91, flags=0x0 in xe_compute_pree [3849] <7> [163.302799] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [163.303068] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=95, flags=0x0 in xe_compute_pree [3849] <7> [163.303070] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [163.303143] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=106, flags=0x0 in xe_compute_pree [3849] <7> [163.303145] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [163.303381] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10315, lrc_seqno=10315, guc_id=0, flags=0x73 in no process [-1] <7> [163.303383] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [163.303442] ------------[ cut here ]------------ <4> [163.303443] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [163.303444] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#2: kworker/u64:44/2860 <4> [163.303519] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [163.303578] efi_pstore nfnetlink autofs4 <4> [163.303583] CPU: 2 UID: 0 PID: 2860 Comm: kworker/u64:44 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [163.303586] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [163.303587] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [163.303588] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [163.303594] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [163.303664] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [163.303666] RSP: 0018:ffffc9000587fc98 EFLAGS: 00010246 <4> [163.303668] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [163.303670] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [163.303671] RBP: ffffc9000587fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [163.303672] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [163.303673] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [163.303674] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [163.303676] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [163.303677] CR2: 00007e09f85b3000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [163.303678] PKRU: 55555554 <4> [163.303679] Call Trace: <4> [163.303680] <TASK> <4> [163.303686] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [163.303691] ? lock_release+0xce/0x280 <4> [163.303697] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [163.303702] process_one_work+0x22e/0x6b0 <4> [163.303709] worker_thread+0x1e8/0x3d0 <4> [163.303712] ? __pfx_worker_thread+0x10/0x10 <4> [163.303714] kthread+0x11f/0x250 <4> [163.303718] ? __pfx_kthread+0x10/0x10 <4> [163.303721] ret_from_fork+0x344/0x3a0 <4> [163.303724] ? __pfx_kthread+0x10/0x10 <4> [163.303726] ret_from_fork_asm+0x1a/0x30 <4> [163.303734] </TASK> <4> [163.303735] irq event stamp: 125983 <4> [163.303736] hardirqs last enabled at (125989): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [163.303740] hardirqs last disabled at (125994): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [163.303742] softirqs last enabled at (125082): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [163.303745] softirqs last disabled at (125069): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [163.303747] ---[ end trace 0000000000000000 ]--- <6> [163.303749] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [163.303818] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <5> [163.303824] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=120, flags=0x0 in xe_compute_pree [3849] <7> [163.303826] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [163.304254] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=126, flags=0x0 in xe_compute_pree [3849] <7> [163.304256] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [163.304327] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=138, flags=0x0 in xe_compute_pree [3849] <7> [163.304329] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [163.304574] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=158, flags=0x0 in xe_compute_pree [3849] <7> [163.304576] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [163.304643] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=185, flags=0x0 in xe_compute_pree [3849] <7> [163.304645] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [163.304871] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [163.304924] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [163.305483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [163.305574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [163.305664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [163.305747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [163.305830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [163.305917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [163.305999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [163.306077] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [163.306171] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [163.306283] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [163.307305] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [163.317864] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [163.318127] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [163.319396] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [163.319486] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [163.319563] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [163.319639] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [163.319712] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [163.319783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [163.319860] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [163.319932] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [163.320004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [163.320073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [163.320141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [163.320218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [163.320287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [163.320356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [163.320426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [163.320494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [163.320562] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [163.320633] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [163.320701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [163.320781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [163.320864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [163.320942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [163.321019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [163.321092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [163.321165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [163.321240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [163.321318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [163.321396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [163.321472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [163.321547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [163.321623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [163.321702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [163.321782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [163.321864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [163.321942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [163.322017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [163.322092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [163.322165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [163.322236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [163.322310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [163.322382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [163.322453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [163.322522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [163.322596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [163.322666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [163.322736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [163.322806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [163.322896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [163.322971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [163.323043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [163.323120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [163.323196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [163.323267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [163.323336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [163.323406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [163.323475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [163.323543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [163.323616] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [163.324876] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [163.325731] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10315, lrc_seqno=10315, guc_id=0, flags=0x73 in no process [-1] <7> [163.325734] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [163.325799] ------------[ cut here ]------------ <4> [163.325800] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [163.325801] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#6: kworker/u64:44/2860 <4> [163.325883] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [163.325943] efi_pstore nfnetlink autofs4 <4> [163.325948] CPU: 6 UID: 0 PID: 2860 Comm: kworker/u64:44 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [163.325951] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [163.325952] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [163.325953] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [163.325959] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [163.326028] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [163.326029] RSP: 0018:ffffc9000587fc98 EFLAGS: 00010246 <4> [163.326031] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [163.326033] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [163.326034] RBP: ffffc9000587fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [163.326035] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [163.326036] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [163.326037] FS: 0000000000000000(0000) GS:ffff8888dafdd000(0000) knlGS:0000000000000000 <4> [163.326039] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [163.326040] CR2: 00007e09ff4cc000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [163.326041] PKRU: 55555554 <4> [163.326042] Call Trace: <4> [163.326043] <TASK> <4> [163.326048] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [163.326053] ? lock_release+0xce/0x280 <4> [163.326060] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [163.326064] process_one_work+0x22e/0x6b0 <4> [163.326071] worker_thread+0x1e8/0x3d0 <4> [163.326073] ? __pfx_worker_thread+0x10/0x10 <4> [163.326076] kthread+0x11f/0x250 <4> [163.326079] ? __pfx_kthread+0x10/0x10 <4> [163.326082] ret_from_fork+0x344/0x3a0 <4> [163.326085] ? __pfx_kthread+0x10/0x10 <4> [163.326088] ret_from_fork_asm+0x1a/0x30 <4> [163.326095] </TASK> <4> [163.326096] irq event stamp: 136887 <4> [163.326097] hardirqs last enabled at (136893): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [163.326100] hardirqs last disabled at (136898): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [163.326102] softirqs last enabled at (134056): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [163.326105] softirqs last disabled at (134049): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [163.326108] ---[ end trace 0000000000000000 ]--- <6> [165.992201] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [165.992615] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [165.993355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [165.993440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [165.993526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [165.993607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [165.993686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [165.993762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [165.993841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [165.993916] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [165.994006] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [165.994119] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [165.995124] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.005091] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.005349] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.006674] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.006748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.006819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.006888] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.006956] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.007023] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.007097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.007162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.007228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.007293] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.007358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.007423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.007488] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.007553] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.007620] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.007684] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.007750] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.007816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.007881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.007955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.008028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.008105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.008178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.008248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.008315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.008385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.008457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.008525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.008592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.008661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.008731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.008806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.008881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.008954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.009024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.009100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.009169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.009238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.009303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.009371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.009436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.009502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.009565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.009634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.009700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.009766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.009830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.009897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.009960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.010024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.010095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.010162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.010227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.010293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.010361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.010426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.010490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.010557] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.011849] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.012702] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13031, lrc_seqno=13031, guc_id=0, flags=0x73 in no process [-1] <7> [166.012705] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.012763] ------------[ cut here ]------------ <4> [166.012764] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.012766] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#2: kworker/u64:8/196 <4> [166.012845] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.012904] efi_pstore nfnetlink autofs4 <4> [166.012908] CPU: 2 UID: 0 PID: 196 Comm: kworker/u64:8 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.012910] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.012911] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.012913] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.012918] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.012982] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.012983] RSP: 0018:ffffc900015ebc98 EFLAGS: 00010246 <4> [166.012985] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.012986] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.012988] RBP: ffffc900015ebda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.012989] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.012990] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.012991] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [166.012992] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.012993] CR2: 0000785eaa33d000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.012995] PKRU: 55555554 <4> [166.012996] Call Trace: <4> [166.012997] <TASK> <4> [166.013002] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.013006] ? lock_release+0xce/0x280 <4> [166.013012] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.013017] process_one_work+0x22e/0x6b0 <4> [166.013022] worker_thread+0x1e8/0x3d0 <4> [166.013025] ? __pfx_worker_thread+0x10/0x10 <4> [166.013027] kthread+0x11f/0x250 <4> [166.013031] ? __pfx_kthread+0x10/0x10 <4> [166.013034] ret_from_fork+0x344/0x3a0 <4> [166.013036] ? __pfx_kthread+0x10/0x10 <4> [166.013039] ret_from_fork_asm+0x1a/0x30 <4> [166.013046] </TASK> <4> [166.013047] irq event stamp: 1298241 <4> [166.013048] hardirqs last enabled at (1298247): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.013050] hardirqs last disabled at (1298252): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.013052] softirqs last enabled at (1294916): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.013055] softirqs last disabled at (1294911): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.013057] ---[ end trace 0000000000000000 ]--- <7> [166.014855] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.014976] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.015128] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.015260] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <5> [166.015344] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13079, lrc_seqno=13079, guc_id=0, flags=0x73 in no process [-1] <7> [166.015348] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.015409] ------------[ cut here ]------------ <4> [166.015410] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [166.015384] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.015411] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#6: kworker/u64:13/2457 <4> [166.015485] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei <7> [166.015501] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.015535] pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [166.015547] CPU: 6 UID: 0 PID: 2457 Comm: kworker/u64:13 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.015550] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.015551] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.015552] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.015556] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.015624] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.015626] RSP: 0018:ffffc90004163c98 EFLAGS: 00010246 <4> [166.015628] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.015629] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.015630] RBP: ffffc90004163da8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.015632] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.015632] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.015634] FS: 0000000000000000(0000) GS:ffff8888dafdd000(0000) knlGS:0000000000000000 <4> [166.015635] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.015636] CR2: 0000785eaa33e000 CR3: 0000000120a6c000 CR4: 0000000000f52ef0 <4> [166.015638] PKRU: 55555554 <4> [166.015639] Call Trace: <4> [166.015640] <TASK> <4> [166.015645] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <7> [166.015618] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.015649] ? lock_release+0xce/0x280 <4> [166.015655] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.015659] process_one_work+0x22e/0x6b0 <4> [166.015665] worker_thread+0x1e8/0x3d0 <4> [166.015667] ? __pfx_worker_thread+0x10/0x10 <4> [166.015669] kthread+0x11f/0x250 <4> [166.015672] ? __pfx_kthread+0x10/0x10 <4> [166.015676] ret_from_fork+0x344/0x3a0 <4> [166.015677] ? __pfx_kthread+0x10/0x10 <4> [166.015680] ret_from_fork_asm+0x1a/0x30 <4> [166.015688] </TASK> <4> [166.015689] irq event stamp: 131287 <4> [166.015690] hardirqs last enabled at (131293): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.015692] hardirqs last disabled at (131298): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.015694] softirqs last enabled at (128366): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.015697] softirqs last disabled at (128361): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.015699] ---[ end trace 0000000000000000 ]--- <6> [166.015701] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [166.015733] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <6> [166.015768] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.015774] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.015847] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.015920] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.015966] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.016085] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.016281] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.016468] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.016490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.016576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.016664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.016713] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.016746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.016827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.016892] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.016905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.016983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.017058] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.017061] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.017184] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.017246] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.017312] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.017408] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.017769] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.018317] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.018329] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.018487] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.026237] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.026348] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.026453] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.026557] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.026661] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.026765] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.026869] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.026972] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.027079] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.027186] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.027291] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.027396] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.027734] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.027894] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.028021] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.028064] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.028149] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.028252] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.028325] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.028354] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.028456] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.028557] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.028659] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.028758] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.028860] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.028958] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.029069] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.029169] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.029288] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.029401] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.029614] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.029695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.029771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.029843] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.029913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.029981] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.030050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.030191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.030258] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.030326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.030391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.030455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.030520] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.030585] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.030652] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.030717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.030783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.030850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.030913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.030988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.031065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.031135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.031206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.031273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.031340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.031411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.031490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.031562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.031631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.031701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.031770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.031846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.031921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.031995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.032068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.032138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.032205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.032272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.032338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.032408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.032475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.032543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.032608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.032679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.032746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.032813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.032881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.032950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.033015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.033090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.033160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.033226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.033291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.033355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.033420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.033484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.033548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.033615] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.035059] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.035908] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13079, lrc_seqno=13079, guc_id=0, flags=0x73 in no process [-1] <7> [166.035911] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.035967] ------------[ cut here ]------------ <4> [166.035968] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.035969] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#4: kworker/u64:8/196 <4> [166.036036] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.036099] efi_pstore nfnetlink autofs4 <4> [166.036103] CPU: 4 UID: 0 PID: 196 Comm: kworker/u64:8 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.036106] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.036107] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.036109] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.036114] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.036177] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.036179] RSP: 0018:ffffc900015ebc98 EFLAGS: 00010246 <4> [166.036181] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.036182] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.036183] RBP: ffffc900015ebda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.036184] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.036185] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.036187] FS: 0000000000000000(0000) GS:ffff8888daedd000(0000) knlGS:0000000000000000 <4> [166.036188] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.036189] CR2: 0000785eaa33f000 CR3: 0000000114fd8000 CR4: 0000000000f52ef0 <4> [166.036191] PKRU: 55555554 <4> [166.036192] Call Trace: <4> [166.036193] <TASK> <4> [166.036197] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.036202] ? lock_release+0xce/0x280 <4> [166.036208] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.036213] process_one_work+0x22e/0x6b0 <4> [166.036219] worker_thread+0x1e8/0x3d0 <4> [166.036221] ? __pfx_worker_thread+0x10/0x10 <4> [166.036223] kthread+0x11f/0x250 <4> [166.036227] ? __pfx_kthread+0x10/0x10 <4> [166.036230] ret_from_fork+0x344/0x3a0 <4> [166.036232] ? __pfx_kthread+0x10/0x10 <4> [166.036234] ret_from_fork_asm+0x1a/0x30 <4> [166.036242] </TASK> <4> [166.036243] irq event stamp: 1309609 <4> [166.036244] hardirqs last enabled at (1309615): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.036247] hardirqs last disabled at (1309620): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.036249] softirqs last enabled at (1306378): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.036251] softirqs last disabled at (1306373): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.036253] ---[ end trace 0000000000000000 ]--- <6> [166.036255] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.036319] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.036325] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.036737] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.036832] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.036932] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.037495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.037575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.037660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.037738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.037814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.037889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.037965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.038037] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.038140] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.038248] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.039254] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.049036] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.049296] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.050567] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.050640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.050709] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.050778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.050848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.050914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.050981] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.051055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.051121] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.051188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.051253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.051321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.051388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.051456] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.051523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.051589] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.051653] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.051717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.051781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.051854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.051928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.051998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.052078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.052146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.052211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.052278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.052349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.052418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.052485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.052554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.052623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.052694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.052765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.052837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.052906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.052974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.053044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.053108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.053171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.053238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.053302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.053367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.053430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.053497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.053562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.053627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.053690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.053755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.053818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.053880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.053946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.054010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.054088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.054154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.054221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.054284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.054348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.054413] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.055819] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.056674] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13079, lrc_seqno=13079, guc_id=0, flags=0x73 in no process [-1] <7> [166.056677] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.056738] ------------[ cut here ]------------ <4> [166.056739] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.056740] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#4: kworker/u64:8/196 <4> [166.056806] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.056864] efi_pstore nfnetlink autofs4 <4> [166.056868] CPU: 4 UID: 0 PID: 196 Comm: kworker/u64:8 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.056871] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.056872] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.056873] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.056878] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.056941] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.056942] RSP: 0018:ffffc900015ebc98 EFLAGS: 00010246 <4> [166.056944] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.056945] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.056947] RBP: ffffc900015ebda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.056948] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.056949] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.056950] FS: 0000000000000000(0000) GS:ffff8888daedd000(0000) knlGS:0000000000000000 <4> [166.056951] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.056952] CR2: 0000785eaa33f000 CR3: 0000000114fd8000 CR4: 0000000000f52ef0 <4> [166.056954] PKRU: 55555554 <4> [166.056955] Call Trace: <4> [166.056956] <TASK> <4> [166.056961] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.056966] ? lock_release+0xce/0x280 <4> [166.056971] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.056976] process_one_work+0x22e/0x6b0 <4> [166.056982] worker_thread+0x1e8/0x3d0 <4> [166.056985] ? __pfx_worker_thread+0x10/0x10 <4> [166.056987] kthread+0x11f/0x250 <4> [166.056990] ? __pfx_kthread+0x10/0x10 <4> [166.056993] ret_from_fork+0x344/0x3a0 <4> [166.056995] ? __pfx_kthread+0x10/0x10 <4> [166.056998] ret_from_fork_asm+0x1a/0x30 <4> [166.057006] </TASK> <4> [166.057006] irq event stamp: 1320275 <4> [166.057007] hardirqs last enabled at (1320281): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.057010] hardirqs last disabled at (1320286): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.057012] softirqs last enabled at (1317070): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.057015] softirqs last disabled at (1317059): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.057022] ---[ end trace 0000000000000000 ]--- <7> [166.058755] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.058854] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.059019] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.059259] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <5> [166.059339] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13126, lrc_seqno=13126, guc_id=0, flags=0x73 in no process [-1] <7> [166.059346] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [166.059387] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.059450] ------------[ cut here ]------------ <4> [166.059451] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.059453] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#13: kworker/u64:40/2856 <7> [166.059504] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.059567] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad <7> [166.059616] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.059650] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [166.059659] CPU: 13 UID: 0 PID: 2856 Comm: kworker/u64:40 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.059663] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.059664] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.059666] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.059673] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <7> [166.059731] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.059782] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.059784] RSP: 0018:ffffc9000585fc98 EFLAGS: 00010246 <4> [166.059786] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.059788] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.059789] RBP: ffffc9000585fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.059791] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.059792] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.059794] FS: 0000000000000000(0000) GS:ffff8888db35d000(0000) knlGS:0000000000000000 <4> [166.059798] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.059800] CR2: 00007e09f8bf3000 CR3: 0000000174e2f000 CR4: 0000000000f52ef0 <4> [166.059802] PKRU: 55555554 <4> [166.059803] Call Trace: <4> [166.059805] <TASK> <4> [166.059814] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.059821] ? lock_release+0xce/0x280 <4> [166.059830] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.059838] process_one_work+0x22e/0x6b0 <4> [166.059848] worker_thread+0x1e8/0x3d0 <4> [166.059852] ? __pfx_worker_thread+0x10/0x10 <4> [166.059855] kthread+0x11f/0x250 <4> [166.059859] ? __pfx_kthread+0x10/0x10 <4> [166.059864] ret_from_fork+0x344/0x3a0 <4> [166.059867] ? __pfx_kthread+0x10/0x10 <4> [166.059871] ret_from_fork_asm+0x1a/0x30 <7> [166.059844] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <4> [166.059883] </TASK> <4> [166.059884] irq event stamp: 242335 <4> [166.059885] hardirqs last enabled at (242341): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.059889] hardirqs last disabled at (242346): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.059891] softirqs last enabled at (238532): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.059894] softirqs last disabled at (238525): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.059897] ---[ end trace 0000000000000000 ]--- <6> [166.059899] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [166.059961] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <6> [166.060008] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.060025] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.060080] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.060211] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.060271] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.060466] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.060725] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.060899] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.060994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.061074] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.061131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.061239] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.061265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.061402] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.061394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.061522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.061635] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.061648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.061775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.061808] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.061901] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.061973] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.062043] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.062203] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.063550] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.069614] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.069724] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.069830] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.069934] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.070046] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.070147] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.070249] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.070351] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.070453] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.070556] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.070659] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.070763] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.070866] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.071019] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.071123] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.071226] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.071328] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.071428] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.071530] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.071632] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.071734] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.071834] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.071934] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.072040] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.072144] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.072245] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.072376] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.072491] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.074021] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.074344] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.075777] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.075894] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.076013] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.076129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.076245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.076360] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.076475] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.076591] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.076706] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.076821] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.076936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.077058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.077173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.077289] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.077404] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.077519] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.077634] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.077750] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.077865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.077985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.078109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.078229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.078349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.078467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.078585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.078706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.078831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.078953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.079078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.079201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.079322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.079449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.079575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.079701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.079825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.079948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.080072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.080193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.080311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.080433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.080554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.080674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.080792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.080915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.081039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.081161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.081280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.081402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.081521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.081639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.081763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.081882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.082007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.082126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.082249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.082368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.082486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.082609] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.083963] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.084824] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13126, lrc_seqno=13126, guc_id=0, flags=0x73 in no process [-1] <7> [166.084827] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.084898] ------------[ cut here ]------------ <4> [166.084899] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.084901] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#6: kworker/u64:40/2856 <4> [166.084990] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.085049] efi_pstore nfnetlink autofs4 <4> [166.085053] CPU: 6 UID: 0 PID: 2856 Comm: kworker/u64:40 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.085055] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.085057] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.085058] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.085063] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.085129] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.085131] RSP: 0018:ffffc9000585fc98 EFLAGS: 00010246 <4> [166.085133] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.085134] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.085135] RBP: ffffc9000585fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.085136] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.085138] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.085139] FS: 0000000000000000(0000) GS:ffff8888dafdd000(0000) knlGS:0000000000000000 <4> [166.085140] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.085142] CR2: 0000785eaa33e000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.085143] PKRU: 55555554 <4> [166.085144] Call Trace: <4> [166.085145] <TASK> <4> [166.085150] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.085155] ? lock_release+0xce/0x280 <4> [166.085160] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.085165] process_one_work+0x22e/0x6b0 <4> [166.085171] worker_thread+0x1e8/0x3d0 <4> [166.085174] ? __pfx_worker_thread+0x10/0x10 <4> [166.085176] kthread+0x11f/0x250 <4> [166.085179] ? __pfx_kthread+0x10/0x10 <4> [166.085182] ret_from_fork+0x344/0x3a0 <4> [166.085185] ? __pfx_kthread+0x10/0x10 <4> [166.085188] ret_from_fork_asm+0x1a/0x30 <4> [166.085195] </TASK> <4> [166.085196] irq event stamp: 252999 <4> [166.085197] hardirqs last enabled at (253005): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.085199] hardirqs last disabled at (253010): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.085202] softirqs last enabled at (252256): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.085204] softirqs last disabled at (252249): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.085206] ---[ end trace 0000000000000000 ]--- <6> [166.085208] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.085272] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.085278] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.085291] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.085391] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.085692] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.086268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.086357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.086445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.086525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.086604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.086680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.086755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.086828] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.086916] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.087031] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.088040] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.097975] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.098232] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.099541] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.099613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.099683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.099752] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.099822] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.099888] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.099954] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.100037] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.100105] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.100173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.100239] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.100308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.100373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.100440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.100504] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.100569] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.100633] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.100700] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.100764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.100839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.100911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.100988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.101060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.101128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.101195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.101264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.101337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.101407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.101476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.101546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.101615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.101690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.101766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.101842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.101915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.102002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.102084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.102155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.102221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.102290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.102358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.102425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.102493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.102565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.102632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.102699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.102764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.102834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.102901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.102976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.103049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.103118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.103185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.103252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.103319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.103384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.103451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.103519] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.104761] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.105620] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13126, lrc_seqno=13126, guc_id=0, flags=0x73 in no process [-1] <7> [166.105623] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.105679] ------------[ cut here ]------------ <4> [166.105680] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.105681] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#11: kworker/u64:6/194 <4> [166.105755] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.105813] efi_pstore nfnetlink autofs4 <4> [166.105817] CPU: 11 UID: 0 PID: 194 Comm: kworker/u64:6 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.105820] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.105821] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.105823] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.105828] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.105892] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.105894] RSP: 0018:ffffc900015dbc98 EFLAGS: 00010246 <4> [166.105896] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.105897] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.105898] RBP: ffffc900015dbda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.105899] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.105900] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.105902] FS: 0000000000000000(0000) GS:ffff8888db25d000(0000) knlGS:0000000000000000 <4> [166.105903] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.105904] CR2: 00007e09f8bf3000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.105905] PKRU: 55555554 <4> [166.105906] Call Trace: <4> [166.105907] <TASK> <4> [166.105913] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.105918] ? lock_release+0xce/0x280 <4> [166.105923] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.105928] process_one_work+0x22e/0x6b0 <4> [166.105934] worker_thread+0x1e8/0x3d0 <4> [166.105936] ? __pfx_worker_thread+0x10/0x10 <4> [166.105938] kthread+0x11f/0x250 <4> [166.105942] ? __pfx_kthread+0x10/0x10 <4> [166.105945] ret_from_fork+0x344/0x3a0 <4> [166.105947] ? __pfx_kthread+0x10/0x10 <4> [166.105950] ret_from_fork_asm+0x1a/0x30 <4> [166.105962] </TASK> <4> [166.105964] irq event stamp: 489313 <4> [166.105965] hardirqs last enabled at (489319): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.105968] hardirqs last disabled at (489324): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.105970] softirqs last enabled at (486082): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.105972] softirqs last disabled at (486075): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.105975] ---[ end trace 0000000000000000 ]--- <7> [166.107721] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.107847] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.108187] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <5> [166.108311] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13173, lrc_seqno=13173, guc_id=0, flags=0x73 in no process [-1] <7> [166.108315] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [166.108332] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <4> [166.108427] ------------[ cut here ]------------ <4> [166.108429] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.108431] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#13: kworker/u64:9/197 <7> [166.108477] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.108575] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux <7> [166.108620] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.108662] nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [166.108699] CPU: 13 UID: 0 PID: 197 Comm: kworker/u64:9 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.108706] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.108708] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.108710] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.108720] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <7> [166.108764] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.108867] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.108870] RSP: 0018:ffffc900015f3c98 EFLAGS: 00010246 <4> [166.108874] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.108877] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.108879] RBP: ffffc900015f3da8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.108881] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.108883] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.108885] FS: 0000000000000000(0000) GS:ffff8888db35d000(0000) knlGS:0000000000000000 <4> [166.108888] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.108891] CR2: 00007e09f8bf3000 CR3: 0000000166095000 CR4: 0000000000f52ef0 <4> [166.108893] PKRU: 55555554 <4> [166.108895] Call Trace: <4> [166.108897] <TASK> <4> [166.108909] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.108919] ? lock_release+0xce/0x280 <4> [166.108931] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.108942] process_one_work+0x22e/0x6b0 <7> [166.108907] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.108971] worker_thread+0x1e8/0x3d0 <4> [166.108977] ? __pfx_worker_thread+0x10/0x10 <4> [166.108981] kthread+0x11f/0x250 <4> [166.108987] ? __pfx_kthread+0x10/0x10 <4> [166.108994] ret_from_fork+0x344/0x3a0 <4> [166.108997] ? __pfx_kthread+0x10/0x10 <4> [166.109004] ret_from_fork_asm+0x1a/0x30 <4> [166.109021] </TASK> <4> [166.109023] irq event stamp: 297311 <4> [166.109025] hardirqs last enabled at (297317): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.109030] hardirqs last disabled at (297322): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.109034] softirqs last enabled at (297262): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.109038] softirqs last disabled at (297255): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.109042] ---[ end trace 0000000000000000 ]--- <7> [166.109066] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <6> [166.109045] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.109196] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.109208] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.109210] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.109261] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.109355] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.109603] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.109829] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.110137] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.110319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.110373] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.110440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.110563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.110595] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.110688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.110787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.110810] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.110884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.111003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.111053] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.111099] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.111216] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.111343] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.111380] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.111569] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.111791] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.114144] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.119922] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.120075] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.120203] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.120315] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.120419] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.120523] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.120624] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.120728] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.120830] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.120932] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.121053] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.121159] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.121262] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.121414] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.121521] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.121624] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.121727] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.121830] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.122146] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.122248] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.122352] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.122455] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.122557] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.122660] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.122762] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.122864] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.122993] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.123110] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.123946] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.124334] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.126081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.126204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.126323] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.126487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.126937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.127103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.127232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.127393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.127530] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.127701] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.127838] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.127960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.128077] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.128193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.128309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.128432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.128569] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.128762] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.128932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.129056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.129177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.129296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.129417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.129536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.129654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.129775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.129904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.130075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.130340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.130480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.130601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.130768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.130949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.131122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.131264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.131388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.131508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.131628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.131746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.131868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.131993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.132114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.132233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.132357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.132477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.132598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.132720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.132840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.132962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.133082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.133204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.133323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.133443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.133562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.133682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.133800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.133918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.134045] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.136108] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.137248] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13173, lrc_seqno=13173, guc_id=0, flags=0x73 in no process [-1] <7> [166.137253] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.137316] ------------[ cut here ]------------ <4> [166.137317] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.137318] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#4: kworker/u64:9/197 <4> [166.137391] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.137451] efi_pstore nfnetlink autofs4 <4> [166.137456] CPU: 4 UID: 0 PID: 197 Comm: kworker/u64:9 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.137458] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.137459] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.137461] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.137466] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.137535] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.137536] RSP: 0018:ffffc900015f3c98 EFLAGS: 00010246 <4> [166.137538] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.137540] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.137541] RBP: ffffc900015f3da8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.137542] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.137543] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.137544] FS: 0000000000000000(0000) GS:ffff8888daedd000(0000) knlGS:0000000000000000 <4> [166.137546] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.137547] CR2: 0000785eaa33f000 CR3: 0000000104b8d000 CR4: 0000000000f52ef0 <4> [166.137548] PKRU: 55555554 <4> [166.137549] Call Trace: <4> [166.137550] <TASK> <4> [166.137556] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.137560] ? lock_release+0xce/0x280 <4> [166.137566] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.137570] process_one_work+0x22e/0x6b0 <4> [166.137576] worker_thread+0x1e8/0x3d0 <4> [166.137579] ? __pfx_worker_thread+0x10/0x10 <4> [166.137581] kthread+0x11f/0x250 <4> [166.137584] ? __pfx_kthread+0x10/0x10 <4> [166.137587] ret_from_fork+0x344/0x3a0 <4> [166.137589] ? __pfx_kthread+0x10/0x10 <4> [166.137592] ret_from_fork_asm+0x1a/0x30 <4> [166.137600] </TASK> <4> [166.137601] irq event stamp: 308087 <4> [166.137602] hardirqs last enabled at (308093): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.137604] hardirqs last disabled at (308098): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.137606] softirqs last enabled at (306288): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.137609] softirqs last disabled at (306283): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.137611] ---[ end trace 0000000000000000 ]--- <6> [166.137613] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.137679] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.137686] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.137736] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.137837] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.137951] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.138962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.139087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.139233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.139372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.139496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.139631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.139750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.139869] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.140018] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.140221] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.141465] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.151905] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.152189] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.153561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.153629] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.153693] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.153758] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.153830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.153890] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.153978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.154042] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.154108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.154168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.154230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.154290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.154350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.154411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.154472] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.154532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.154590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.154649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.154708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.154777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.154844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.154911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.154983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.155048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.155110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.155175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.155243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.155310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.155373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.155437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.155502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.155569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.155637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.155704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.155770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.155833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.155899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.155967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.156029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.156092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.156155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.156215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.156275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.156339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.156398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.156458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.156515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.156576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.156634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.156692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.156754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.156813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.156873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.156944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.157010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.157069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.157130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.157191] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.158415] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.159273] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13173, lrc_seqno=13173, guc_id=0, flags=0x73 in no process [-1] <7> [166.159276] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.159331] ------------[ cut here ]------------ <4> [166.159332] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.159333] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#7: kworker/u64:9/197 <4> [166.159393] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.159449] efi_pstore nfnetlink autofs4 <4> [166.159453] CPU: 7 UID: 0 PID: 197 Comm: kworker/u64:9 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.159455] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.159456] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.159457] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.159462] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.159520] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.159522] RSP: 0018:ffffc900015f3c98 EFLAGS: 00010246 <4> [166.159523] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.159525] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.159526] RBP: ffffc900015f3da8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.159527] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.159528] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.159529] FS: 0000000000000000(0000) GS:ffff8888db05d000(0000) knlGS:0000000000000000 <4> [166.159530] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.159531] CR2: 00007e09f1a227fd CR3: 0000000120a6c000 CR4: 0000000000f52ef0 <4> [166.159532] PKRU: 55555554 <4> [166.159533] Call Trace: <4> [166.159534] <TASK> <4> [166.159539] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.159543] ? lock_release+0xce/0x280 <4> [166.159549] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.159553] process_one_work+0x22e/0x6b0 <4> [166.159559] worker_thread+0x1e8/0x3d0 <4> [166.159561] ? __pfx_worker_thread+0x10/0x10 <4> [166.159563] kthread+0x11f/0x250 <4> [166.159566] ? __pfx_kthread+0x10/0x10 <4> [166.159569] ret_from_fork+0x344/0x3a0 <4> [166.159571] ? __pfx_kthread+0x10/0x10 <4> [166.159573] ret_from_fork_asm+0x1a/0x30 <4> [166.159580] </TASK> <4> [166.159581] irq event stamp: 318769 <4> [166.159582] hardirqs last enabled at (318775): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.159585] hardirqs last disabled at (318780): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.159587] softirqs last enabled at (315452): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.159589] softirqs last disabled at (315447): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.159591] ---[ end trace 0000000000000000 ]--- <7> [166.161287] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.161389] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.161708] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.161996] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.162121] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.162235] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <5> [166.162293] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13223, lrc_seqno=13223, guc_id=0, flags=0x73 in no process [-1] <7> [166.162299] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [166.162343] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.162401] ------------[ cut here ]------------ <4> [166.162402] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.162405] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#12: kworker/u64:6/194 <7> [166.162450] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.162516] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel <7> [166.162556] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <4> [166.162588] mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [166.162608] CPU: 12 UID: 0 PID: 194 Comm: kworker/u64:6 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.162612] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.162613] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.162615] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.162622] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <7> [166.162675] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.162731] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.162733] RSP: 0018:ffffc900015dbc98 EFLAGS: 00010246 <4> [166.162736] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.162738] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.162740] RBP: ffffc900015dbda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.162742] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.162743] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.162745] FS: 0000000000000000(0000) GS:ffff8888db2dd000(0000) knlGS:0000000000000000 <4> [166.162747] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.162749] CR2: 0000785eaa341000 CR3: 0000000120a6c000 CR4: 0000000000f52ef0 <4> [166.162751] PKRU: 55555554 <4> [166.162753] Call Trace: <4> [166.162754] <TASK> <4> [166.162763] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.162770] ? lock_release+0xce/0x280 <4> [166.162779] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.162788] process_one_work+0x22e/0x6b0 <4> [166.162797] worker_thread+0x1e8/0x3d0 <4> [166.162801] ? __pfx_worker_thread+0x10/0x10 <4> [166.162804] kthread+0x11f/0x250 <7> [166.162780] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.162809] ? __pfx_kthread+0x10/0x10 <4> [166.162814] ret_from_fork+0x344/0x3a0 <4> [166.162816] ? __pfx_kthread+0x10/0x10 <4> [166.162820] ret_from_fork_asm+0x1a/0x30 <4> [166.162832] </TASK> <4> [166.162833] irq event stamp: 494297 <4> [166.162834] hardirqs last enabled at (494303): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.162838] hardirqs last disabled at (494308): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.162841] softirqs last enabled at (492238): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.162844] softirqs last disabled at (492231): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.162847] ---[ end trace 0000000000000000 ]--- <6> [166.162850] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.162973] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.162982] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.162984] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.163155] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.163235] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.163369] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.163601] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.163782] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.163956] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.164045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.164122] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.164175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.164286] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.164307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.164435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.164507] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.164562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.164677] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.164688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.164842] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.164815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.164946] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.165083] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.165242] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.166603] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.172732] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.172878] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.172991] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.173099] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.173206] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.173311] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.173415] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.173519] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.173621] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.173724] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.173828] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.173945] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.174048] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.174202] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.174307] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.174410] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.174511] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.174615] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.174717] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.174817] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.174928] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.175029] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.175132] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.175234] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.175335] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.175437] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.175564] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.175679] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.176879] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.177202] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.178606] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.178688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.178761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.178832] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.178923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.178992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.179058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.179124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.179190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.179255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.179320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.179385] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.179451] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.179518] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.179584] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.179648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.179712] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.179776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.179841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.179930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.180006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.180077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.180146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.180214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.180279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.180347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.180420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.180489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.180556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.180624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.180692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.180765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.180840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.180925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.180995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.181064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.181130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.181197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.181262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.181331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.181399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.181464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.181529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.181597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.181661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.181726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.181792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.181865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.181930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.181995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.182061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.182127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.182193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.182259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.182326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.182391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.182456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.182524] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.183728] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.183933] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13223, lrc_seqno=13223, guc_id=0, flags=0x73 in no process [-1] <7> [166.183942] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.184275] ------------[ cut here ]------------ <4> [166.184278] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.184280] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#11: kworker/u64:6/194 <4> [166.184581] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.184648] efi_pstore nfnetlink autofs4 <4> [166.184652] CPU: 11 UID: 0 PID: 194 Comm: kworker/u64:6 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.184655] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.184656] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.184657] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.184662] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.184740] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.184743] RSP: 0018:ffffc900015dbc98 EFLAGS: 00010246 <4> [166.184746] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.184747] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.184749] RBP: ffffc900015dbda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.184751] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.184752] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.184754] FS: 0000000000000000(0000) GS:ffff8888db25d000(0000) knlGS:0000000000000000 <4> [166.184756] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.184757] CR2: 00007e09f8bf3000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.184760] PKRU: 55555554 <4> [166.184761] Call Trace: <4> [166.184763] <TASK> <4> [166.184773] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.184781] ? lock_release+0xce/0x280 <7> [166.184724] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [166.184790] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.184799] process_one_work+0x22e/0x6b0 <4> [166.184808] worker_thread+0x1e8/0x3d0 <4> [166.184811] ? __pfx_worker_thread+0x10/0x10 <4> [166.184814] kthread+0x11f/0x250 <4> [166.184818] ? __pfx_kthread+0x10/0x10 <4> [166.184823] ret_from_fork+0x344/0x3a0 <4> [166.184826] ? __pfx_kthread+0x10/0x10 <4> [166.184830] ret_from_fork_asm+0x1a/0x30 <4> [166.184843] </TASK> <4> [166.184844] irq event stamp: 504999 <4> [166.184846] hardirqs last enabled at (505005): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.184849] hardirqs last disabled at (505010): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.184852] softirqs last enabled at (502322): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.184867] softirqs last disabled at (505021): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.184870] ---[ end trace 0000000000000000 ]--- <6> [166.184873] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [166.184872] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [166.184985] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.184995] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.185404] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.185965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.186047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.186131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.186211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.186289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.186365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.186440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.186515] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.186602] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.186709] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.187716] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.198432] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.198691] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.199996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.200067] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.200135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.200204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.200271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.200340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.200407] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.200473] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.200538] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.200603] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.200670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.200735] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.200800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.200879] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.200947] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.201012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.201075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.201141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.201206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.201279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.201351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.201420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.201491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.201559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.201626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.201695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.201768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.201843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.201913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.201981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.202050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.202124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.202197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.202271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.202341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.202411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.202478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.202545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.202610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.202678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.202743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.202809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.202887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.202960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.203028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.203095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.203161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.203228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.203294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.203360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.203428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.203494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.203562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.203627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.203695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.203759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.203823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.203909] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.205156] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.206016] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13223, lrc_seqno=13223, guc_id=0, flags=0x73 in no process [-1] <7> [166.206019] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.206075] ------------[ cut here ]------------ <4> [166.206076] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.206078] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#11: kworker/u64:6/194 <4> [166.206151] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.206208] efi_pstore nfnetlink autofs4 <4> [166.206213] CPU: 11 UID: 0 PID: 194 Comm: kworker/u64:6 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.206215] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.206216] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.206218] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.206222] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.206286] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.206287] RSP: 0018:ffffc900015dbc98 EFLAGS: 00010246 <4> [166.206290] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.206291] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.206292] RBP: ffffc900015dbda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.206293] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.206294] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.206295] FS: 0000000000000000(0000) GS:ffff8888db25d000(0000) knlGS:0000000000000000 <4> [166.206297] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.206298] CR2: 00007e09f8bf3000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.206299] PKRU: 55555554 <4> [166.206300] Call Trace: <4> [166.206301] <TASK> <4> [166.206306] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.206311] ? lock_release+0xce/0x280 <4> [166.206317] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.206322] process_one_work+0x22e/0x6b0 <4> [166.206327] worker_thread+0x1e8/0x3d0 <4> [166.206330] ? __pfx_worker_thread+0x10/0x10 <4> [166.206332] kthread+0x11f/0x250 <4> [166.206335] ? __pfx_kthread+0x10/0x10 <4> [166.206339] ret_from_fork+0x344/0x3a0 <4> [166.206341] ? __pfx_kthread+0x10/0x10 <4> [166.206343] ret_from_fork_asm+0x1a/0x30 <4> [166.206351] </TASK> <4> [166.206352] irq event stamp: 515637 <4> [166.206353] hardirqs last enabled at (515643): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.206356] hardirqs last disabled at (515648): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.206359] softirqs last enabled at (512360): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.206361] softirqs last disabled at (512355): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.206363] ---[ end trace 0000000000000000 ]--- <7> [166.208167] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.208265] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [166.209097] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13271, lrc_seqno=13271, guc_id=0, flags=0x73 in no process [-1] <7> [166.209105] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.209223] ------------[ cut here ]------------ <4> [166.209224] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.209226] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#14: kworker/u64:9/197 <4> [166.209349] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 <7> [166.209346] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <4> [166.209414] realtek <4> [166.209415] snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [166.209445] CPU: 14 UID: 0 PID: 197 Comm: kworker/u64:9 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.209449] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.209451] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.209452] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.209460] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.209575] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.209577] RSP: 0000:ffffc900015f3c98 EFLAGS: 00010246 <4> [166.209580] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.209582] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.209584] RBP: ffffc900015f3da8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.209585] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.209587] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.209589] FS: 0000000000000000(0000) GS:ffff8888db3dd000(0000) knlGS:0000000000000000 <4> [166.209591] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.209593] CR2: 00007e0a019e40a0 CR3: 0000000114fd8000 CR4: 0000000000f52ef0 <4> [166.209594] PKRU: 55555554 <4> [166.209596] Call Trace: <4> [166.209597] <TASK> <4> [166.209606] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.209614] ? lock_release+0xce/0x280 <4> [166.209622] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.209631] process_one_work+0x22e/0x6b0 <4> [166.209641] worker_thread+0x1e8/0x3d0 <4> [166.209645] ? __pfx_worker_thread+0x10/0x10 <4> [166.209648] kthread+0x11f/0x250 <4> [166.209652] ? __pfx_kthread+0x10/0x10 <7> [166.209597] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <4> [166.209657] ret_from_fork+0x344/0x3a0 <4> [166.209660] ? __pfx_kthread+0x10/0x10 <4> [166.209663] ret_from_fork_asm+0x1a/0x30 <4> [166.209675] </TASK> <4> [166.209677] irq event stamp: 322045 <4> [166.209678] hardirqs last enabled at (322051): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.209681] hardirqs last disabled at (322056): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.209684] softirqs last enabled at (319012): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.209687] softirqs last disabled at (318983): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.209690] ---[ end trace 0000000000000000 ]--- <6> [166.209692] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.209806] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.209817] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.210423] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.210859] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.211078] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.211282] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.211302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.211439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.211486] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.211590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.211686] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.211725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.211870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.211901] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.212006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.212100] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.212139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.212274] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.212413] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.212431] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.212590] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.212723] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.213093] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.213386] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.213666] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.213957] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.214234] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.214603] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.214772] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.214903] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.215181] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.223322] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.223489] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.223606] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.223717] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.223873] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.223993] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.224103] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.224211] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.224318] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.224424] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.224531] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.224634] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.224739] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.224821] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.224931] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.225041] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.225144] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.225169] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.225246] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.225349] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.225452] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.225554] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.225654] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.225758] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.226111] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.226215] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.226354] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.226459] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.226594] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.226613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.226694] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.226716] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.226768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.227239] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.227321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.227403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.227475] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.227559] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.227626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.227708] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.227774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.227863] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.228124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.228188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.228257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.228327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.228397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.228471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.228543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.228618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.228691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.228762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.228841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.228909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.228976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.229045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.229125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.229196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.229266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.229336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.229404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.229482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.229558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.229633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.229704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.229774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.229851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.229921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.229987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.230055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.230122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.230188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.230253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.230323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.230389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.230454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.230520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.230587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.230652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.230717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.230784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.230867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.230948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.231025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.231097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.231161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.231227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.231294] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.232649] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.233665] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13271, lrc_seqno=13271, guc_id=0, flags=0x73 in no process [-1] <7> [166.233669] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.233725] ------------[ cut here ]------------ <4> [166.233727] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.233728] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#6: kworker/u64:6/194 <4> [166.233802] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.233867] efi_pstore nfnetlink autofs4 <4> [166.233871] CPU: 6 UID: 0 PID: 194 Comm: kworker/u64:6 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.233875] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.233876] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.233877] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.233883] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.233946] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.233948] RSP: 0018:ffffc900015dbc98 EFLAGS: 00010246 <4> [166.233950] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.233952] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.233953] RBP: ffffc900015dbda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.233954] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.233955] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.233956] FS: 0000000000000000(0000) GS:ffff8888dafdd000(0000) knlGS:0000000000000000 <4> [166.233958] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.233959] CR2: 00007e09ff4cd000 CR3: 0000000120a6c000 CR4: 0000000000f52ef0 <4> [166.233960] PKRU: 55555554 <4> [166.233961] Call Trace: <4> [166.233963] <TASK> <4> [166.233968] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.233973] ? lock_release+0xce/0x280 <4> [166.233980] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.233985] process_one_work+0x22e/0x6b0 <4> [166.233992] worker_thread+0x1e8/0x3d0 <4> [166.233994] ? __pfx_worker_thread+0x10/0x10 <4> [166.233996] kthread+0x11f/0x250 <4> [166.234000] ? __pfx_kthread+0x10/0x10 <4> [166.234003] ret_from_fork+0x344/0x3a0 <4> [166.234006] ? __pfx_kthread+0x10/0x10 <4> [166.234009] ret_from_fork_asm+0x1a/0x30 <4> [166.234017] </TASK> <4> [166.234018] irq event stamp: 526673 <4> [166.234019] hardirqs last enabled at (526679): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.234022] hardirqs last disabled at (526684): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.234024] softirqs last enabled at (524256): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.234027] softirqs last disabled at (524249): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.234029] ---[ end trace 0000000000000000 ]--- <6> [166.234031] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.234097] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.234105] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.234152] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.234249] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.234348] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.234999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.235088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.235180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.235268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.235346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.235421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.235510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.235586] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.235675] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.235802] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.236953] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.246786] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.247075] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.248455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.248525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.248593] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.248661] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.248727] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.248801] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.248871] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.248940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.249007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.249072] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.249136] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.249198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.249261] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.249324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.249389] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.249453] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.249517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.249580] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.249646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.249721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.249798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.249869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.249940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.250010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.250077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.250147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.250219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.250288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.250356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.250424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.250493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.250568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.250642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.250714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.250789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.250860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.250928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.250995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.251059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.251125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.251190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.251257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.251322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.251394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.251460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.251529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.251595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.251662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.251726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.251796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.251864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.251930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.251994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.252059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.252124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.252187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.252251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.252319] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.253684] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.254534] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13271, lrc_seqno=13271, guc_id=0, flags=0x73 in no process [-1] <7> [166.254537] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.254594] ------------[ cut here ]------------ <4> [166.254596] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.254597] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#6: kworker/u64:6/194 <4> [166.254665] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.254727] efi_pstore nfnetlink autofs4 <4> [166.254731] CPU: 6 UID: 0 PID: 194 Comm: kworker/u64:6 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.254734] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.254735] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.254737] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.254742] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.254816] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.254818] RSP: 0018:ffffc900015dbc98 EFLAGS: 00010246 <4> [166.254820] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.254822] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.254823] RBP: ffffc900015dbda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.254824] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.254825] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.254827] FS: 0000000000000000(0000) GS:ffff8888dafdd000(0000) knlGS:0000000000000000 <4> [166.254828] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.254829] CR2: 00007e09ff4cd000 CR3: 0000000120a6c000 CR4: 0000000000f52ef0 <4> [166.254831] PKRU: 55555554 <4> [166.254832] Call Trace: <4> [166.254833] <TASK> <4> [166.254838] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.254843] ? lock_release+0xce/0x280 <4> [166.254850] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.254855] process_one_work+0x22e/0x6b0 <4> [166.254861] worker_thread+0x1e8/0x3d0 <4> [166.254864] ? __pfx_worker_thread+0x10/0x10 <4> [166.254866] kthread+0x11f/0x250 <4> [166.254870] ? __pfx_kthread+0x10/0x10 <4> [166.254873] ret_from_fork+0x344/0x3a0 <4> [166.254876] ? __pfx_kthread+0x10/0x10 <4> [166.254879] ret_from_fork_asm+0x1a/0x30 <4> [166.254887] </TASK> <4> [166.254888] irq event stamp: 537341 <4> [166.254889] hardirqs last enabled at (537347): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.254892] hardirqs last disabled at (537352): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.254894] softirqs last enabled at (534894): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.254897] softirqs last disabled at (534887): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.254899] ---[ end trace 0000000000000000 ]--- <7> [166.257747] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.257872] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.258203] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <5> [166.258535] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13336, lrc_seqno=13336, guc_id=0, flags=0x73 in no process [-1] <7> [166.258540] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.258602] ------------[ cut here ]------------ <4> [166.258603] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.258605] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#9: kworker/u64:25/2840 <7> [166.258594] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <4> [166.258680] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.258742] efi_pstore nfnetlink autofs4 <4> [166.258746] CPU: 9 UID: 0 PID: 2840 Comm: kworker/u64:25 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.258749] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.258750] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.258752] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.258757] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <7> [166.258752] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.258844] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.258846] RSP: 0000:ffffc90004eafc98 EFLAGS: 00010246 <4> [166.258848] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.258849] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.258850] RBP: ffffc90004eafda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.258851] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.258852] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.258854] FS: 0000000000000000(0000) GS:ffff8888db15d000(0000) knlGS:0000000000000000 <4> [166.258855] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.258856] CR2: 00007e09f8933000 CR3: 00000001f307b000 CR4: 0000000000f52ef0 <4> [166.258857] PKRU: 55555554 <4> [166.258858] Call Trace: <4> [166.258859] <TASK> <4> [166.258864] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.258871] ? lock_release+0xce/0x280 <4> [166.258877] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.258882] process_one_work+0x22e/0x6b0 <4> [166.258889] worker_thread+0x1e8/0x3d0 <4> [166.258891] ? __pfx_worker_thread+0x10/0x10 <4> [166.258894] kthread+0x11f/0x250 <4> [166.258897] ? __pfx_kthread+0x10/0x10 <4> [166.258900] ret_from_fork+0x344/0x3a0 <4> [166.258902] ? __pfx_kthread+0x10/0x10 <4> [166.258905] ret_from_fork_asm+0x1a/0x30 <4> [166.258913] </TASK> <4> [166.258914] irq event stamp: 464963 <4> [166.258915] hardirqs last enabled at (464969): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.258918] hardirqs last disabled at (464974): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.258920] softirqs last enabled at (464802): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.258923] softirqs last disabled at (464797): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.258925] ---[ end trace 0000000000000000 ]--- <6> [166.258927] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.258995] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.259001] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.258973] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.259018] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.259100] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.259229] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.259346] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.259464] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.259616] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.259869] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.259898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.259987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.260073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.260109] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.260154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.260230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.260287] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.260305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.260382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.260459] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.260456] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.260545] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.260623] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.260654] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.260852] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.261256] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.261519] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.261665] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.261709] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.269584] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.269699] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.269835] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.269965] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.270072] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.270177] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.270285] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.270388] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.270492] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.270596] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.270701] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.270873] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.270980] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.271135] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.271243] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.271347] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.271447] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.271547] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.271647] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.271756] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.271756] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.271891] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.271995] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.272014] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.272100] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.272202] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.272304] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.272406] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.272529] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.272645] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.273336] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.273408] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.273476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.273543] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.273612] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.273679] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.273748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.273815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.273883] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.273951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.274019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.274089] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.274156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.274222] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.274287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.274351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.274417] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.274482] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.274547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.274620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.274693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.274770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.274845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.274914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.274980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.275049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.275122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.275191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.275258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.275329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.275397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.275470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.275543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.275617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.275689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.275761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.275828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.275894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.275958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.276025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.276089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.276154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.276217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.276286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.276351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.276417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.276484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.276552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.276618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.276685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.276756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.276822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.276889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.276954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.277020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.277083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.277146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.277213] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.278706] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.279756] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13336, lrc_seqno=13336, guc_id=0, flags=0x73 in no process [-1] <7> [166.279762] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.279874] ------------[ cut here ]------------ <4> [166.279875] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.279877] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#13: kworker/u64:6/194 <4> [166.279993] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.280082] efi_pstore nfnetlink autofs4 <4> [166.280088] CPU: 13 UID: 0 PID: 194 Comm: kworker/u64:6 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.280092] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.280093] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.280095] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.280103] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.280214] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.280216] RSP: 0018:ffffc900015dbc98 EFLAGS: 00010246 <4> [166.280219] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.280221] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.280222] RBP: ffffc900015dbda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.280224] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.280225] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.280227] FS: 0000000000000000(0000) GS:ffff8888db35d000(0000) knlGS:0000000000000000 <4> [166.280229] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.280231] CR2: 00007e09ff4cd000 CR3: 0000000162c00000 CR4: 0000000000f52ef0 <4> [166.280233] PKRU: 55555554 <4> [166.280234] Call Trace: <4> [166.280236] <TASK> <4> [166.280245] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <7> [166.280169] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [166.280252] ? lock_release+0xce/0x280 <4> [166.280262] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.280270] process_one_work+0x22e/0x6b0 <4> [166.280280] worker_thread+0x1e8/0x3d0 <4> [166.280283] ? __pfx_worker_thread+0x10/0x10 <4> [166.280286] kthread+0x11f/0x250 <4> [166.280291] ? __pfx_kthread+0x10/0x10 <4> [166.280295] ret_from_fork+0x344/0x3a0 <4> [166.280298] ? __pfx_kthread+0x10/0x10 <4> [166.280302] ret_from_fork_asm+0x1a/0x30 <4> [166.280314] </TASK> <4> [166.280315] irq event stamp: 548869 <4> [166.280316] hardirqs last enabled at (548875): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.280319] hardirqs last disabled at (548880): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.280322] softirqs last enabled at (545426): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.280325] softirqs last disabled at (545421): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.280328] ---[ end trace 0000000000000000 ]--- <6> [166.280330] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [166.280334] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [166.280445] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <5> [166.280457] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=255, flags=0x0 in xe_compute_pree [3849] <7> [166.280460] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [166.280622] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=259, flags=0x0 in xe_compute_pree [3849] <7> [166.280627] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [166.280786] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=263, flags=0x0 in xe_compute_pree [3849] <7> [166.280790] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [166.280939] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=289, flags=0x0 in xe_compute_pree [3849] <7> [166.280945] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [166.281096] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.281118] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.281957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.282051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.282141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.282221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.282301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.282376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.282453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.282526] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.282616] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.282723] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.283762] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.293726] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.293984] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.295260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.295331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.295400] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.295470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.295537] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.295603] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.295668] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.295786] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.295853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.295918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.295985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.296051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.296117] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.296181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.296246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.296313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.296378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.296445] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.296509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.296583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.296656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.296734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.296807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.296877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.296946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.297015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.297089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.297161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.297230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.297298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.297365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.297437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.297510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.297584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.297654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.297733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.297801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.297867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.297932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.298001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.298072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.298140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.298205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.298275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.298341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.298409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.298473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.298538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.298603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.298667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.298744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.298811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.298876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.298939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.299005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.299070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.299135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.299203] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.300489] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.300762] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13336, lrc_seqno=13336, guc_id=0, flags=0x73 in no process [-1] <7> [166.300771] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.301120] ------------[ cut here ]------------ <4> [166.301123] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.301126] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#3: kworker/u64:6/194 <4> [166.301374] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.301441] efi_pstore nfnetlink autofs4 <4> [166.301446] CPU: 3 UID: 0 PID: 194 Comm: kworker/u64:6 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.301449] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.301450] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.301452] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.301457] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <7> [166.301490] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [166.301565] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.301567] RSP: 0018:ffffc900015dbc98 EFLAGS: 00010246 <4> [166.301570] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.301572] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.301574] RBP: ffffc900015dbda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.301575] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.301577] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.301578] FS: 0000000000000000(0000) GS:ffff8888dae5d000(0000) knlGS:0000000000000000 <4> [166.301580] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.301581] CR2: 00007e09ff4cd000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.301583] PKRU: 55555554 <4> [166.301585] Call Trace: <4> [166.301586] <TASK> <4> [166.301593] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.301601] ? lock_release+0xce/0x280 <4> [166.301610] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.301619] process_one_work+0x22e/0x6b0 <4> [166.301629] worker_thread+0x1e8/0x3d0 <4> [166.301634] ? __pfx_worker_thread+0x10/0x10 <4> [166.301637] kthread+0x11f/0x250 <4> [166.301642] ? __pfx_kthread+0x10/0x10 <4> [166.301647] ret_from_fork+0x344/0x3a0 <4> [166.301650] ? __pfx_kthread+0x10/0x10 <4> [166.301654] ret_from_fork_asm+0x1a/0x30 <4> [166.301665] </TASK> <4> [166.301666] irq event stamp: 560083 <4> [166.301668] hardirqs last enabled at (560089): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.301671] hardirqs last disabled at (560094): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.301674] softirqs last enabled at (556860): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.301677] softirqs last disabled at (556837): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.301681] ---[ end trace 0000000000000000 ]--- <7> [166.301638] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [166.303510] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=200, flags=0x0 in xe_compute_pree [3849] <7> [166.303514] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [166.303645] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=214, flags=0x0 in xe_compute_pree [3849] <7> [166.303651] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [166.304225] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13387, lrc_seqno=13387, guc_id=0, flags=0x73 in no process [-1] <7> [166.304216] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.304231] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.304337] ------------[ cut here ]------------ <4> [166.304338] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.304340] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#12: kworker/u64:25/2840 <4> [166.304454] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate <7> [166.304453] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <4> [166.304513] snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [166.304546] CPU: 12 UID: 0 PID: 2840 Comm: kworker/u64:25 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.304549] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.304551] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.304552] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.304559] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.304671] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.304673] RSP: 0018:ffffc90004eafc98 EFLAGS: 00010246 <4> [166.304676] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.304678] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.304680] RBP: ffffc90004eafda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.304681] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.304683] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.304685] FS: 0000000000000000(0000) GS:ffff8888db2dd000(0000) knlGS:0000000000000000 <4> [166.304687] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.304688] CR2: 00007e09f8a43000 CR3: 0000000158c00000 CR4: 0000000000f52ef0 <4> [166.304690] PKRU: 55555554 <4> [166.304692] Call Trace: <4> [166.304693] <TASK> <4> [166.304709] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.304717] ? lock_release+0xce/0x280 <4> [166.304726] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.304735] process_one_work+0x22e/0x6b0 <7> [166.304678] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.304745] worker_thread+0x1e8/0x3d0 <4> [166.304748] ? __pfx_worker_thread+0x10/0x10 <4> [166.304751] kthread+0x11f/0x250 <4> [166.304755] ? __pfx_kthread+0x10/0x10 <4> [166.304760] ret_from_fork+0x344/0x3a0 <4> [166.304763] ? __pfx_kthread+0x10/0x10 <4> [166.304766] ret_from_fork_asm+0x1a/0x30 <4> [166.304779] </TASK> <4> [166.304780] irq event stamp: 469309 <4> [166.304781] hardirqs last enabled at (469315): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.304784] hardirqs last disabled at (469320): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.304787] softirqs last enabled at (468474): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.304790] softirqs last disabled at (468467): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.304792] ---[ end trace 0000000000000000 ]--- <6> [166.304795] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.304911] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.304919] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.304905] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.304938] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.305116] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.305314] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.305511] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.305723] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.305771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.305864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.305926] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.305952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.306032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.306110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.306186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.306263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.306248] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.306338] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.306426] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.306534] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.306525] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.306856] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.307194] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.307489] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.307549] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.307856] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.308149] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.308426] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.308714] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.308994] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.309338] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.309621] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.309909] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.317696] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.317812] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.317961] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.317967] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.318077] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.318190] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.318298] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.318405] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.318512] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.318619] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.318732] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.318837] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.318944] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.319050] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.319154] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.319239] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.319310] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.319313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.319383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.319418] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.319452] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.319519] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.319522] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.319588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.319620] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.319654] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.319726] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.319733] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.319799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.319826] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.319864] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.319927] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.319929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.319995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.320028] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.320059] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.320124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.320131] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.320188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.320236] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.320253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.320318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.320339] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.320381] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.320442] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.320446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.320522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.320545] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.320597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.320668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.320675] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.320758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.320828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.320896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.320968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.321040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.321111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.321181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.321251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.321320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.321394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.321468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.321542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.321613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.321686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.321782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.321864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.321943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.322018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.322086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.322153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.322218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.322288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.322353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.322420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.322485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.322553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.322617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.322690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.322763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.322830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.322896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.322960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.323027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.323091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.323157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.323225] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.324515] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.325374] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13387, lrc_seqno=13387, guc_id=0, flags=0x73 in no process [-1] <7> [166.325377] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.325434] ------------[ cut here ]------------ <4> [166.325435] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.325436] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#11: kworker/u64:25/2840 <4> [166.325503] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.325567] efi_pstore nfnetlink autofs4 <4> [166.325572] CPU: 11 UID: 0 PID: 2840 Comm: kworker/u64:25 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.325575] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.325576] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.325577] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.325583] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.325648] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.325650] RSP: 0018:ffffc90004eafc98 EFLAGS: 00010246 <4> [166.325652] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.325653] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.325655] RBP: ffffc90004eafda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.325656] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.325657] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.325658] FS: 0000000000000000(0000) GS:ffff8888db25d000(0000) knlGS:0000000000000000 <4> [166.325659] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.325661] CR2: 0000785eaa343000 CR3: 0000000167787000 CR4: 0000000000f52ef0 <4> [166.325662] PKRU: 55555554 <4> [166.325663] Call Trace: <4> [166.325664] <TASK> <4> [166.325669] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.325674] ? lock_release+0xce/0x280 <4> [166.325685] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.325690] process_one_work+0x22e/0x6b0 <4> [166.325697] worker_thread+0x1e8/0x3d0 <4> [166.325699] ? __pfx_worker_thread+0x10/0x10 <4> [166.325702] kthread+0x11f/0x250 <4> [166.325705] ? __pfx_kthread+0x10/0x10 <4> [166.325709] ret_from_fork+0x344/0x3a0 <4> [166.325711] ? __pfx_kthread+0x10/0x10 <4> [166.325714] ret_from_fork_asm+0x1a/0x30 <4> [166.325722] </TASK> <4> [166.325723] irq event stamp: 479991 <4> [166.325724] hardirqs last enabled at (479997): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.325727] hardirqs last disabled at (480002): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.325729] softirqs last enabled at (476762): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.325731] softirqs last disabled at (476755): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.325734] ---[ end trace 0000000000000000 ]--- <6> [166.325735] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.325801] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <5> [166.325809] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=135, flags=0x0 in xe_compute_pree [3849] <7> [166.325812] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [166.326152] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=172, flags=0x0 in xe_compute_pree [3849] <7> [166.326156] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [166.326168] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.326273] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [166.326419] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=260, flags=0x0 in xe_compute_pree [3849] <7> [166.326424] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [166.326706] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=269, flags=0x0 in xe_compute_pree [3849] <7> [166.326710] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [166.326964] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.327024] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.327837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.327930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.328018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.328097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.328175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.328251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.328329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.328404] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.328493] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.328603] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.329615] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.339669] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.339926] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.341213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.341287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.341354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.341423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.341492] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.341558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.341624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.341706] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.341772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.341838] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.341902] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.341966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.342033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.342098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.342162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.342228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.342293] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.342357] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.342421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.342496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.342569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.342640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.342724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.342793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.342861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.342929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.343002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.343071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.343139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.343207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.343274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.343349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.343424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.343498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.343569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.343638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.343722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.343790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.343858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.343926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.343992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.344057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.344122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.344192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.344256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.344321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.344384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.344449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.344512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.344577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.344642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.344725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.344794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.344860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.344929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.344993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.345059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.345127] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.346243] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.347098] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13387, lrc_seqno=13387, guc_id=0, flags=0x73 in no process [-1] <7> [166.347101] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.347157] ------------[ cut here ]------------ <4> [166.347158] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.347159] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#6: kworker/u64:25/2840 <4> [166.347230] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.347292] efi_pstore nfnetlink autofs4 <4> [166.347297] CPU: 6 UID: 0 PID: 2840 Comm: kworker/u64:25 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.347300] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.347301] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.347303] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.347308] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.347373] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.347374] RSP: 0018:ffffc90004eafc98 EFLAGS: 00010246 <4> [166.347376] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.347378] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.347379] RBP: ffffc90004eafda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.347380] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.347381] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.347382] FS: 0000000000000000(0000) GS:ffff8888dafdd000(0000) knlGS:0000000000000000 <4> [166.347383] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.347385] CR2: 00007e09ff4cd000 CR3: 0000000110555000 CR4: 0000000000f52ef0 <4> [166.347386] PKRU: 55555554 <4> [166.347387] Call Trace: <4> [166.347388] <TASK> <4> [166.347393] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.347398] ? lock_release+0xce/0x280 <4> [166.347404] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.347409] process_one_work+0x22e/0x6b0 <4> [166.347416] worker_thread+0x1e8/0x3d0 <4> [166.347418] ? __pfx_worker_thread+0x10/0x10 <4> [166.347420] kthread+0x11f/0x250 <4> [166.347424] ? __pfx_kthread+0x10/0x10 <4> [166.347427] ret_from_fork+0x344/0x3a0 <4> [166.347430] ? __pfx_kthread+0x10/0x10 <4> [166.347432] ret_from_fork_asm+0x1a/0x30 <4> [166.347440] </TASK> <4> [166.347441] irq event stamp: 490891 <4> [166.347442] hardirqs last enabled at (490897): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.347445] hardirqs last disabled at (490902): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.347447] softirqs last enabled at (487460): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.347450] softirqs last disabled at (487451): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.347452] ---[ end trace 0000000000000000 ]--- <7> [166.349830] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.349982] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.350226] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <5> [166.350351] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13443, lrc_seqno=13443, guc_id=0, flags=0x73 in no process [-1] <7> [166.350354] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.350410] ------------[ cut here ]------------ <4> [166.350411] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [166.350379] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <4> [166.350412] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#6: kworker/u64:25/2840 <4> [166.350481] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.350538] efi_pstore nfnetlink autofs4 <4> [166.350541] CPU: 6 UID: 0 PID: 2840 Comm: kworker/u64:25 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.350544] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.350545] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.350546] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.350551] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.350618] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.350619] RSP: 0018:ffffc90004eafc98 EFLAGS: 00010246 <4> [166.350621] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.350622] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.350623] RBP: ffffc90004eafda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.350624] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.350625] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.350626] FS: 0000000000000000(0000) GS:ffff8888dafdd000(0000) knlGS:0000000000000000 <4> [166.350628] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.350629] CR2: 00007e09ff4cd000 CR3: 000000011ed6d000 CR4: 0000000000f52ef0 <4> [166.350630] PKRU: 55555554 <4> [166.350631] Call Trace: <4> [166.350632] <TASK> <4> [166.350637] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.350642] ? lock_release+0xce/0x280 <4> [166.350655] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.350660] process_one_work+0x22e/0x6b0 <4> [166.350666] worker_thread+0x1e8/0x3d0 <4> [166.350669] ? __pfx_worker_thread+0x10/0x10 <4> [166.350671] kthread+0x11f/0x250 <4> [166.350674] ? __pfx_kthread+0x10/0x10 <4> [166.350678] ret_from_fork+0x344/0x3a0 <4> [166.350680] ? __pfx_kthread+0x10/0x10 <4> [166.350683] ret_from_fork_asm+0x1a/0x30 <4> [166.350690] </TASK> <4> [166.350691] irq event stamp: 492103 <4> [166.350692] hardirqs last enabled at (492109): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.350695] hardirqs last disabled at (492114): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.350697] softirqs last enabled at (492040): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.350699] softirqs last disabled at (492031): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.350701] ---[ end trace 0000000000000000 ]--- <6> [166.350703] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.350768] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.350774] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.350791] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.350925] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.351050] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.351167] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.351300] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.351420] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.351417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.351504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.351537] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.351590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.351660] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.351673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.351750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.351825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.351855] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.351902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.351977] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.352021] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.352066] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.352175] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.352185] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.352520] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.352794] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.353025] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.353182] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.353212] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.353372] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.353614] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.353795] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.353961] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.361644] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.361770] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.361882] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.361990] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.362094] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.362199] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.362303] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.362408] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.362513] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.362618] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.363106] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.363215] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.363319] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.363473] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.363580] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.363638] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.363690] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.363800] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.363896] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.363903] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.364004] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.364105] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.364206] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.364309] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.364411] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.364513] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.364615] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.364731] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.364856] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.365207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.365279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.365348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.365417] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.365484] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.365551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.365618] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.365699] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.365764] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.365832] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.365899] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.365967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.366033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.366099] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.366166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.366232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.366297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.366361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.366425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.366499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.366572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.366644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.366716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.366783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.366850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.366921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.366992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.367063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.367132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.367201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.367271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.367345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.367419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.367493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.367564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.367635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.367702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.367769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.367833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.367901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.367968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.368034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.368100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.368169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.368234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.368299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.368365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.368431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.368495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.368559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.368632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.368700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.368766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.368830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.368898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.368963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.369028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.369095] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.370312] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.371166] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13443, lrc_seqno=13443, guc_id=0, flags=0x73 in no process [-1] <7> [166.371168] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.371225] ------------[ cut here ]------------ <4> [166.371226] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.371227] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#8: kworker/u64:6/194 <4> [166.371296] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.371355] efi_pstore nfnetlink autofs4 <4> [166.371360] CPU: 8 UID: 0 PID: 194 Comm: kworker/u64:6 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.371363] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.371364] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.371365] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.371370] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.371434] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.371436] RSP: 0018:ffffc900015dbc98 EFLAGS: 00010246 <4> [166.371438] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.371439] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.371441] RBP: ffffc900015dbda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.371442] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.371443] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.371444] FS: 0000000000000000(0000) GS:ffff8888db0dd000(0000) knlGS:0000000000000000 <4> [166.371445] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.371447] CR2: 00007e09ff4cd000 CR3: 00000001743fa000 CR4: 0000000000f52ef0 <4> [166.371448] PKRU: 55555554 <4> [166.371449] Call Trace: <4> [166.371450] <TASK> <4> [166.371456] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.371460] ? lock_release+0xce/0x280 <4> [166.371466] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.371471] process_one_work+0x22e/0x6b0 <4> [166.371477] worker_thread+0x1e8/0x3d0 <4> [166.371479] ? __pfx_worker_thread+0x10/0x10 <4> [166.371481] kthread+0x11f/0x250 <4> [166.371484] ? __pfx_kthread+0x10/0x10 <4> [166.371488] ret_from_fork+0x344/0x3a0 <4> [166.371490] ? __pfx_kthread+0x10/0x10 <4> [166.371493] ret_from_fork_asm+0x1a/0x30 <4> [166.371500] </TASK> <4> [166.371501] irq event stamp: 574331 <4> [166.371502] hardirqs last enabled at (574337): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.371505] hardirqs last disabled at (574342): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.371507] softirqs last enabled at (572100): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.371510] softirqs last disabled at (572093): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.371512] ---[ end trace 0000000000000000 ]--- <6> [166.371514] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.371578] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <7> [166.371593] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.371708] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [166.371820] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=281, flags=0x0 in xe_compute_pree [3849] <7> [166.371823] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [166.372288] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=285, flags=0x0 in xe_compute_pree [3849] <7> [166.372301] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [166.372571] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.372627] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.373190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.373277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.373365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.373445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.373522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.373599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.373691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.373764] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.373853] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.373964] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.374972] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.385961] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.386218] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.387502] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.387574] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.387655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.387724] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.387793] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.387861] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.387928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.387996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.388062] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.388129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.388194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.388258] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.388326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.388391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.388457] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.388523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.388587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.388717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.388841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.388919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.388993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.389064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.389134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.389201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.389269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.389337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.389409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.389479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.389546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.389620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.389690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.389765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.389837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.389910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.389980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.390048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.390114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.390181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.390247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.390316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.390382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.390448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.390513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.390582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.390661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.390731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.390805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.390872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.390937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.391004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.391072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.391141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.391208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.391274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.391341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.391406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.391470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.391538] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.392785] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.393616] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13443, lrc_seqno=13443, guc_id=0, flags=0x73 in no process [-1] <7> [166.393621] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.393726] ------------[ cut here ]------------ <4> [166.393727] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.393729] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#12: kworker/u64:20/2835 <7> [166.393768] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [166.393839] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.393926] efi_pstore nfnetlink <7> [166.393880] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [166.393929] autofs4 <4> [166.393933] CPU: 12 UID: 0 PID: 2835 Comm: kworker/u64:20 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.393937] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.393938] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.393940] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.393947] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.394055] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.394058] RSP: 0018:ffffc9000419bc98 EFLAGS: 00010246 <4> [166.394060] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.394062] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.394064] RBP: ffffc9000419bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.394066] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.394067] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.394069] FS: 0000000000000000(0000) GS:ffff8888db2dd000(0000) knlGS:0000000000000000 <4> [166.394071] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.394073] CR2: 00007e09f8a43000 CR3: 0000000164737000 CR4: 0000000000f52ef0 <4> [166.394075] PKRU: 55555554 <4> [166.394076] Call Trace: <4> [166.394078] <TASK> <4> [166.394087] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.394094] ? lock_release+0xce/0x280 <4> [166.394103] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.394112] process_one_work+0x22e/0x6b0 <4> [166.394121] worker_thread+0x1e8/0x3d0 <4> [166.394125] ? __pfx_worker_thread+0x10/0x10 <4> [166.394128] kthread+0x11f/0x250 <4> [166.394133] ? __pfx_kthread+0x10/0x10 <4> [166.394137] ret_from_fork+0x344/0x3a0 <4> [166.394140] ? __pfx_kthread+0x10/0x10 <4> [166.394144] ret_from_fork_asm+0x1a/0x30 <4> [166.394156] </TASK> <4> [166.394158] irq event stamp: 104063 <4> [166.394159] hardirqs last enabled at (104069): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.394162] hardirqs last disabled at (104074): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.394165] softirqs last enabled at (100800): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.394168] softirqs last disabled at (100795): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.394171] ---[ end trace 0000000000000000 ]--- <7> [166.396824] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <5> [166.396955] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13493, lrc_seqno=13493, guc_id=0, flags=0x73 in no process [-1] <7> [166.396959] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [166.396979] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <4> [166.397020] ------------[ cut here ]------------ <4> [166.397021] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.397022] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#7: kworker/u64:40/2856 <4> [166.397091] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <7> [166.397114] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.397150] efi_pstore nfnetlink autofs4 <4> [166.397153] CPU: 7 UID: 0 PID: 2856 Comm: kworker/u64:40 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.397156] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.397157] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.397158] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.397162] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.397228] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.397230] RSP: 0018:ffffc9000585fc98 EFLAGS: 00010246 <4> [166.397232] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.397233] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.397234] RBP: ffffc9000585fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.397235] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.397236] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.397238] FS: 0000000000000000(0000) GS:ffff8888db05d000(0000) knlGS:0000000000000000 <4> [166.397239] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.397240] CR2: 00007e09ff4cd000 CR3: 0000000162c00000 CR4: 0000000000f52ef0 <4> [166.397242] PKRU: 55555554 <4> [166.397243] Call Trace: <4> [166.397244] <TASK> <4> [166.397249] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.397253] ? lock_release+0xce/0x280 <4> [166.397259] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.397264] process_one_work+0x22e/0x6b0 <7> [166.397235] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.397269] worker_thread+0x1e8/0x3d0 <4> [166.397272] ? __pfx_worker_thread+0x10/0x10 <4> [166.397274] kthread+0x11f/0x250 <4> [166.397277] ? __pfx_kthread+0x10/0x10 <4> [166.397280] ret_from_fork+0x344/0x3a0 <4> [166.397282] ? __pfx_kthread+0x10/0x10 <4> [166.397284] ret_from_fork_asm+0x1a/0x30 <4> [166.397292] </TASK> <4> [166.397293] irq event stamp: 268393 <4> [166.397293] hardirqs last enabled at (268399): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.397296] hardirqs last disabled at (268404): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.397298] softirqs last enabled at (267538): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.397300] softirqs last disabled at (267531): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.397304] ---[ end trace 0000000000000000 ]--- <6> [166.397306] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.397372] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.397379] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.397354] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.397400] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.397473] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.397588] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.397730] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.397848] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.398050] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.398114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.398210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.398220] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.398300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.398380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.398385] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.398457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.398534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.398617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.398633] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.398693] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.398782] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.398815] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.398892] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.398980] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.399202] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.399425] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.399904] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.399927] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.400093] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.400252] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.408086] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.408196] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.408300] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.408403] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.408507] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.408617] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.408722] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.408825] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.408929] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.409034] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.409137] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.409241] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.409345] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.409500] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.409613] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.409716] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.409819] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.409919] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.410020] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.410122] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.410224] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.410324] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.410424] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.410526] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.410583] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.410635] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.410744] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.410841] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.410867] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.412157] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.412229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.412296] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.412364] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.412432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.412498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.412565] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.412646] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.412713] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.412778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.412843] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.412907] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.412974] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.413039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.413103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.413168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.413234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.413299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.413367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.413440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.413512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.413587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.413659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.413727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.413795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.413863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.413934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.414002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.414073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.414143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.414213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.414287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.414359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.414430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.414501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.414577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.414646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.414715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.414781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.414851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.414920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.414987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.415053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.415122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.415189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.415255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.415319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.415384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.415448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.415510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.415580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.415645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.415711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.415777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.415843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.415905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.415970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.416039] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.417515] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.418398] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13493, lrc_seqno=13493, guc_id=0, flags=0x73 in no process [-1] <7> [166.418401] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.418462] ------------[ cut here ]------------ <4> [166.418463] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.418465] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#2: kworker/u64:49/2865 <4> [166.418538] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.418604] efi_pstore nfnetlink autofs4 <4> [166.418608] CPU: 2 UID: 0 PID: 2865 Comm: kworker/u64:49 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.418611] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.418612] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.418613] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.418618] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.418686] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.418687] RSP: 0018:ffffc900058a7c98 EFLAGS: 00010246 <4> [166.418690] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.418691] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.418692] RBP: ffffc900058a7da8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.418693] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.418694] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.418695] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [166.418697] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.418698] CR2: 00007e09ff4cd000 CR3: 000000019969f000 CR4: 0000000000f52ef0 <4> [166.418699] PKRU: 55555554 <4> [166.418700] Call Trace: <4> [166.418701] <TASK> <4> [166.418707] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.418711] ? lock_release+0xce/0x280 <4> [166.418717] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.418721] process_one_work+0x22e/0x6b0 <4> [166.418728] worker_thread+0x1e8/0x3d0 <4> [166.418730] ? __pfx_worker_thread+0x10/0x10 <4> [166.418732] kthread+0x11f/0x250 <4> [166.418735] ? __pfx_kthread+0x10/0x10 <4> [166.418739] ret_from_fork+0x344/0x3a0 <4> [166.418740] ? __pfx_kthread+0x10/0x10 <4> [166.418743] ret_from_fork_asm+0x1a/0x30 <4> [166.418751] </TASK> <4> [166.418752] irq event stamp: 597525 <4> [166.418753] hardirqs last enabled at (597531): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.418755] hardirqs last disabled at (597536): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.418757] softirqs last enabled at (594290): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.418760] softirqs last disabled at (594283): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.418762] ---[ end trace 0000000000000000 ]--- <6> [166.418764] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.418831] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <5> [166.418838] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=177, flags=0x0 in xe_compute_pree [3849] <7> [166.418841] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [166.418937] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=267, flags=0x0 in xe_compute_pree [3849] <7> [166.418941] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [166.418958] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [166.419041] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.419061] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.419160] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.419774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.419857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.419943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.420021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.420097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.420172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.420246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.420318] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.420406] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.420516] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.421533] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.432262] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.432525] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.433839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.433913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.433982] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.434052] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.434120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.434188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.434254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.434320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.434385] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.434450] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.434515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.434597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.434663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.434729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.434794] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.434858] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.434922] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.434988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.435054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.435129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.435203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.435273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.435343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.435412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.435481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.435556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.435630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.435700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.435768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.435836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.435905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.435978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.436050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.436123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.436194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.436264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.436330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.436396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.436460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.436527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.436606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.436673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.436739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.436810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.436877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.436942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.437007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.437074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.437140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.437204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.437271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.437339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.437410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.437478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.437550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.437617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.437682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.437751] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.438943] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.439613] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13493, lrc_seqno=13493, guc_id=0, flags=0x73 in no process [-1] <7> [166.439620] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.439717] ------------[ cut here ]------------ <4> [166.439720] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.439722] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#1: kworker/u64:44/2860 <4> [166.439800] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.439860] efi_pstore nfnetlink autofs4 <4> [166.439866] CPU: 1 UID: 0 PID: 2860 Comm: kworker/u64:44 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.439884] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.439886] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.439887] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.439893] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.439959] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.439961] RSP: 0018:ffffc9000587fc98 EFLAGS: 00010246 <4> [166.439963] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.439965] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.439966] RBP: ffffc9000587fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.439967] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.439968] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.439969] FS: 0000000000000000(0000) GS:ffff8888dad5d000(0000) knlGS:0000000000000000 <4> [166.439971] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.439972] CR2: 00007e09ff4cd000 CR3: 0000000120a6c000 CR4: 0000000000f52ef0 <4> [166.439973] PKRU: 55555554 <4> [166.439974] Call Trace: <4> [166.439975] <TASK> <7> [166.439921] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [166.439980] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.439985] ? lock_release+0xce/0x280 <4> [166.439990] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.439995] process_one_work+0x22e/0x6b0 <4> [166.440001] worker_thread+0x1e8/0x3d0 <4> [166.440003] ? __pfx_worker_thread+0x10/0x10 <4> [166.440005] kthread+0x11f/0x250 <4> [166.440008] ? __pfx_kthread+0x10/0x10 <4> [166.440011] ret_from_fork+0x344/0x3a0 <4> [166.440013] ? __pfx_kthread+0x10/0x10 <4> [166.440016] ret_from_fork_asm+0x1a/0x30 <4> [166.440023] </TASK> <4> [166.440024] irq event stamp: 147551 <4> [166.440025] hardirqs last enabled at (147557): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.440027] hardirqs last disabled at (147562): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.440029] softirqs last enabled at (146466): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.440032] softirqs last disabled at (146459): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.440034] ---[ end trace 0000000000000000 ]--- <7> [166.440039] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [166.441379] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=257, flags=0x0 in xe_compute_pree [3849] <7> [166.441384] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [166.441544] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=288, flags=0x0 in xe_compute_pree [3849] <7> [166.441549] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [166.441685] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <5> [166.441875] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13540, lrc_seqno=13540, guc_id=0, flags=0x73 in no process [-1] <7> [166.441880] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.441964] ------------[ cut here ]------------ <4> [166.441966] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [166.441912] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <4> [166.441968] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#9: kworker/u64:25/2840 <4> [166.442071] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.442143] efi_pstore nfnetlink autofs4 <4> [166.442147] CPU: 9 UID: 0 PID: 2840 Comm: kworker/u64:25 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.442150] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.442151] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.442152] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [166.442127] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.442157] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.442226] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.442227] RSP: 0000:ffffc90004eafc98 EFLAGS: 00010246 <4> [166.442229] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.442230] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.442231] RBP: ffffc90004eafda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.442232] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.442233] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.442234] FS: 0000000000000000(0000) GS:ffff8888db15d000(0000) knlGS:0000000000000000 <4> [166.442235] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.442237] CR2: 00007e09f8933000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.442238] PKRU: 55555554 <4> [166.442239] Call Trace: <4> [166.442240] <TASK> <4> [166.442245] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.442250] ? lock_release+0xce/0x280 <4> [166.442255] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.442260] process_one_work+0x22e/0x6b0 <4> [166.442266] worker_thread+0x1e8/0x3d0 <4> [166.442268] ? __pfx_worker_thread+0x10/0x10 <4> [166.442270] kthread+0x11f/0x250 <4> [166.442273] ? __pfx_kthread+0x10/0x10 <4> [166.442277] ret_from_fork+0x344/0x3a0 <4> [166.442279] ? __pfx_kthread+0x10/0x10 <4> [166.442282] ret_from_fork_asm+0x1a/0x30 <4> [166.442289] </TASK> <4> [166.442290] irq event stamp: 496359 <4> [166.442291] hardirqs last enabled at (496365): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.442294] hardirqs last disabled at (496370): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.442296] softirqs last enabled at (495014): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.442298] softirqs last disabled at (495009): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.442300] ---[ end trace 0000000000000000 ]--- <6> [166.442302] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.442368] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.442377] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.442324] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.442398] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.442526] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.442725] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.442859] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.442982] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.443086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.443107] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.443172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.443259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.443299] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.443338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.443416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.443467] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.443491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.443578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.443643] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.443652] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.443743] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.443852] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.443871] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.444090] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.444322] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.444559] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.444788] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.444863] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.445016] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.445184] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.445351] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.452965] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.453081] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.453185] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.453290] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.453731] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.453835] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.453938] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.454045] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.454147] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.454250] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.454352] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.454458] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.454569] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.454721] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.454827] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.454929] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.455032] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.455134] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.455234] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.455338] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.455440] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.455548] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.455647] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.455747] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.455846] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.455878] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.455947] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.456069] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.456137] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.456181] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.457467] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.457547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.457616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.457687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.457756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.457823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.457889] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.457955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.458021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.458088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.458153] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.458219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.458284] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.458348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.458413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.458479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.458554] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.458619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.458684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.458758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.458830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.458899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.458969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.459036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.459102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.459170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.459242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.459310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.459377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.459446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.459520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.459597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.459671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.459746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.459818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.459886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.459954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.460020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.460087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.460157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.460225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.460291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.460358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.460428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.460497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.460575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.460640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.460707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.460771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.460837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.460905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.460972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.461038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.461103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.461170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.461236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.461302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.461371] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.462804] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.463664] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13540, lrc_seqno=13540, guc_id=0, flags=0x73 in no process [-1] <7> [166.463667] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.463723] ------------[ cut here ]------------ <4> [166.463724] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.463726] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#9: kworker/u64:40/2856 <4> [166.463798] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.463856] efi_pstore nfnetlink autofs4 <4> [166.463860] CPU: 9 UID: 0 PID: 2856 Comm: kworker/u64:40 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.463863] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.463864] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.463865] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.463870] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.463934] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.463936] RSP: 0000:ffffc9000585fc98 EFLAGS: 00010246 <4> [166.463938] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.463939] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.463940] RBP: ffffc9000585fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.463941] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.463942] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.463943] FS: 0000000000000000(0000) GS:ffff8888db15d000(0000) knlGS:0000000000000000 <4> [166.463945] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.463946] CR2: 00007e09f8933000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.463948] PKRU: 55555554 <4> [166.463949] Call Trace: <4> [166.463950] <TASK> <4> [166.463955] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.463959] ? lock_release+0xce/0x280 <4> [166.463964] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.463969] process_one_work+0x22e/0x6b0 <4> [166.463975] worker_thread+0x1e8/0x3d0 <4> [166.463977] ? __pfx_worker_thread+0x10/0x10 <4> [166.463980] kthread+0x11f/0x250 <4> [166.463983] ? __pfx_kthread+0x10/0x10 <4> [166.463986] ret_from_fork+0x344/0x3a0 <4> [166.463988] ? __pfx_kthread+0x10/0x10 <4> [166.463991] ret_from_fork_asm+0x1a/0x30 <4> [166.463999] </TASK> <4> [166.464000] irq event stamp: 281563 <4> [166.464001] hardirqs last enabled at (281569): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.464003] hardirqs last disabled at (281574): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.464005] softirqs last enabled at (277964): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.464008] softirqs last disabled at (277955): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.464010] ---[ end trace 0000000000000000 ]--- <6> [166.464011] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.464075] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <7> [166.464092] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.464208] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [166.464316] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=148, flags=0x0 in xe_compute_pree [3849] <7> [166.464318] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [166.464402] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=164, flags=0x0 in xe_compute_pree [3849] <7> [166.464407] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [166.464490] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=290, flags=0x0 in xe_compute_pree [3849] <7> [166.464492] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [166.464582] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=292, flags=0x0 in xe_compute_pree [3849] <7> [166.464584] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [166.464651] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.464677] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.465256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.465338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.465421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.465501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.465602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.465680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.465759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.465834] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.465920] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.466028] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.467035] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.477505] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.477762] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.479053] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.479126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.479195] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.479263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.479329] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.479394] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.479459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.479535] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.479601] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.479667] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.479731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.479803] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.479913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.480011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.480103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.480198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.480290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.480383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.480474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.480575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.480649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.480719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.480791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.480860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.480926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.480996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.481070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.481139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.481206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.481275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.481344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.481417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.481490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.481582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.481652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.481720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.481785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.481850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.481914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.481981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.482048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.482113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.482177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.482244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.482311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.482376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.482440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.482510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.482579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.482646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.482715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.482781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.482846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.482911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.482977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.483042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.483108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.483175] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.484404] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.485263] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13540, lrc_seqno=13540, guc_id=0, flags=0x73 in no process [-1] <7> [166.485266] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.485324] ------------[ cut here ]------------ <4> [166.485325] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.485327] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#9: kworker/u64:40/2856 <4> [166.485412] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.485470] efi_pstore nfnetlink autofs4 <4> [166.485474] CPU: 9 UID: 0 PID: 2856 Comm: kworker/u64:40 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.485477] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.485478] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.485479] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.485484] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.485566] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.485568] RSP: 0000:ffffc9000585fc98 EFLAGS: 00010246 <4> [166.485570] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.485572] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.485573] RBP: ffffc9000585fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.485574] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.485576] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.485577] FS: 0000000000000000(0000) GS:ffff8888db15d000(0000) knlGS:0000000000000000 <4> [166.485578] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.485579] CR2: 00007e09f8933000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.485581] PKRU: 55555554 <4> [166.485582] Call Trace: <4> [166.485583] <TASK> <4> [166.485588] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.485593] ? lock_release+0xce/0x280 <4> [166.485598] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.485603] process_one_work+0x22e/0x6b0 <4> [166.485609] worker_thread+0x1e8/0x3d0 <4> [166.485612] ? __pfx_worker_thread+0x10/0x10 <4> [166.485614] kthread+0x11f/0x250 <4> [166.485617] ? __pfx_kthread+0x10/0x10 <4> [166.485621] ret_from_fork+0x344/0x3a0 <4> [166.485623] ? __pfx_kthread+0x10/0x10 <4> [166.485626] ret_from_fork_asm+0x1a/0x30 <4> [166.485633] </TASK> <4> [166.485634] irq event stamp: 292417 <4> [166.485635] hardirqs last enabled at (292423): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.485638] hardirqs last disabled at (292428): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.485640] softirqs last enabled at (289070): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.485642] softirqs last disabled at (289063): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.485645] ---[ end trace 0000000000000000 ]--- <7> [166.487535] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.487641] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [166.487782] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=223, flags=0x0 in xe_compute_pree [3849] <7> [166.487797] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [166.487836] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <5> [166.487880] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=291, flags=0x0 in xe_compute_pree [3849] <7> [166.487886] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [166.488065] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13590, lrc_seqno=13590, guc_id=0, flags=0x73 in no process [-1] <7> [166.488069] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [166.488092] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <4> [166.488130] ------------[ cut here ]------------ <4> [166.488131] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.488133] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#6: kworker/u64:24/2839 <4> [166.488205] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.488262] efi_pstore <7> [166.488228] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.488263] nfnetlink autofs4 <4> [166.488267] CPU: 6 UID: 0 PID: 2839 Comm: kworker/u64:24 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.488269] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.488270] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.488271] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.488276] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.488343] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.488344] RSP: 0018:ffffc90004ea7c98 EFLAGS: 00010246 <4> [166.488346] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.488348] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.488349] RBP: ffffc90004ea7da8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.488350] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.488351] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.488352] FS: 0000000000000000(0000) GS:ffff8888dafdd000(0000) knlGS:0000000000000000 <4> [166.488354] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.488355] CR2: 00007e09ff4cd000 CR3: 0000000120a6c000 CR4: 0000000000f52ef0 <4> [166.488356] PKRU: 55555554 <4> [166.488357] Call Trace: <4> [166.488358] <TASK> <4> [166.488363] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.488368] ? lock_release+0xce/0x280 <4> [166.488373] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.488378] process_one_work+0x22e/0x6b0 <7> [166.488350] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.488384] worker_thread+0x1e8/0x3d0 <4> [166.488387] ? __pfx_worker_thread+0x10/0x10 <4> [166.488388] kthread+0x11f/0x250 <4> [166.488392] ? __pfx_kthread+0x10/0x10 <4> [166.488395] ret_from_fork+0x344/0x3a0 <4> [166.488397] ? __pfx_kthread+0x10/0x10 <4> [166.488399] ret_from_fork_asm+0x1a/0x30 <4> [166.488406] </TASK> <4> [166.488407] irq event stamp: 22223 <4> [166.488408] hardirqs last enabled at (22229): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.488410] hardirqs last disabled at (22234): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.488412] softirqs last enabled at (19692): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.488415] softirqs last disabled at (19673): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.488417] ---[ end trace 0000000000000000 ]--- <6> [166.488419] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.488496] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.488503] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.488470] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.488523] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.488655] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.488772] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.488886] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.489011] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.489203] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.489321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.489367] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.489454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.489553] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.489593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.489722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.489790] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.489849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.489960] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.489975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.490120] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.490103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.490228] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.490281] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.490364] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.490446] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.490543] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.490772] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.491021] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.491232] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.491562] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.499096] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.499209] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.499338] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.499459] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.499691] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.499797] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.499900] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.500003] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.500107] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.500212] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.500316] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.500422] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.500534] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.500681] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.500787] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.500890] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.500991] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.501092] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.501193] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.501295] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.501397] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.501476] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.501504] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.501608] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.501711] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.501738] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.501814] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.501917] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.502041] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.502160] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.503057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.503132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.503205] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.503276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.503345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.503414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.503493] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.503561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.503628] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.503695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.503759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.503823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.503887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.503952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.504017] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.504082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.504149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.504213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.504279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.504355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.504427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.504513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.504586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.504654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.504724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.504792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.504866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.504937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.505007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.505077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.505144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.505217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.505290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.505366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.505437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.505516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.505586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.505651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.505714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.505782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.505849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.505915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.505981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.506049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.506115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.506180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.506246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.506313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.506377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.506440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.506525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.506590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.506655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.506721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.506788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.506851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.506912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.506978] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.508374] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.509231] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13590, lrc_seqno=13590, guc_id=0, flags=0x73 in no process [-1] <7> [166.509234] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.509321] ------------[ cut here ]------------ <4> [166.509322] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.509324] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#0: kworker/u64:6/194 <4> [166.509393] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.509452] efi_pstore nfnetlink autofs4 <4> [166.509456] CPU: 0 UID: 0 PID: 194 Comm: kworker/u64:6 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.509462] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.509463] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.509464] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.509470] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.509537] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.509539] RSP: 0018:ffffc900015dbc98 EFLAGS: 00010246 <4> [166.509541] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.509542] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.509543] RBP: ffffc900015dbda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.509544] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.509546] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.509547] FS: 0000000000000000(0000) GS:ffff8888dacdd000(0000) knlGS:0000000000000000 <4> [166.509548] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.509549] CR2: 00007e09ff4cd000 CR3: 000000019969f000 CR4: 0000000000f52ef0 <4> [166.509551] PKRU: 55555554 <4> [166.509552] Call Trace: <4> [166.509553] <TASK> <4> [166.509558] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.509563] ? lock_release+0xce/0x280 <4> [166.509569] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.509573] process_one_work+0x22e/0x6b0 <4> [166.509579] worker_thread+0x1e8/0x3d0 <4> [166.509582] ? __pfx_worker_thread+0x10/0x10 <4> [166.509584] kthread+0x11f/0x250 <4> [166.509587] ? __pfx_kthread+0x10/0x10 <4> [166.509591] ret_from_fork+0x344/0x3a0 <4> [166.509592] ? __pfx_kthread+0x10/0x10 <4> [166.509595] ret_from_fork_asm+0x1a/0x30 <4> [166.509603] </TASK> <4> [166.509604] irq event stamp: 596543 <4> [166.509605] hardirqs last enabled at (596549): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.509608] hardirqs last disabled at (596554): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.509610] softirqs last enabled at (593214): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.509612] softirqs last disabled at (593207): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.509614] ---[ end trace 0000000000000000 ]--- <6> [166.509616] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.509681] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <5> [166.509688] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=277, flags=0x0 in xe_compute_pree [3849] <7> [166.509690] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [166.510122] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.510137] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.510238] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.510337] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.510912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.511000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.511087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.511171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.511252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.511330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.511408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.511490] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.511577] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.511684] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.512692] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.522453] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.522713] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.524031] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.524102] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.524169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.524238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.524305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.524372] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.524439] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.524524] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.524591] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.524658] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.524725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.524789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.524854] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.524919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.524983] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.525047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.525111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.525175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.525239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.525312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.525385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.525457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.525528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.525595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.525662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.525731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.525803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.525873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.525941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.526010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.526079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.526154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.526228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.526300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.526370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.526443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.526512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.526580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.526646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.526714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.526781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.526846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.526910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.526978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.527043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.527112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.527179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.527246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.527311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.527375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.527447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.527514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.527580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.527646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.527712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.527777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.527842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.527910] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.529113] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.529965] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13590, lrc_seqno=13590, guc_id=0, flags=0x73 in no process [-1] <7> [166.529967] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.530024] ------------[ cut here ]------------ <4> [166.530025] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.530026] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#10: kworker/u64:29/2844 <4> [166.530093] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.530152] efi_pstore nfnetlink autofs4 <4> [166.530157] CPU: 10 UID: 0 PID: 2844 Comm: kworker/u64:29 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.530160] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.530161] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.530162] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.530167] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.530230] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.530232] RSP: 0018:ffffc90004e87c98 EFLAGS: 00010246 <4> [166.530234] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.530235] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.530236] RBP: ffffc90004e87da8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.530237] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.530238] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.530239] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [166.530241] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.530242] CR2: 00007e09ff4cd000 CR3: 0000000130626000 CR4: 0000000000f52ef0 <4> [166.530243] PKRU: 55555554 <4> [166.530244] Call Trace: <4> [166.530245] <TASK> <4> [166.530251] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.530255] ? lock_release+0xce/0x280 <4> [166.530261] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.530266] process_one_work+0x22e/0x6b0 <4> [166.530272] worker_thread+0x1e8/0x3d0 <4> [166.530274] ? __pfx_worker_thread+0x10/0x10 <4> [166.530277] kthread+0x11f/0x250 <4> [166.530280] ? __pfx_kthread+0x10/0x10 <4> [166.530283] ret_from_fork+0x344/0x3a0 <4> [166.530285] ? __pfx_kthread+0x10/0x10 <4> [166.530288] ret_from_fork_asm+0x1a/0x30 <4> [166.530295] </TASK> <4> [166.530296] irq event stamp: 23665 <4> [166.530297] hardirqs last enabled at (23671): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.530300] hardirqs last disabled at (23676): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.530302] softirqs last enabled at (20344): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.530304] softirqs last disabled at (20339): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.530307] ---[ end trace 0000000000000000 ]--- <7> [166.531841] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.531943] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.532116] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <5> [166.532241] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13638, lrc_seqno=13638, guc_id=0, flags=0x73 in no process [-1] <7> [166.532247] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [166.532264] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <4> [166.532336] ------------[ cut here ]------------ <4> [166.532338] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.532341] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#4: kworker/u64:24/2839 <7> [166.532399] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.532454] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.532568] efi_pstore nfnetlink autofs4 <7> [166.532541] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.532576] CPU: 4 UID: 0 PID: 2839 Comm: kworker/u64:24 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.532580] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.532581] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.532583] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.532591] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <7> [166.532660] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.532695] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.532697] RSP: 0018:ffffc90004ea7c98 EFLAGS: 00010246 <4> [166.532701] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.532703] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.532705] RBP: ffffc90004ea7da8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.532707] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.532709] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.532710] FS: 0000000000000000(0000) GS:ffff8888daedd000(0000) knlGS:0000000000000000 <4> [166.532713] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.532715] CR2: 00007e09ff4cd000 CR3: 0000000110555000 CR4: 0000000000f52ef0 <4> [166.532717] PKRU: 55555554 <4> [166.532718] Call Trace: <4> [166.532720] <TASK> <4> [166.532730] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.532738] ? lock_release+0xce/0x280 <4> [166.532748] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.532756] process_one_work+0x22e/0x6b0 <4> [166.532767] worker_thread+0x1e8/0x3d0 <4> [166.532772] ? __pfx_worker_thread+0x10/0x10 <4> [166.532775] kthread+0x11f/0x250 <4> [166.532781] ? __pfx_kthread+0x10/0x10 <4> [166.532786] ret_from_fork+0x344/0x3a0 <4> [166.532789] ? __pfx_kthread+0x10/0x10 <4> [166.532794] ret_from_fork_asm+0x1a/0x30 <4> [166.532807] </TASK> <4> [166.532809] irq event stamp: 24235 <7> [166.532779] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.532810] hardirqs last enabled at (24241): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.532814] hardirqs last disabled at (24246): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.532817] softirqs last enabled at (23492): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.532821] softirqs last disabled at (23487): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.532824] ---[ end trace 0000000000000000 ]--- <6> [166.532827] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [166.532895] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <6> [166.532928] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.532945] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.532961] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.533013] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.533128] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.533323] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.533501] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.533553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.533637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.533668] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.533725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.533807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.533888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.533899] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.533966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.534045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.534068] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.534123] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.534211] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.534226] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.534320] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.534388] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.534620] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.535002] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.535249] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.535331] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.535412] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.543083] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.543196] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.543303] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.543406] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.543523] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.543627] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.543730] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.543833] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.543938] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.544290] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.544393] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.544506] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.544610] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.544758] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.544865] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.544967] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.545068] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.545167] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.545268] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.545367] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.545428] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.545471] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.545576] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.545679] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.545690] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.545781] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.545882] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.545984] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.546105] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.546217] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.547024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.547100] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.547171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.547240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.547308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.547374] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.547451] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.547521] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.547587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.547652] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.547717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.547782] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.547847] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.547912] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.547978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.548043] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.548108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.548171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.548235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.548308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.548381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.548468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.548540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.548609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.548677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.548748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.548822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.548894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.548964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.549034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.549103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.549177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.549253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.549326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.549397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.549485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.549554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.549621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.549688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.549758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.549826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.549895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.549963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.550034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.550105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.550174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.550263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.550355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.550470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.550539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.550608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.550677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.550744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.550810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.550877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.550942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.551007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.551076] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.552388] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.553270] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13638, lrc_seqno=13638, guc_id=0, flags=0x73 in no process [-1] <7> [166.553273] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.553340] ------------[ cut here ]------------ <4> [166.553342] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.553343] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#10: kworker/u64:24/2839 <4> [166.553438] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.553496] efi_pstore nfnetlink autofs4 <4> [166.553500] CPU: 10 UID: 0 PID: 2839 Comm: kworker/u64:24 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.553503] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.553504] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.553506] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.553511] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.553576] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.553577] RSP: 0018:ffffc90004ea7c98 EFLAGS: 00010246 <4> [166.553580] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.553581] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.553582] RBP: ffffc90004ea7da8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.553583] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.553584] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.553585] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [166.553587] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.553588] CR2: 00007e09ff4cd000 CR3: 0000000130626000 CR4: 0000000000f52ef0 <4> [166.553589] PKRU: 55555554 <4> [166.553590] Call Trace: <4> [166.553591] <TASK> <4> [166.553597] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.553602] ? lock_release+0xce/0x280 <4> [166.553607] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.553612] process_one_work+0x22e/0x6b0 <4> [166.553618] worker_thread+0x1e8/0x3d0 <4> [166.553620] ? __pfx_worker_thread+0x10/0x10 <4> [166.553622] kthread+0x11f/0x250 <4> [166.553625] ? __pfx_kthread+0x10/0x10 <4> [166.553629] ret_from_fork+0x344/0x3a0 <4> [166.553631] ? __pfx_kthread+0x10/0x10 <4> [166.553634] ret_from_fork_asm+0x1a/0x30 <4> [166.553641] </TASK> <4> [166.553642] irq event stamp: 34887 <4> [166.553643] hardirqs last enabled at (34893): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.553646] hardirqs last disabled at (34898): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.553648] softirqs last enabled at (31554): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.553651] softirqs last disabled at (31547): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.553653] ---[ end trace 0000000000000000 ]--- <6> [166.553655] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.553720] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <7> [166.553736] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.553830] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [166.553920] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=180, flags=0x0 in xe_compute_pree [3849] <7> [166.553923] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [166.553996] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=198, flags=0x0 in xe_compute_pree [3849] <7> [166.553998] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [166.554068] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=215, flags=0x0 in xe_compute_pree [3849] <7> [166.554070] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [166.554135] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.554156] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.554739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.554823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.554908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.554986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.555064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.555140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.555217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.555292] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.555379] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.555499] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.556504] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.566401] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.566658] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.567948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.568021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.568089] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.568158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.568226] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.568294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.568359] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.568439] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.568504] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.568571] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.568645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.568711] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.568777] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.568842] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.568906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.568971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.569036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.569102] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.569166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.569241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.569313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.569382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.569468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.569537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.569602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.569671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.569742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.569812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.569881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.569949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.570016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.570090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.570163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.570238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.570307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.570376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.570462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.570544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.570617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.570685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.570754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.570820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.570885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.570954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.571021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.571092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.571159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.571227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.571293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.571358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.571440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.571506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.571571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.571636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.571702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.571767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.571834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.571903] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.573040] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.573904] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13638, lrc_seqno=13638, guc_id=0, flags=0x73 in no process [-1] <7> [166.573907] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.573963] ------------[ cut here ]------------ <4> [166.573964] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.573966] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#10: kworker/u64:24/2839 <4> [166.574033] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.574091] efi_pstore nfnetlink autofs4 <4> [166.574095] CPU: 10 UID: 0 PID: 2839 Comm: kworker/u64:24 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.574098] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.574099] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.574100] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.574105] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.574169] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.574171] RSP: 0018:ffffc90004ea7c98 EFLAGS: 00010246 <4> [166.574173] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.574174] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.574176] RBP: ffffc90004ea7da8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.574177] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.574178] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.574179] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [166.574180] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.574182] CR2: 00007e09ff4cd000 CR3: 0000000130626000 CR4: 0000000000f52ef0 <4> [166.574183] PKRU: 55555554 <4> [166.574184] Call Trace: <4> [166.574185] <TASK> <4> [166.574190] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.574195] ? lock_release+0xce/0x280 <4> [166.574200] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.574205] process_one_work+0x22e/0x6b0 <4> [166.574211] worker_thread+0x1e8/0x3d0 <4> [166.574213] ? __pfx_worker_thread+0x10/0x10 <4> [166.574216] kthread+0x11f/0x250 <4> [166.574219] ? __pfx_kthread+0x10/0x10 <4> [166.574222] ret_from_fork+0x344/0x3a0 <4> [166.574224] ? __pfx_kthread+0x10/0x10 <4> [166.574227] ret_from_fork_asm+0x1a/0x30 <4> [166.574235] </TASK> <4> [166.574235] irq event stamp: 45691 <4> [166.574236] hardirqs last enabled at (45697): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.574239] hardirqs last disabled at (45702): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.574241] softirqs last enabled at (42470): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.574244] softirqs last disabled at (42463): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.574246] ---[ end trace 0000000000000000 ]--- <7> [166.575979] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.576077] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [166.576173] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=270, flags=0x0 in xe_compute_pree [3849] <7> [166.576176] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [166.576253] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=278, flags=0x0 in xe_compute_pree [3849] <7> [166.576241] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.576258] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [166.576491] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <5> [166.576623] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13686, lrc_seqno=13686, guc_id=0, flags=0x73 in no process [-1] <7> [166.576625] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [166.576625] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.576682] ------------[ cut here ]------------ <4> [166.576683] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.576684] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#0: kworker/u64:6/194 <4> [166.576756] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor <7> [166.576747] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.576781] mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [166.576818] CPU: 0 UID: 0 PID: 194 Comm: kworker/u64:6 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.576821] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.576822] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.576823] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.576828] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.576894] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.576896] RSP: 0018:ffffc900015dbc98 EFLAGS: 00010246 <4> [166.576898] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <7> [166.576865] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.576899] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.576900] RBP: ffffc900015dbda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.576901] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.576902] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.576903] FS: 0000000000000000(0000) GS:ffff8888dacdd000(0000) knlGS:0000000000000000 <4> [166.576904] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.576906] CR2: 00007e09ff4cd000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.576907] PKRU: 55555554 <4> [166.576908] Call Trace: <4> [166.576908] <TASK> <4> [166.576913] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.576918] ? lock_release+0xce/0x280 <4> [166.576923] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.576928] process_one_work+0x22e/0x6b0 <4> [166.576934] worker_thread+0x1e8/0x3d0 <4> [166.576937] ? __pfx_worker_thread+0x10/0x10 <4> [166.576939] kthread+0x11f/0x250 <4> [166.576942] ? __pfx_kthread+0x10/0x10 <4> [166.576945] ret_from_fork+0x344/0x3a0 <4> [166.576947] ? __pfx_kthread+0x10/0x10 <4> [166.576950] ret_from_fork_asm+0x1a/0x30 <4> [166.576958] </TASK> <4> [166.576959] irq event stamp: 603089 <4> [166.576960] hardirqs last enabled at (603095): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.576962] hardirqs last disabled at (603100): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.576964] softirqs last enabled at (599194): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.576967] softirqs last disabled at (599187): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.576969] ---[ end trace 0000000000000000 ]--- <6> [166.576971] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [166.576986] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <6> [166.577036] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.577042] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.577102] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.577214] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.577221] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.577333] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.577538] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.577701] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.577798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.577867] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.577887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.577976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.578057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.578095] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.578137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.578215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.578271] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.578294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.578371] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.578441] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.578475] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.578585] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.578605] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.578815] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.579199] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.579497] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.579597] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.579666] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.587301] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.587419] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.587523] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.587625] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.587729] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.587834] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.587938] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.588042] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.588144] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.588246] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.588348] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.588467] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.588571] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.588722] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.588827] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.588928] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.589026] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.589128] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.589232] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.589333] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.589372] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.589451] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.589555] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.589631] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.589654] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.589759] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.589860] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.589963] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.590091] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.590948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.591023] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.591091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.591161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.591229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.591295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.591366] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.591433] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.591498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.591563] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.591628] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.591694] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.591758] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.591824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.591887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.591951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.592015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.592081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.592145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.592221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.592294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.592368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.592439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.592507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.592575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.592645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.592718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.592789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.592857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.592926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.592996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.593072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.593147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.593221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.593292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.593365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.593432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.593499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.593566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.593637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.593704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.593770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.593836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.593906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.593973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.594039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.594103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.594168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.594232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.594298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.594380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.594459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.594533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.594599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.594666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.594733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.594801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.594872] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.596292] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.597145] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13686, lrc_seqno=13686, guc_id=0, flags=0x73 in no process [-1] <7> [166.597148] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.597206] ------------[ cut here ]------------ <4> [166.597207] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.597208] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#2: kworker/u64:29/2844 <4> [166.597277] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.597337] efi_pstore nfnetlink autofs4 <4> [166.597341] CPU: 2 UID: 0 PID: 2844 Comm: kworker/u64:29 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.597344] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.597346] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.597347] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.597352] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.597433] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.597435] RSP: 0018:ffffc90004e87c98 EFLAGS: 00010246 <4> [166.597437] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.597439] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.597440] RBP: ffffc90004e87da8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.597441] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.597443] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.597444] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [166.597445] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.597447] CR2: 0000785eaa346000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.597448] PKRU: 55555554 <4> [166.597449] Call Trace: <4> [166.597450] <TASK> <4> [166.597455] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.597460] ? lock_release+0xce/0x280 <4> [166.597466] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.597471] process_one_work+0x22e/0x6b0 <4> [166.597477] worker_thread+0x1e8/0x3d0 <4> [166.597479] ? __pfx_worker_thread+0x10/0x10 <4> [166.597482] kthread+0x11f/0x250 <4> [166.597485] ? __pfx_kthread+0x10/0x10 <4> [166.597488] ret_from_fork+0x344/0x3a0 <4> [166.597491] ? __pfx_kthread+0x10/0x10 <4> [166.597493] ret_from_fork_asm+0x1a/0x30 <4> [166.597501] </TASK> <4> [166.597503] irq event stamp: 37371 <4> [166.597504] hardirqs last enabled at (37377): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.597506] hardirqs last disabled at (37382): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.597508] softirqs last enabled at (35040): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.597511] softirqs last disabled at (35023): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.597514] ---[ end trace 0000000000000000 ]--- <6> [166.597515] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.597581] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <5> [166.597588] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=204, flags=0x0 in xe_compute_pree [3849] <7> [166.597590] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [166.598012] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.598071] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.598169] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.598268] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.598843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.598930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.599017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.599097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.599175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.599252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.599328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.599414] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.599504] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.599612] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.600624] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.610351] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.610620] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.611935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.612006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.612075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.612144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.612212] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.612281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.612356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.612425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.612492] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.612558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.612623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.612688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.612752] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.612816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.612882] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.612948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.613012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.613078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.613144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.613218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.613290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.613370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.613440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.613508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.613576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.613647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.613721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.613791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.613859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.613931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.613999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.614071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.614145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.614219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.614291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.614369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.614438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.614506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.614573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.614643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.614711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.614778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.614845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.614914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.614981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.615048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.615118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.615186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.615251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.615318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.615399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.615466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.615533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.615604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.615673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.615739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.615804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.615875] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.617104] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.617356] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13686, lrc_seqno=13686, guc_id=0, flags=0x73 in no process [-1] <7> [166.617365] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.617690] ------------[ cut here ]------------ <4> [166.617693] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.617695] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#0: kworker/u64:29/2844 <4> [166.617964] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.618054] efi_pstore nfnetlink autofs4 <4> [166.618059] CPU: 0 UID: 0 PID: 2844 Comm: kworker/u64:29 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.618062] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.618063] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.618064] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.618069] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <7> [166.618094] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [166.618186] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.618188] RSP: 0018:ffffc90004e87c98 EFLAGS: 00010246 <4> [166.618192] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.618194] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.618196] RBP: ffffc90004e87da8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.618197] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.618199] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.618201] FS: 0000000000000000(0000) GS:ffff8888dacdd000(0000) knlGS:0000000000000000 <4> [166.618203] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.618204] CR2: 00007e09ff4cd000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.618207] PKRU: 55555554 <4> [166.618208] Call Trace: <4> [166.618209] <TASK> <4> [166.618218] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.618228] ? lock_release+0xce/0x280 <4> [166.618238] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.618248] process_one_work+0x22e/0x6b0 <4> [166.618260] worker_thread+0x1e8/0x3d0 <4> [166.618266] ? __pfx_worker_thread+0x10/0x10 <4> [166.618269] kthread+0x11f/0x250 <4> [166.618274] ? __pfx_kthread+0x10/0x10 <4> [166.618279] ret_from_fork+0x344/0x3a0 <4> [166.618282] ? __pfx_kthread+0x10/0x10 <4> [166.618286] ret_from_fork_asm+0x1a/0x30 <4> [166.618298] </TASK> <4> [166.618299] irq event stamp: 48071 <4> [166.618300] hardirqs last enabled at (48077): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.618304] hardirqs last disabled at (48082): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.618307] softirqs last enabled at (44634): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.618310] softirqs last disabled at (44625): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.618314] ---[ end trace 0000000000000000 ]--- <7> [166.618269] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.620047] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.620206] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <5> [166.620309] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13733, lrc_seqno=13733, guc_id=0, flags=0x73 in no process [-1] <7> [166.620312] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [166.620349] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.620393] ------------[ cut here ]------------ <4> [166.620394] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.620395] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#2: kworker/u64:29/2844 <4> [166.620463] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd <7> [166.620473] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.620507] idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [166.620524] CPU: 2 UID: 0 PID: 2844 Comm: kworker/u64:29 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.620527] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.620528] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.620529] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.620533] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.620599] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.620600] RSP: 0018:ffffc90004e87c98 EFLAGS: 00010246 <4> [166.620603] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.620604] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.620605] RBP: ffffc90004e87da8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.620606] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.620607] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.620608] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [166.620610] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.620611] CR2: 0000785eaa346000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.620612] PKRU: 55555554 <4> [166.620613] Call Trace: <4> [166.620614] <TASK> <4> [166.620619] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <7> [166.620591] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.620624] ? lock_release+0xce/0x280 <4> [166.620629] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.620634] process_one_work+0x22e/0x6b0 <4> [166.620640] worker_thread+0x1e8/0x3d0 <4> [166.620642] ? __pfx_worker_thread+0x10/0x10 <4> [166.620644] kthread+0x11f/0x250 <4> [166.620647] ? __pfx_kthread+0x10/0x10 <4> [166.620650] ret_from_fork+0x344/0x3a0 <4> [166.620652] ? __pfx_kthread+0x10/0x10 <4> [166.620655] ret_from_fork_asm+0x1a/0x30 <4> [166.620662] </TASK> <4> [166.620663] irq event stamp: 50287 <4> [166.620664] hardirqs last enabled at (50293): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.620667] hardirqs last disabled at (50298): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.620669] softirqs last enabled at (49526): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.620671] softirqs last disabled at (49521): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.620673] ---[ end trace 0000000000000000 ]--- <6> [166.620675] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [166.620706] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <6> [166.620740] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.620748] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.620820] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.620897] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.620940] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.621063] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.621253] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.621433] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.621602] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.621632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.621727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.621815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.621833] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.621895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.621974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.622007] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.622050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.622128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.622170] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.622204] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.622293] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.622350] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.622414] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.622519] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.622895] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.623148] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.623384] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.623425] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.630938] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.631050] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.631153] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.631258] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.631383] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.631486] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.631589] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.631691] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.631794] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.631896] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.631997] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.632099] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.632200] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.632357] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.632461] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.632772] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.632873] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.632976] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.633078] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.633178] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.633279] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.633329] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.633395] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.633502] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.633589] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.633604] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.633706] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.633808] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.633945] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.634914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.634986] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.635054] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.635123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.635192] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.635259] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.635332] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.635399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.635465] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.635531] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.635597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.635662] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.635726] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.635791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.635856] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.635920] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.635985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.636052] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.636118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.636200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.636274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.636404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.636485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.636556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.636624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.636694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.636768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.636838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.636909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.636979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.637046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.637121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.637196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.637271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.637355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.637424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.637490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.637556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.637621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.637690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.637758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.637824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.637889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.637958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.638025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.638093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.638158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.638224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.638288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.638364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.638435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.638500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.638565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.638629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.638694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.638758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.638825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.638892] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.640148] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.641004] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13733, lrc_seqno=13733, guc_id=0, flags=0x73 in no process [-1] <7> [166.641007] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.641063] ------------[ cut here ]------------ <4> [166.641064] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.641065] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#10: kworker/u64:40/2856 <4> [166.641132] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.641190] efi_pstore nfnetlink autofs4 <4> [166.641195] CPU: 10 UID: 0 PID: 2856 Comm: kworker/u64:40 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.641198] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.641199] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.641200] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.641205] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.641269] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.641270] RSP: 0018:ffffc9000585fc98 EFLAGS: 00010246 <4> [166.641272] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.641274] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.641275] RBP: ffffc9000585fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.641276] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.641277] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.641278] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [166.641280] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.641281] CR2: 00007e09ff4cd000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.641282] PKRU: 55555554 <4> [166.641283] Call Trace: <4> [166.641284] <TASK> <4> [166.641290] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.641295] ? lock_release+0xce/0x280 <4> [166.641300] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.641312] process_one_work+0x22e/0x6b0 <4> [166.641318] worker_thread+0x1e8/0x3d0 <4> [166.641321] ? __pfx_worker_thread+0x10/0x10 <4> [166.641323] kthread+0x11f/0x250 <4> [166.641326] ? __pfx_kthread+0x10/0x10 <4> [166.641330] ret_from_fork+0x344/0x3a0 <4> [166.641332] ? __pfx_kthread+0x10/0x10 <4> [166.641334] ret_from_fork_asm+0x1a/0x30 <4> [166.641342] </TASK> <4> [166.641343] irq event stamp: 310983 <4> [166.641344] hardirqs last enabled at (310989): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.641347] hardirqs last disabled at (310994): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.641349] softirqs last enabled at (310926): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.641351] softirqs last disabled at (310921): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.641354] ---[ end trace 0000000000000000 ]--- <6> [166.641356] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.641430] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <5> [166.641439] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=168, flags=0x0 in xe_compute_pree [3849] <7> [166.641441] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [166.641872] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=171, flags=0x0 in xe_compute_pree [3849] <7> [166.641874] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [166.641936] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.641991] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.642089] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.642187] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.642752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.642836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.642919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.642998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.643076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.643153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.643229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.643308] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.643395] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.643503] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.644508] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.654298] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.654556] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.655787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.655859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.655928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.655997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.656065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.656133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.656199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.656264] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.656346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.656415] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.656480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.656545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.656609] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.656673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.656737] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.656803] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.656869] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.656933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.656998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.657078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.657151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.657222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.657302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.657373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.657444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.657514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.657586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.657656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.657724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.657792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.657859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.657931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.658006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.658079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.658150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.658219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.658289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.658359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.658424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.658494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.658561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.658628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.658693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.658762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.658828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.658896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.658965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.659033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.659099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.659167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.659238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.659314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.659380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.659447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.659516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.659581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.659648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.659716] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.660908] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.661554] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13733, lrc_seqno=13733, guc_id=0, flags=0x73 in no process [-1] <7> [166.661562] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.661777] ------------[ cut here ]------------ <4> [166.661779] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.661780] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#11: kworker/u64:40/2856 <4> [166.661847] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.661923] efi_pstore nfnetlink autofs4 <4> [166.661929] CPU: 11 UID: 0 PID: 2856 Comm: kworker/u64:40 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.661933] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.661935] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.661937] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [166.661899] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [166.661945] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.662053] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.662056] RSP: 0018:ffffc9000585fc98 EFLAGS: 00010246 <4> [166.662059] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.662060] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.662062] RBP: ffffc9000585fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.662064] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.662065] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.662067] FS: 0000000000000000(0000) GS:ffff8888db25d000(0000) knlGS:0000000000000000 <4> [166.662069] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.662071] CR2: 0000785eaa343000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.662073] PKRU: 55555554 <4> [166.662074] Call Trace: <4> [166.662076] <TASK> <4> [166.662085] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.662094] ? lock_release+0xce/0x280 <4> [166.662103] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <7> [166.662041] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [166.662112] process_one_work+0x22e/0x6b0 <4> [166.662121] worker_thread+0x1e8/0x3d0 <4> [166.662125] ? __pfx_worker_thread+0x10/0x10 <4> [166.662127] kthread+0x11f/0x250 <4> [166.662131] ? __pfx_kthread+0x10/0x10 <4> [166.662136] ret_from_fork+0x344/0x3a0 <4> [166.662138] ? __pfx_kthread+0x10/0x10 <4> [166.662141] ret_from_fork_asm+0x1a/0x30 <4> [166.662154] </TASK> <4> [166.662156] irq event stamp: 321765 <4> [166.662157] hardirqs last enabled at (321771): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.662160] hardirqs last disabled at (321776): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.662163] softirqs last enabled at (319772): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.662166] softirqs last disabled at (319765): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.662169] ---[ end trace 0000000000000000 ]--- <7> [166.664081] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.664342] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <5> [166.664416] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13780, lrc_seqno=13780, guc_id=0, flags=0x73 in no process [-1] <7> [166.664422] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [166.664473] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.664527] ------------[ cut here ]------------ <4> [166.664529] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.664531] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#14: kworker/u64:14/2460 <7> [166.664591] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.664645] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.664729] efi_pstore nfnetlink autofs4 <4> [166.664735] CPU: 14 UID: 0 PID: 2460 Comm: kworker/u64:14 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <7> [166.664705] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.664739] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.664741] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.664742] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.664749] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <7> [166.664820] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.664857] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.664859] RSP: 0018:ffffc90003eebc98 EFLAGS: 00010246 <4> [166.664862] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.664864] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.664865] RBP: ffffc90003eebda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.664867] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.664868] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.664870] FS: 0000000000000000(0000) GS:ffff8888db3dd000(0000) knlGS:0000000000000000 <4> [166.664871] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.664873] CR2: 0000785eaa345000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.664875] PKRU: 55555554 <4> [166.664876] Call Trace: <4> [166.664877] <TASK> <4> [166.664886] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.664894] ? lock_release+0xce/0x280 <4> [166.664902] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.664911] process_one_work+0x22e/0x6b0 <4> [166.664920] worker_thread+0x1e8/0x3d0 <4> [166.664924] ? __pfx_worker_thread+0x10/0x10 <4> [166.664927] kthread+0x11f/0x250 <4> [166.664932] ? __pfx_kthread+0x10/0x10 <4> [166.664936] ret_from_fork+0x344/0x3a0 <4> [166.664939] ? __pfx_kthread+0x10/0x10 <4> [166.664943] ret_from_fork_asm+0x1a/0x30 <4> [166.664955] </TASK> <4> [166.664956] irq event stamp: 453995 <4> [166.664958] hardirqs last enabled at (454001): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.664961] hardirqs last disabled at (454006): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.664964] softirqs last enabled at (452320): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <7> [166.664935] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <4> [166.664967] softirqs last disabled at (452313): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.664970] ---[ end trace 0000000000000000 ]--- <6> [166.664972] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.665081] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <7> [166.665051] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <6> [166.665091] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.665173] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.665304] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.665375] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.665541] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.665737] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.665960] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.666086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.666126] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.666216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.666294] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.666358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.666455] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.666487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.666617] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.666614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.666740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.666843] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.666867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.667006] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.666993] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.667128] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.667168] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.667301] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.668330] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.675143] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.675258] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.675385] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.675491] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.675595] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.675696] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.675800] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.675903] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.676007] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.676110] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.676211] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.676324] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.676430] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.676577] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.676685] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.676788] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.676892] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.676993] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.677095] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.677198] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.677451] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.677554] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.677656] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.677759] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.677859] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.677960] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.678083] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.678199] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.678272] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.678532] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.679821] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.679896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.679964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.680033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.680101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.680168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.680234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.680313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.680379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.680445] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.680510] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.680575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.680640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.680706] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.680772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.680835] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.680900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.680965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.681030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.681106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.681179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.681249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.681334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.681403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.681471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.681543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.681616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.681688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.681755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.681824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.681893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.681967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.682041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.682115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.682186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.682262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.682331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.682399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.682465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.682535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.682602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.682667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.682733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.682802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.682869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.682935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.683000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.683066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.683132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.683197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.683270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.683337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.683402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.683468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.683534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.683598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.683662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.683729] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.685000] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.685859] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13780, lrc_seqno=13780, guc_id=0, flags=0x73 in no process [-1] <7> [166.685862] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.685922] ------------[ cut here ]------------ <4> [166.685923] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.685924] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#2: kworker/u64:14/2460 <4> [166.685995] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.686053] efi_pstore nfnetlink autofs4 <4> [166.686057] CPU: 2 UID: 0 PID: 2460 Comm: kworker/u64:14 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.686060] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.686061] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.686062] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.686067] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.686132] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.686134] RSP: 0018:ffffc90003eebc98 EFLAGS: 00010246 <4> [166.686136] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.686137] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.686138] RBP: ffffc90003eebda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.686139] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.686140] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.686142] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [166.686143] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.686144] CR2: 0000785eaa346000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.686145] PKRU: 55555554 <4> [166.686147] Call Trace: <4> [166.686148] <TASK> <4> [166.686153] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.686158] ? lock_release+0xce/0x280 <4> [166.686163] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.686168] process_one_work+0x22e/0x6b0 <4> [166.686174] worker_thread+0x1e8/0x3d0 <4> [166.686176] ? __pfx_worker_thread+0x10/0x10 <4> [166.686178] kthread+0x11f/0x250 <4> [166.686181] ? __pfx_kthread+0x10/0x10 <4> [166.686185] ret_from_fork+0x344/0x3a0 <4> [166.686186] ? __pfx_kthread+0x10/0x10 <4> [166.686189] ret_from_fork_asm+0x1a/0x30 <4> [166.686196] </TASK> <4> [166.686197] irq event stamp: 464635 <4> [166.686198] hardirqs last enabled at (464641): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.686201] hardirqs last disabled at (464646): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.686203] softirqs last enabled at (461314): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.686206] softirqs last disabled at (461309): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.686208] ---[ end trace 0000000000000000 ]--- <6> [166.686209] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.686287] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.686292] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.686705] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.686803] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.686902] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.687463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.687547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.687633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.687714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.687793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.687870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.687947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.688021] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.688110] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.688219] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.689233] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.699244] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.699502] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.700822] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.700904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.700978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.701049] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.701119] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.701188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.701270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.701348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.701416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.701483] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.701550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.701615] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.701680] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.701744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.701808] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.701872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.701935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.701999] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.702063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.702138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.702211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.702293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.702382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.702454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.702522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.702594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.702667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.702739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.702807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.702875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.702943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.703015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.703089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.703163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.703239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.703322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.703392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.703460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.703526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.703595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.703664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.703729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.703796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.703863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.703927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.703992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.704059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.704125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.704191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.704270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.704352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.704418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.704483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.704547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.704612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.704677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.704741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.704811] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.705920] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.706782] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13780, lrc_seqno=13780, guc_id=0, flags=0x73 in no process [-1] <7> [166.706785] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.706842] ------------[ cut here ]------------ <4> [166.706843] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.706844] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#6: kworker/u64:14/2460 <4> [166.706910] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.706968] efi_pstore nfnetlink autofs4 <4> [166.706972] CPU: 6 UID: 0 PID: 2460 Comm: kworker/u64:14 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.706975] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.706976] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.706977] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.706982] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.707047] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.707049] RSP: 0018:ffffc90003eebc98 EFLAGS: 00010246 <4> [166.707051] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.707052] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.707053] RBP: ffffc90003eebda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.707054] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.707055] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.707057] FS: 0000000000000000(0000) GS:ffff8888dafdd000(0000) knlGS:0000000000000000 <4> [166.707058] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.707059] CR2: 00007e09ff4cd000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.707061] PKRU: 55555554 <4> [166.707062] Call Trace: <4> [166.707063] <TASK> <4> [166.707068] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.707073] ? lock_release+0xce/0x280 <4> [166.707078] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.707083] process_one_work+0x22e/0x6b0 <4> [166.707089] worker_thread+0x1e8/0x3d0 <4> [166.707091] ? __pfx_worker_thread+0x10/0x10 <4> [166.707094] kthread+0x11f/0x250 <4> [166.707097] ? __pfx_kthread+0x10/0x10 <4> [166.707100] ret_from_fork+0x344/0x3a0 <4> [166.707102] ? __pfx_kthread+0x10/0x10 <4> [166.707105] ret_from_fork_asm+0x1a/0x30 <4> [166.707112] </TASK> <4> [166.707113] irq event stamp: 475287 <4> [166.707114] hardirqs last enabled at (475293): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.707117] hardirqs last disabled at (475298): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.707119] softirqs last enabled at (472970): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.707121] softirqs last disabled at (472965): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.707124] ---[ end trace 0000000000000000 ]--- <7> [166.708625] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.708724] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.708909] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <5> [166.709028] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13828, lrc_seqno=13828, guc_id=0, flags=0x73 in no process [-1] <7> [166.709032] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [166.709051] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <4> [166.709092] ------------[ cut here ]------------ <4> [166.709093] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.709094] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#10: kworker/u64:25/2840 <4> [166.709175] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.709243] efi_pstore nfnetlink autofs4 <4> [166.709248] CPU: 10 UID: 0 PID: 2840 Comm: kworker/u64:25 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.709250] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.709251] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.709253] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [166.709215] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.709257] <4> [166.709258] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.709327] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.709328] RSP: 0018:ffffc90004eafc98 EFLAGS: 00010246 <4> [166.709330] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.709332] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.709333] RBP: ffffc90004eafda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.709334] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.709335] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.709336] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [166.709337] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.709338] CR2: 00007e09ff4cd000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.709340] PKRU: 55555554 <4> [166.709341] Call Trace: <4> [166.709342] <TASK> <4> [166.709347] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.709351] ? lock_release+0xce/0x280 <4> [166.709357] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.709361] process_one_work+0x22e/0x6b0 <4> [166.709367] worker_thread+0x1e8/0x3d0 <4> [166.709370] ? __pfx_worker_thread+0x10/0x10 <4> [166.709372] kthread+0x11f/0x250 <4> [166.709375] ? __pfx_kthread+0x10/0x10 <4> [166.709378] ret_from_fork+0x344/0x3a0 <4> [166.709380] ? __pfx_kthread+0x10/0x10 <4> [166.709383] ret_from_fork_asm+0x1a/0x30 <7> [166.709353] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.709390] </TASK> <4> [166.709391] irq event stamp: 500375 <4> [166.709392] hardirqs last enabled at (500381): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.709395] hardirqs last disabled at (500386): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.709396] softirqs last enabled at (500032): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.709399] softirqs last disabled at (500027): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.709401] ---[ end trace 0000000000000000 ]--- <6> [166.709402] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.709469] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.709476] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.709470] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.709495] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.709591] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.709704] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.709819] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.709931] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.710084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.710121] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.710169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.710262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.710294] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.710342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.710422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.710457] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.710504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.710580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.710653] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.710681] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.710743] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.710853] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.710857] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.711060] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.711322] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.711558] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.711846] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.711862] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.712020] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.712187] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.719987] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.720100] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.720204] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.720345] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.720468] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.720583] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.720687] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.720792] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.720894] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.720996] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.721097] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.721201] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.721323] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.721477] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.721582] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.721682] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.721781] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.721882] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.721982] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.722082] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.722221] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.722388] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.722479] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.722492] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.722594] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.722734] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.722869] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.722973] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.723128] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.723250] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.723924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.723997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.724065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.724133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.724200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.724288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.724355] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.724421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.724487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.724552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.724618] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.724683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.724748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.724813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.724876] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.724943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.725009] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.725073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.725138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.725217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.725291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.725362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.725441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.725513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.725582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.725652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.725724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.725794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.725862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.725931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.726000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.726072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.726146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.726224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.726295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.726363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.726430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.726500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.726568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.726638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.726706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.726776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.726843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.726913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.726980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.727049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.727114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.727181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.727266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.727332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.727401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.727468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.727534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.727600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.727666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.727730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.727794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.727860] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.729219] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.730075] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13828, lrc_seqno=13828, guc_id=0, flags=0x73 in no process [-1] <7> [166.730078] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.730135] ------------[ cut here ]------------ <4> [166.730136] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.730138] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#11: kworker/u64:44/2860 <4> [166.730212] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.730272] efi_pstore nfnetlink autofs4 <4> [166.730276] CPU: 11 UID: 0 PID: 2860 Comm: kworker/u64:44 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.730279] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.730280] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.730281] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.730286] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.730350] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.730352] RSP: 0018:ffffc9000587fc98 EFLAGS: 00010246 <4> [166.730354] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.730355] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.730356] RBP: ffffc9000587fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.730357] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.730358] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.730359] FS: 0000000000000000(0000) GS:ffff8888db25d000(0000) knlGS:0000000000000000 <4> [166.730361] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.730362] CR2: 0000785eaa343000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.730363] PKRU: 55555554 <4> [166.730364] Call Trace: <4> [166.730365] <TASK> <4> [166.730370] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.730375] ? lock_release+0xce/0x280 <4> [166.730380] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.730385] process_one_work+0x22e/0x6b0 <4> [166.730391] worker_thread+0x1e8/0x3d0 <4> [166.730393] ? __pfx_worker_thread+0x10/0x10 <4> [166.730396] kthread+0x11f/0x250 <4> [166.730399] ? __pfx_kthread+0x10/0x10 <4> [166.730402] ret_from_fork+0x344/0x3a0 <4> [166.730404] ? __pfx_kthread+0x10/0x10 <4> [166.730407] ret_from_fork_asm+0x1a/0x30 <4> [166.730414] </TASK> <4> [166.730415] irq event stamp: 168481 <4> [166.730416] hardirqs last enabled at (168487): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.730419] hardirqs last disabled at (168492): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.730421] softirqs last enabled at (165242): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.730424] softirqs last disabled at (165211): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.730426] ---[ end trace 0000000000000000 ]--- <6> [166.730428] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.730493] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <5> [166.730501] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=243, flags=0x0 in xe_compute_pree [3849] <7> [166.730503] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [166.730848] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.730903] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.731000] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.731099] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.731663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.731744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.731829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.731911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.731990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.732065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.732141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.732222] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.732308] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.732415] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.733423] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.743196] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.743455] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.744816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.744944] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.745060] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.745177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.745303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.745420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.745535] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.745650] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.745766] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.745881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.745996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.746111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.746231] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.746347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.746462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.746577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.746692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.746807] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.746922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.747045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.747166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.747289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.747410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.747529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.747647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.747768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.747894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.748016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.748137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.748264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.748386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.748513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.748640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.748766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.748890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.749013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.749133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.749257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.749376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.749499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.749620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.749739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.749858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.749981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.750101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.750224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.750343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.750463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.750582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.750700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.750822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.750942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.751061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.751194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.751315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.751433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.751551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.751673] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.752976] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.753831] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13828, lrc_seqno=13828, guc_id=0, flags=0x73 in no process [-1] <7> [166.753833] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.753889] ------------[ cut here ]------------ <4> [166.753890] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.753891] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#10: kworker/u64:44/2860 <4> [166.753953] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.754007] efi_pstore nfnetlink autofs4 <4> [166.754010] CPU: 10 UID: 0 PID: 2860 Comm: kworker/u64:44 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.754013] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.754014] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.754015] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.754019] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.754080] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.754082] RSP: 0018:ffffc9000587fc98 EFLAGS: 00010246 <4> [166.754083] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.754085] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.754086] RBP: ffffc9000587fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.754087] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.754087] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.754089] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [166.754090] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.754091] CR2: 00007e09ff4cd000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.754092] PKRU: 55555554 <4> [166.754093] Call Trace: <4> [166.754094] <TASK> <4> [166.754099] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.754103] ? lock_release+0xce/0x280 <4> [166.754108] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.754112] process_one_work+0x22e/0x6b0 <4> [166.754117] worker_thread+0x1e8/0x3d0 <4> [166.754120] ? __pfx_worker_thread+0x10/0x10 <4> [166.754122] kthread+0x11f/0x250 <4> [166.754125] ? __pfx_kthread+0x10/0x10 <4> [166.754128] ret_from_fork+0x344/0x3a0 <4> [166.754129] ? __pfx_kthread+0x10/0x10 <4> [166.754132] ret_from_fork_asm+0x1a/0x30 <4> [166.754139] </TASK> <4> [166.754140] irq event stamp: 179225 <4> [166.754141] hardirqs last enabled at (179231): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.754143] hardirqs last disabled at (179236): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.754145] softirqs last enabled at (176812): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.754147] softirqs last disabled at (176803): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.754149] ---[ end trace 0000000000000000 ]--- <7> [166.755895] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.755910] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.756008] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.756167] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <5> [166.756256] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13876, lrc_seqno=13876, guc_id=0, flags=0x73 in no process [-1] <7> [166.756258] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.756314] ------------[ cut here ]------------ <4> [166.756315] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.756316] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#10: kworker/u64:44/2860 <7> [166.756329] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.756382] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.756438] efi_pstore nfnetlink autofs4 <4> [166.756442] CPU: 10 UID: 0 PID: 2860 Comm: kworker/u64:44 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.756444] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.756445] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.756446] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.756451] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <7> [166.756449] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.756514] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.756516] RSP: 0018:ffffc9000587fc98 EFLAGS: 00010246 <4> [166.756518] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.756519] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.756520] RBP: ffffc9000587fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.756521] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.756522] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.756523] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [166.756525] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.756526] CR2: 00007e09ff4cd000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.756527] PKRU: 55555554 <4> [166.756528] Call Trace: <4> [166.756529] <TASK> <4> [166.756534] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.756538] ? lock_release+0xce/0x280 <4> [166.756544] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.756548] process_one_work+0x22e/0x6b0 <4> [166.756554] worker_thread+0x1e8/0x3d0 <4> [166.756557] ? __pfx_worker_thread+0x10/0x10 <4> [166.756559] kthread+0x11f/0x250 <4> [166.756562] ? __pfx_kthread+0x10/0x10 <4> [166.756565] ret_from_fork+0x344/0x3a0 <4> [166.756567] ? __pfx_kthread+0x10/0x10 <4> [166.756570] ret_from_fork_asm+0x1a/0x30 <4> [166.756577] </TASK> <4> [166.756578] irq event stamp: 181513 <4> [166.756579] hardirqs last enabled at (181519): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.756581] hardirqs last disabled at (181524): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.756583] softirqs last enabled at (179456): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.756586] softirqs last disabled at (179401): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.756588] ---[ end trace 0000000000000000 ]--- <7> [166.756565] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <6> [166.756590] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.756658] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.756707] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.756695] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.756811] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.756863] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.756930] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.757044] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.757252] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.757426] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.757446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.757541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.757599] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.757634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.757718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.757798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.757831] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.757877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.757956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.758010] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.758034] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.758128] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.758184] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.758252] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.758356] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.758603] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.758980] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.759264] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.759284] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.759450] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.767053] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.767172] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.767279] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.767384] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.767489] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.767590] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.767692] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.767794] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.767896] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.767998] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.768100] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.768394] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.768500] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.768652] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.768756] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.768859] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.768963] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.769064] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.769163] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.769177] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.769282] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.769385] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.769427] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.769488] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.769616] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.769753] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.769854] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.769996] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.770118] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.770276] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.770822] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.770898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.770971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.771044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.771115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.771195] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.771269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.771339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.771411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.771481] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.771550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.771619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.771687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.771756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.771825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.771894] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.771962] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.772031] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.772100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.772185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.772264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.772339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.772414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.772485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.772556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.772629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.772705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.772779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.772851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.772923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.772996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.773074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.773155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.773236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.773312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.773388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.773460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.773530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.773600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.773673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.773745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.773817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.773887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.773960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.774030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.774100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.774174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.774246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.774315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.774384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.774457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.774527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.774598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.774665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.774736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.774805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.774876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.774949] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.776350] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.777211] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13876, lrc_seqno=13876, guc_id=0, flags=0x73 in no process [-1] <7> [166.777214] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.777276] ------------[ cut here ]------------ <4> [166.777277] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.777278] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#2: kworker/u64:12/984 <4> [166.777349] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.777408] efi_pstore nfnetlink autofs4 <4> [166.777412] CPU: 2 UID: 0 PID: 984 Comm: kworker/u64:12 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.777415] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.777417] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.777418] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.777423] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.777492] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.777494] RSP: 0018:ffffc9000355fc98 EFLAGS: 00010246 <4> [166.777496] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.777497] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.777498] RBP: ffffc9000355fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.777499] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.777500] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.777501] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [166.777503] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.777504] CR2: 0000785eaa346000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.777505] PKRU: 55555554 <4> [166.777506] Call Trace: <4> [166.777507] <TASK> <4> [166.777513] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.777517] ? lock_release+0xce/0x280 <4> [166.777523] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.777528] process_one_work+0x22e/0x6b0 <4> [166.777534] worker_thread+0x1e8/0x3d0 <4> [166.777536] ? __pfx_worker_thread+0x10/0x10 <4> [166.777539] kthread+0x11f/0x250 <4> [166.777542] ? __pfx_kthread+0x10/0x10 <4> [166.777545] ret_from_fork+0x344/0x3a0 <4> [166.777547] ? __pfx_kthread+0x10/0x10 <4> [166.777550] ret_from_fork_asm+0x1a/0x30 <4> [166.777558] </TASK> <4> [166.777559] irq event stamp: 79945 <4> [166.777560] hardirqs last enabled at (79951): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.777563] hardirqs last disabled at (79956): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.777565] softirqs last enabled at (78828): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.777568] softirqs last disabled at (78821): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.777570] ---[ end trace 0000000000000000 ]--- <6> [166.777572] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.777642] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <5> [166.777650] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=115, flags=0x0 in xe_compute_pree [3849] <7> [166.777652] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [166.778071] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.778125] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.778239] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.778342] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.778906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.778994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.779084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.779174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.779258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.779339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.779420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.779499] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.779591] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.779705] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.780716] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.791135] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.791396] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.792714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.792794] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.792868] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.792941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.793015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.793087] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.793167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.793237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.793310] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.793380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.793451] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.793520] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.793589] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.793659] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.793726] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.793793] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.793860] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.793928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.793997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.794077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.794159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.794233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.794307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.794380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.794451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.794525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.794603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.794678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.794749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.794821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.794893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.794973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.795051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.795131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.795209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.795281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.795351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.795420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.795490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.795561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.795631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.795702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.795771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.795845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.795914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.795983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.796053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.796125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.796192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.796259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.796329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.796398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.796467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.796535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.796604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.796671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.796738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.796810] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.798070] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.798920] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13876, lrc_seqno=13876, guc_id=0, flags=0x73 in no process [-1] <7> [166.798922] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.798987] ------------[ cut here ]------------ <4> [166.798988] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.798989] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#2: kworker/u64:12/984 <4> [166.799060] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.799121] efi_pstore nfnetlink autofs4 <4> [166.799126] CPU: 2 UID: 0 PID: 984 Comm: kworker/u64:12 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.799129] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.799130] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.799131] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.799136] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.799208] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.799209] RSP: 0018:ffffc9000355fc98 EFLAGS: 00010246 <4> [166.799211] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.799212] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.799213] RBP: ffffc9000355fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.799215] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.799216] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.799217] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [166.799218] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.799219] CR2: 0000785eaa346000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.799221] PKRU: 55555554 <4> [166.799222] Call Trace: <4> [166.799223] <TASK> <4> [166.799228] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.799232] ? lock_release+0xce/0x280 <4> [166.799238] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.799242] process_one_work+0x22e/0x6b0 <4> [166.799248] worker_thread+0x1e8/0x3d0 <4> [166.799251] ? __pfx_worker_thread+0x10/0x10 <4> [166.799253] kthread+0x11f/0x250 <4> [166.799256] ? __pfx_kthread+0x10/0x10 <4> [166.799259] ret_from_fork+0x344/0x3a0 <4> [166.799261] ? __pfx_kthread+0x10/0x10 <4> [166.799264] ret_from_fork_asm+0x1a/0x30 <4> [166.799272] </TASK> <4> [166.799273] irq event stamp: 90643 <4> [166.799274] hardirqs last enabled at (90649): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.799277] hardirqs last disabled at (90654): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.799279] softirqs last enabled at (90422): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.799281] softirqs last disabled at (90417): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.799284] ---[ end trace 0000000000000000 ]--- <7> [166.800997] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.801100] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.801270] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <5> [166.801546] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13924, lrc_seqno=13924, guc_id=0, flags=0x73 in no process [-1] <7> [166.801498] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.801548] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.801608] ------------[ cut here ]------------ <4> [166.801609] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.801610] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#2: kworker/u64:12/984 <4> [166.801680] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.801736] efi_pstore nfnetlink autofs4 <4> [166.801740] CPU: 2 UID: 0 PID: 984 Comm: kworker/u64:12 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.801742] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.801743] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.801744] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [166.801714] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.801749] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.801817] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.801818] RSP: 0018:ffffc9000355fc98 EFLAGS: 00010246 <4> [166.801820] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.801821] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.801822] RBP: ffffc9000355fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.801823] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.801823] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.801824] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [166.801826] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.801827] CR2: 0000785eaa346000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.801828] PKRU: 55555554 <4> [166.801829] Call Trace: <4> [166.801831] <TASK> <4> [166.801835] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.801840] ? lock_release+0xce/0x280 <4> [166.801845] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.801850] process_one_work+0x22e/0x6b0 <4> [166.801856] worker_thread+0x1e8/0x3d0 <4> [166.801858] ? __pfx_worker_thread+0x10/0x10 <4> [166.801860] kthread+0x11f/0x250 <4> [166.801864] ? __pfx_kthread+0x10/0x10 <4> [166.801867] ret_from_fork+0x344/0x3a0 <4> [166.801869] ? __pfx_kthread+0x10/0x10 <4> [166.801872] ret_from_fork_asm+0x1a/0x30 <4> [166.801879] </TASK> <4> [166.801880] irq event stamp: 92049 <4> [166.801881] hardirqs last enabled at (92055): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.801883] hardirqs last disabled at (92060): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.801885] softirqs last enabled at (90746): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.801888] softirqs last disabled at (90741): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.801890] ---[ end trace 0000000000000000 ]--- <6> [166.801891] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.801958] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.801964] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.801915] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.802109] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.802143] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.802317] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.802509] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.802707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.802708] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.802795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.802881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.802900] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.802960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.803038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.803119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.803195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.803215] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.803268] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.803357] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.803464] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.803500] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.803799] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.804294] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.804476] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.804617] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.804885] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.805157] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.805422] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.805766] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.806046] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.806315] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.814145] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.814267] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.814378] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.814486] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.814593] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.814698] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.814803] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.814909] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.815014] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.815108] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.815127] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.815251] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.815360] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.815369] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.815466] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.815619] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.815724] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.815828] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.815931] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.816034] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.816140] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.816242] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.816344] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.816444] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.816545] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.816647] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.816698] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.816749] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.816776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.816848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.816920] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.816992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.817038] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.817061] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.817160] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.817180] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.817232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.817294] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.817299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.817365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.817429] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.817493] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.817558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.817623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.817687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.817753] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.817818] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.817886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.817952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.818028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.818113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.818224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.818298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.818367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.818436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.818508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.818581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.818651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.818721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.818790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.818858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.818933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.819006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.819080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.819168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.819250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.819320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.819387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.819454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.819523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.819589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.819655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.819720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.819789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.819854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.819920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.819985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.820051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.820126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.820205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.820274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.820341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.820407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.820472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.820538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.820605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.820668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.820736] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.822056] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.822146] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13924, lrc_seqno=13924, guc_id=0, flags=0x73 in no process [-1] <7> [166.822154] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.822528] ------------[ cut here ]------------ <4> [166.822531] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.822532] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#2: kworker/u64:20/2835 <4> [166.822881] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.822965] efi_pstore nfnetlink autofs4 <4> [166.822969] CPU: 2 UID: 0 PID: 2835 Comm: kworker/u64:20 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.822972] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.822973] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.822974] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.822979] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.823053] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.823056] RSP: 0018:ffffc9000419bc98 EFLAGS: 00010246 <4> [166.823059] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.823061] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.823063] RBP: ffffc9000419bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.823065] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.823067] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.823068] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [166.823071] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.823073] CR2: 0000785eaa346000 CR3: 0000000120a6c000 CR4: 0000000000f52ef0 <4> [166.823075] PKRU: 55555554 <4> [166.823076] Call Trace: <4> [166.823078] <TASK> <4> [166.823085] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.823101] ? lock_release+0xce/0x280 <4> [166.823111] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.823121] process_one_work+0x22e/0x6b0 <7> [166.823056] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [166.823131] worker_thread+0x1e8/0x3d0 <4> [166.823135] ? __pfx_worker_thread+0x10/0x10 <4> [166.823138] kthread+0x11f/0x250 <4> [166.823142] ? __pfx_kthread+0x10/0x10 <4> [166.823147] ret_from_fork+0x344/0x3a0 <4> [166.823149] ? __pfx_kthread+0x10/0x10 <4> [166.823153] ret_from_fork_asm+0x1a/0x30 <4> [166.823164] </TASK> <4> [166.823165] irq event stamp: 164835 <4> [166.823167] hardirqs last enabled at (164841): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.823170] hardirqs last disabled at (164846): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.823173] softirqs last enabled at (164764): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.823176] softirqs last disabled at (164759): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.823179] ---[ end trace 0000000000000000 ]--- <6> [166.823181] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [166.823219] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [166.823288] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.823297] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.823700] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.824268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.824351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.824434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.824513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.824594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.824671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.824748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.824823] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.824910] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.825016] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.826018] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.836083] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.836341] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.837638] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.837711] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.837779] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.837850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.837919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.837987] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.838053] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.838137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.838204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.838271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.838338] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.838402] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.838466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.838530] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.838596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.838660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.838723] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.838787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.838851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.838925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.838999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.839069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.839157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.839227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.839294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.839364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.839436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.839506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.839574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.839643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.839712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.839785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.839858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.839931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.840000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.840075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.840143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.840211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.840277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.840346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.840414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.840480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.840545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.840615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.840680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.840747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.840813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.840878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.840945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.841009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.841079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.841148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.841213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.841277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.841343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.841406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.841470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.841537] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.842741] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.843593] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13924, lrc_seqno=13924, guc_id=0, flags=0x73 in no process [-1] <7> [166.843595] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.843653] ------------[ cut here ]------------ <4> [166.843654] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.843655] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#2: kworker/u64:20/2835 <4> [166.843722] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.843781] efi_pstore nfnetlink autofs4 <4> [166.843785] CPU: 2 UID: 0 PID: 2835 Comm: kworker/u64:20 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.843787] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.843788] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.843790] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.843794] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.843858] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.843859] RSP: 0018:ffffc9000419bc98 EFLAGS: 00010246 <4> [166.843861] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.843862] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.843864] RBP: ffffc9000419bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.843865] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.843866] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.843867] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [166.843869] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.843870] CR2: 0000785eaa346000 CR3: 0000000120a6c000 CR4: 0000000000f52ef0 <4> [166.843871] PKRU: 55555554 <4> [166.843872] Call Trace: <4> [166.843873] <TASK> <4> [166.843878] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.843883] ? lock_release+0xce/0x280 <4> [166.843889] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.843893] process_one_work+0x22e/0x6b0 <4> [166.843899] worker_thread+0x1e8/0x3d0 <4> [166.843902] ? __pfx_worker_thread+0x10/0x10 <4> [166.843904] kthread+0x11f/0x250 <4> [166.843907] ? __pfx_kthread+0x10/0x10 <4> [166.843911] ret_from_fork+0x344/0x3a0 <4> [166.843913] ? __pfx_kthread+0x10/0x10 <4> [166.843916] ret_from_fork_asm+0x1a/0x30 <4> [166.843923] </TASK> <4> [166.843924] irq event stamp: 175467 <4> [166.843925] hardirqs last enabled at (175473): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.843928] hardirqs last disabled at (175478): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.843930] softirqs last enabled at (172038): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.843932] softirqs last disabled at (172031): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.843934] ---[ end trace 0000000000000000 ]--- <7> [166.845657] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.845758] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.845892] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.846247] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <5> [166.846306] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13972, lrc_seqno=13972, guc_id=0, flags=0x73 in no process [-1] <7> [166.846309] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.846372] ------------[ cut here ]------------ <4> [166.846373] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.846374] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#2: kworker/u64:20/2835 <7> [166.846384] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.846439] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.846495] efi_pstore nfnetlink autofs4 <4> [166.846499] CPU: 2 UID: 0 PID: 2835 Comm: kworker/u64:20 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.846501] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.846502] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.846503] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [166.846503] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.846508] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.846571] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.846573] RSP: 0018:ffffc9000419bc98 EFLAGS: 00010246 <4> [166.846575] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.846576] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.846577] RBP: ffffc9000419bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.846578] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.846579] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.846580] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [166.846582] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.846583] CR2: 0000785eaa346000 CR3: 0000000120a6c000 CR4: 0000000000f52ef0 <4> [166.846584] PKRU: 55555554 <4> [166.846585] Call Trace: <4> [166.846586] <TASK> <4> [166.846591] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.846595] ? lock_release+0xce/0x280 <4> [166.846600] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.846605] process_one_work+0x22e/0x6b0 <4> [166.846610] worker_thread+0x1e8/0x3d0 <4> [166.846613] ? __pfx_worker_thread+0x10/0x10 <4> [166.846615] kthread+0x11f/0x250 <4> [166.846618] ? __pfx_kthread+0x10/0x10 <4> [166.846621] ret_from_fork+0x344/0x3a0 <4> [166.846623] ? __pfx_kthread+0x10/0x10 <4> [166.846626] ret_from_fork_asm+0x1a/0x30 <4> [166.846633] </TASK> <4> [166.846634] irq event stamp: 176641 <4> [166.846635] hardirqs last enabled at (176647): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.846637] hardirqs last disabled at (176652): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.846639] softirqs last enabled at (175516): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.846642] softirqs last disabled at (175511): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.846644] ---[ end trace 0000000000000000 ]--- <7> [166.846618] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <6> [166.846645] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.846708] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.846714] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.846734] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.846852] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.846910] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.846969] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.847096] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.847291] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.847484] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.847545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.847634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.847657] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.847723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.847808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.847884] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.847887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.847962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.848038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.848057] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.848124] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.848231] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.848242] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.848341] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.848408] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.848633] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.849009] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.849283] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.849356] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.849447] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.857161] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.857274] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.857378] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.857482] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.857585] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.857687] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.857789] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.857892] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.857993] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.858109] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.858231] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.858339] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.858442] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.858593] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.858697] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.858798] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.858902] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.859005] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.859118] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.859221] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.859322] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.859425] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.859527] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.859629] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.859732] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.859835] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.859964] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.860056] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.860330] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.861632] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.861704] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.861773] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.861841] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.861908] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.861976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.862043] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.862143] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.862220] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.862286] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.862351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.862419] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.862487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.862553] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.862617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.862681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.862746] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.862811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.862874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.862948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.863021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.863102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.863198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.863269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.863337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.863405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.863477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.863546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.863613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.863680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.863747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.863821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.863893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.863965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.864035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.864121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.864213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.864281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.864346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.864415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.864482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.864549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.864616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.864685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.864751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.864817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.864883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.864949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.865012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.865088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.865166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.865233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.865299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.865365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.865432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.865498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.865562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.865631] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.866896] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.867758] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13972, lrc_seqno=13972, guc_id=0, flags=0x73 in no process [-1] <7> [166.867760] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.867818] ------------[ cut here ]------------ <4> [166.867819] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.867820] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#9: kworker/u64:6/194 <4> [166.867889] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.867948] efi_pstore nfnetlink autofs4 <4> [166.867952] CPU: 9 UID: 0 PID: 194 Comm: kworker/u64:6 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.867955] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.867956] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.867958] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.867962] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.868027] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.868028] RSP: 0018:ffffc900015dbc98 EFLAGS: 00010246 <4> [166.868030] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.868032] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.868033] RBP: ffffc900015dbda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.868034] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.868035] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.868040] FS: 0000000000000000(0000) GS:ffff8888db15d000(0000) knlGS:0000000000000000 <4> [166.868043] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.868045] CR2: 00007e09f8933000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.868046] PKRU: 55555554 <4> [166.868048] Call Trace: <4> [166.868049] <TASK> <4> [166.868054] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.868059] ? lock_release+0xce/0x280 <4> [166.868064] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.868069] process_one_work+0x22e/0x6b0 <4> [166.868075] worker_thread+0x1e8/0x3d0 <4> [166.868078] ? __pfx_worker_thread+0x10/0x10 <4> [166.868080] kthread+0x11f/0x250 <4> [166.868083] ? __pfx_kthread+0x10/0x10 <4> [166.868087] ret_from_fork+0x344/0x3a0 <4> [166.868089] ? __pfx_kthread+0x10/0x10 <4> [166.868091] ret_from_fork_asm+0x1a/0x30 <4> [166.868099] </TASK> <4> [166.868100] irq event stamp: 623701 <4> [166.868101] hardirqs last enabled at (623707): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.868104] hardirqs last disabled at (623712): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.868106] softirqs last enabled at (620264): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.868109] softirqs last disabled at (620257): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.868111] ---[ end trace 0000000000000000 ]--- <6> [166.868113] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.868177] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.868183] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.868598] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.868694] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.868792] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.869362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.869444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.869530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.869610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.869688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.869764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.869842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.869916] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.870003] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.870122] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.871128] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.881032] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.881289] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.882547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.882619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.882687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.882756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.882823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.882891] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.882958] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.883029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.883095] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.883162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.883228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.883292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.883357] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.883424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.883489] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.883555] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.883618] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.883682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.883745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.883818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.883888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.883957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.884031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.884101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.884167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.884236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.884308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.884379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.884447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.884516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.884584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.884657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.884730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.884803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.884872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.884943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.885010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.885096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.885173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.885253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.885331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.885405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.885471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.885541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.885609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.885676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.885741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.885807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.885872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.885938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.886005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.886089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.886155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.886219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.886283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.886346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.886410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.886477] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.887686] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.888553] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=13972, lrc_seqno=13972, guc_id=0, flags=0x73 in no process [-1] <7> [166.888556] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.888615] ------------[ cut here ]------------ <4> [166.888616] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.888617] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#9: kworker/u64:6/194 <4> [166.888686] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.888744] efi_pstore nfnetlink autofs4 <4> [166.888748] CPU: 9 UID: 0 PID: 194 Comm: kworker/u64:6 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.888750] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.888751] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.888753] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.888757] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.888821] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.888823] RSP: 0018:ffffc900015dbc98 EFLAGS: 00010246 <4> [166.888825] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.888826] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.888827] RBP: ffffc900015dbda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.888828] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.888829] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.888831] FS: 0000000000000000(0000) GS:ffff8888db15d000(0000) knlGS:0000000000000000 <4> [166.888832] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.888833] CR2: 00007e09f8933000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.888835] PKRU: 55555554 <4> [166.888836] Call Trace: <4> [166.888837] <TASK> <4> [166.888842] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.888846] ? lock_release+0xce/0x280 <4> [166.888851] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.888856] process_one_work+0x22e/0x6b0 <4> [166.888862] worker_thread+0x1e8/0x3d0 <4> [166.888864] ? __pfx_worker_thread+0x10/0x10 <4> [166.888867] kthread+0x11f/0x250 <4> [166.888870] ? __pfx_kthread+0x10/0x10 <4> [166.888873] ret_from_fork+0x344/0x3a0 <4> [166.888875] ? __pfx_kthread+0x10/0x10 <4> [166.888878] ret_from_fork_asm+0x1a/0x30 <4> [166.888885] </TASK> <4> [166.888886] irq event stamp: 634373 <4> [166.888887] hardirqs last enabled at (634379): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.888889] hardirqs last disabled at (634384): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.888891] softirqs last enabled at (631160): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.888894] softirqs last disabled at (631153): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.888896] ---[ end trace 0000000000000000 ]--- <7> [166.890350] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.890449] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.890600] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.890756] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <5> [166.890890] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14019, lrc_seqno=14019, guc_id=0, flags=0x73 in no process [-1] <7> [166.890893] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [166.890894] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.890955] ------------[ cut here ]------------ <4> [166.890956] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.890957] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#2: kworker/u64:12/984 <4> [166.891033] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci <7> [166.891037] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.891078] snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [166.891095] CPU: 2 UID: 0 PID: 984 Comm: kworker/u64:12 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.891097] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.891098] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.891099] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.891104] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.891169] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.891171] RSP: 0018:ffffc9000355fc98 EFLAGS: 00010246 <4> [166.891172] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.891174] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.891175] RBP: ffffc9000355fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.891176] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.891177] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.891178] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [166.891179] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.891181] CR2: 0000785eaa346000 CR3: 0000000120a6c000 CR4: 0000000000f52ef0 <4> [166.891182] PKRU: 55555554 <4> [166.891183] Call Trace: <4> [166.891184] <TASK> <4> [166.891189] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.891193] ? lock_release+0xce/0x280 <4> [166.891199] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <7> [166.891168] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.891204] process_one_work+0x22e/0x6b0 <4> [166.891209] worker_thread+0x1e8/0x3d0 <4> [166.891212] ? __pfx_worker_thread+0x10/0x10 <4> [166.891214] kthread+0x11f/0x250 <4> [166.891217] ? __pfx_kthread+0x10/0x10 <4> [166.891220] ret_from_fork+0x344/0x3a0 <4> [166.891222] ? __pfx_kthread+0x10/0x10 <4> [166.891224] ret_from_fork_asm+0x1a/0x30 <4> [166.891231] </TASK> <4> [166.891232] irq event stamp: 99107 <4> [166.891233] hardirqs last enabled at (99113): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.891236] hardirqs last disabled at (99118): [<ffffffff814a3c53>] vprintk_emit+0x443/0x470 <4> [166.891239] softirqs last enabled at (98360): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.891241] softirqs last disabled at (98341): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.891244] ---[ end trace 0000000000000000 ]--- <6> [166.891245] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.891311] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.891317] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.891290] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.891406] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.891486] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.891529] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.891645] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.891837] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.892007] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.892053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.892141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.892227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.892308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.892354] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.892386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.892462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.892541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.892617] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.892708] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.892731] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.892816] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.893082] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.893420] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.893713] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.893826] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.893984] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.894352] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.894633] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.894901] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.903744] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.904011] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.903987] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.904203] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.904277] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.904331] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.904448] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.904562] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.904672] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.904778] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.904889] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.905012] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.905123] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.905229] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.905334] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.905507] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.905599] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.905620] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.905673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.905721] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.905744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.905814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.905823] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.905881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.905924] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.905947] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.906019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.906088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.906125] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.906153] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.906221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.906233] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.906285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.906335] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.906349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.906414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.906439] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.906478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.906539] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.906542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.906607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.906642] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.906675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.906741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.906744] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.906809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.906844] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.906886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.906960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.906982] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.907045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.907117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.907186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.907254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.907324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.907397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.907467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.907536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.907605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.907673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.907751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.907829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.907903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.907975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.908056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.908123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.908189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.908256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.908328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.908399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.908469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.908539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.908610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.908677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.908744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.908810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.908879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.908944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.909015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.909084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.909152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.909219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.909284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.909350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.909414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.909478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.909546] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.910994] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.911844] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14019, lrc_seqno=14019, guc_id=0, flags=0x73 in no process [-1] <7> [166.911847] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.911904] ------------[ cut here ]------------ <4> [166.911905] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.911906] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#2: kworker/u64:20/2835 <4> [166.911976] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.912043] efi_pstore nfnetlink autofs4 <4> [166.912047] CPU: 2 UID: 0 PID: 2835 Comm: kworker/u64:20 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.912050] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.912051] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.912053] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.912058] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.912123] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.912124] RSP: 0018:ffffc9000419bc98 EFLAGS: 00010246 <4> [166.912126] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.912128] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.912129] RBP: ffffc9000419bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.912130] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.912131] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.912132] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [166.912134] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.912135] CR2: 0000785eaa346000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.912137] PKRU: 55555554 <4> [166.912138] Call Trace: <4> [166.912139] <TASK> <4> [166.912144] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.912149] ? lock_release+0xce/0x280 <4> [166.912155] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.912160] process_one_work+0x22e/0x6b0 <4> [166.912166] worker_thread+0x1e8/0x3d0 <4> [166.912168] ? __pfx_worker_thread+0x10/0x10 <4> [166.912171] kthread+0x11f/0x250 <4> [166.912174] ? __pfx_kthread+0x10/0x10 <4> [166.912177] ret_from_fork+0x344/0x3a0 <4> [166.912180] ? __pfx_kthread+0x10/0x10 <4> [166.912183] ret_from_fork_asm+0x1a/0x30 <4> [166.912190] </TASK> <4> [166.912191] irq event stamp: 191205 <4> [166.912192] hardirqs last enabled at (191211): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.912195] hardirqs last disabled at (191216): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.912197] softirqs last enabled at (190532): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.912200] softirqs last disabled at (190527): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.912202] ---[ end trace 0000000000000000 ]--- <6> [166.912204] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.912271] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <7> [166.912288] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.912385] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [166.912475] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.913015] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.913591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.913674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.913759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.913840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.913920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.914002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.914079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.914153] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.914241] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.914351] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.915359] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.925977] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.926234] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.927540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.927612] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.927681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.927748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.927815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.927882] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.927948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.928066] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.928134] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.928198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.928264] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.928328] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.928392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.928455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.928521] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.928588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.928653] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.928717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.928782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.928857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.928927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.929007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.929077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.929146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.929212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.929283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.929356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.929425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.929492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.929560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.929628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.929702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.929776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.929851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.929924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.930005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.930075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.930141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.930207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.930275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.930344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.930412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.930479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.930549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.930614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.930681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.930744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.930810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.930874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.930939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.931019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.931086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.931151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.931216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.931281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.931345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.931409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.931476] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.932594] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.932993] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14019, lrc_seqno=14019, guc_id=0, flags=0x73 in no process [-1] <7> [166.933001] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.933318] ------------[ cut here ]------------ <4> [166.933320] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.933323] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#3: kworker/u64:20/2835 <4> [166.933481] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.933545] efi_pstore nfnetlink autofs4 <4> [166.933549] CPU: 3 UID: 0 PID: 2835 Comm: kworker/u64:20 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.933552] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.933553] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.933554] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.933560] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <7> [166.933578] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [166.933666] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.933668] RSP: 0018:ffffc9000419bc98 EFLAGS: 00010246 <4> [166.933670] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.933672] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.933674] RBP: ffffc9000419bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.933675] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.933676] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.933678] FS: 0000000000000000(0000) GS:ffff8888dae5d000(0000) knlGS:0000000000000000 <4> [166.933679] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.933681] CR2: 00007e09ff4cd000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.933683] PKRU: 55555554 <4> [166.933684] Call Trace: <4> [166.933686] <TASK> <4> [166.933695] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.933703] ? lock_release+0xce/0x280 <4> [166.933712] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.933721] process_one_work+0x22e/0x6b0 <4> [166.933732] worker_thread+0x1e8/0x3d0 <4> [166.933735] ? __pfx_worker_thread+0x10/0x10 <4> [166.933739] kthread+0x11f/0x250 <4> [166.933743] ? __pfx_kthread+0x10/0x10 <4> [166.933748] ret_from_fork+0x344/0x3a0 <4> [166.933750] ? __pfx_kthread+0x10/0x10 <4> [166.933754] ret_from_fork_asm+0x1a/0x30 <4> [166.933767] </TASK> <4> [166.933769] irq event stamp: 202241 <4> [166.933770] hardirqs last enabled at (202247): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.933774] hardirqs last disabled at (202252): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.933777] softirqs last enabled at (200068): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.933781] softirqs last disabled at (200061): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.933784] ---[ end trace 0000000000000000 ]--- <7> [166.933725] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.935557] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <5> [166.935782] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14066, lrc_seqno=14066, guc_id=0, flags=0x73 in no process [-1] <7> [166.935786] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.935844] ------------[ cut here ]------------ <7> [166.935807] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <4> [166.935845] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.935847] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#8: kworker/u64:29/2844 <4> [166.935915] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.935978] efi_pstore nfnetlink autofs4 <7> [166.935942] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.935982] CPU: 8 UID: 0 PID: 2844 Comm: kworker/u64:29 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.935985] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.935986] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.935987] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.935991] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.936056] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.936057] RSP: 0018:ffffc90004e87c98 EFLAGS: 00010246 <4> [166.936059] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.936061] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.936062] RBP: ffffc90004e87da8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.936063] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.936064] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.936065] FS: 0000000000000000(0000) GS:ffff8888db0dd000(0000) knlGS:0000000000000000 <4> [166.936067] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.936068] CR2: 00007e09ff4cd000 CR3: 0000000120a6c000 CR4: 0000000000f52ef0 <4> [166.936070] PKRU: 55555554 <4> [166.936071] Call Trace: <4> [166.936072] <TASK> <4> [166.936077] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.936082] ? lock_release+0xce/0x280 <4> [166.936087] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.936092] process_one_work+0x22e/0x6b0 <4> [166.936098] worker_thread+0x1e8/0x3d0 <4> [166.936101] ? __pfx_worker_thread+0x10/0x10 <4> [166.936103] kthread+0x11f/0x250 <4> [166.936106] ? __pfx_kthread+0x10/0x10 <4> [166.936109] ret_from_fork+0x344/0x3a0 <4> [166.936111] ? __pfx_kthread+0x10/0x10 <7> [166.936081] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.936114] ret_from_fork_asm+0x1a/0x30 <4> [166.936121] </TASK> <4> [166.936122] irq event stamp: 56787 <4> [166.936123] hardirqs last enabled at (56793): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.936126] hardirqs last disabled at (56798): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.936128] softirqs last enabled at (54664): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.936130] softirqs last disabled at (54659): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.936132] ---[ end trace 0000000000000000 ]--- <6> [166.936133] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.936198] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.936205] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.936200] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.936349] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.936456] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.936700] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.936918] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.937006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.937092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.937133] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.937176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.937254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.937330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.937404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.937449] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.937478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.937550] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.937641] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.937723] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.937749] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.938040] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.938550] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.938759] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.938885] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.939169] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.939435] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.939705] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.940063] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.940342] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.940612] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.948784] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.948936] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.948954] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.949073] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.949216] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.949524] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.949635] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.949742] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.949846] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.949955] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.950061] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.950165] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.950271] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.950377] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.950482] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.950550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.950623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.950648] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.950692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.950757] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.950761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.950830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.950859] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.950896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.950968] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.950969] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.951036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.951069] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.951102] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.951169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.951170] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.951235] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.951273] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.951300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.951364] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.951374] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.951429] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.951474] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.951494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.951560] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.951578] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.951625] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.951681] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.951689] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.951754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.951783] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.951830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.951886] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.951903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.951981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.952034] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.952052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.952120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.952187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.952256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.952329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.952399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.952466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.952535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.952604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.952678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.952755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.952827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.952898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.952976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.953045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.953115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.953180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.953248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.953314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.953380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.953448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.953518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.953586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.953653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.953719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.953787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.953850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.953914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.953991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.954061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.954127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.954191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.954256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.954321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.954386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.954454] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.955832] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.956696] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14066, lrc_seqno=14066, guc_id=0, flags=0x73 in no process [-1] <7> [166.956700] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.956760] ------------[ cut here ]------------ <4> [166.956761] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.956763] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#11: kworker/u64:1/118 <4> [166.956832] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.956896] efi_pstore nfnetlink autofs4 <4> [166.956901] CPU: 11 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.956905] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.956906] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.956907] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.956913] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.956988] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.956990] RSP: 0018:ffffc90000557c98 EFLAGS: 00010246 <4> [166.956993] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.956994] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.956996] RBP: ffffc90000557da8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.956997] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.956998] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.956999] FS: 0000000000000000(0000) GS:ffff8888db25d000(0000) knlGS:0000000000000000 <4> [166.957001] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.957002] CR2: 0000785eaa343000 CR3: 0000000120a6c000 CR4: 0000000000f52ef0 <4> [166.957003] PKRU: 55555554 <4> [166.957004] Call Trace: <4> [166.957006] <TASK> <4> [166.957011] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.957016] ? lock_release+0xce/0x280 <4> [166.957022] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.957027] process_one_work+0x22e/0x6b0 <4> [166.957033] worker_thread+0x1e8/0x3d0 <4> [166.957036] ? __pfx_worker_thread+0x10/0x10 <4> [166.957038] kthread+0x11f/0x250 <4> [166.957042] ? __pfx_kthread+0x10/0x10 <4> [166.957045] ret_from_fork+0x344/0x3a0 <4> [166.957048] ? __pfx_kthread+0x10/0x10 <4> [166.957050] ret_from_fork_asm+0x1a/0x30 <4> [166.957058] </TASK> <4> [166.957059] irq event stamp: 86857 <4> [166.957061] hardirqs last enabled at (86863): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.957064] hardirqs last disabled at (86868): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.957065] softirqs last enabled at (84414): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.957068] softirqs last disabled at (84389): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.957071] ---[ end trace 0000000000000000 ]--- <6> [166.957073] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [166.957138] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.957145] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.957557] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.957656] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.957757] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.958340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.958424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.958509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.958589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.958666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.958743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.958820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.958895] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.958992] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.959099] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.960107] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.969926] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.970183] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.971489] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.971560] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.971629] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.971698] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.971768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.971836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.971904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.971986] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.972053] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.972120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.972186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.972251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.972316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.972381] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.972446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.972510] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.972574] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.972639] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.972703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.972775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.972848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.972924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.972996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.973064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.973131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.973201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.973275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.973345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.973414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.973484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.973552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.973627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.973702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.973775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.973845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.973918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.973989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.974056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.974122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.974191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.974260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.974326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.974391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.974459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.974525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.974593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.974661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.974728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.974793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.974859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.974931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.974998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.975064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.975128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.975195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.975258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.975323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.975392] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.976673] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [166.977531] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14066, lrc_seqno=14066, guc_id=0, flags=0x73 in no process [-1] <7> [166.977533] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [166.977590] ------------[ cut here ]------------ <4> [166.977592] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.977593] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#11: kworker/u64:1/118 <4> [166.977659] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [166.977720] efi_pstore nfnetlink autofs4 <4> [166.977724] CPU: 11 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.977727] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.977728] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.977729] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.977734] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.977798] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.977799] RSP: 0018:ffffc90000557c98 EFLAGS: 00010246 <4> [166.977801] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.977803] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.977804] RBP: ffffc90000557da8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.977805] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.977806] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.977807] FS: 0000000000000000(0000) GS:ffff8888db25d000(0000) knlGS:0000000000000000 <4> [166.977809] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.977810] CR2: 0000785eaa343000 CR3: 0000000120a6c000 CR4: 0000000000f52ef0 <4> [166.977811] PKRU: 55555554 <4> [166.977812] Call Trace: <4> [166.977813] <TASK> <4> [166.977818] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.977823] ? lock_release+0xce/0x280 <4> [166.977829] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.977834] process_one_work+0x22e/0x6b0 <4> [166.977840] worker_thread+0x1e8/0x3d0 <4> [166.977843] ? __pfx_worker_thread+0x10/0x10 <4> [166.977845] kthread+0x11f/0x250 <4> [166.977848] ? __pfx_kthread+0x10/0x10 <4> [166.977851] ret_from_fork+0x344/0x3a0 <4> [166.977854] ? __pfx_kthread+0x10/0x10 <4> [166.977857] ret_from_fork_asm+0x1a/0x30 <4> [166.977864] </TASK> <4> [166.977865] irq event stamp: 97503 <4> [166.977866] hardirqs last enabled at (97509): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.977869] hardirqs last disabled at (97514): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.977871] softirqs last enabled at (94282): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.977874] softirqs last disabled at (94275): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.977876] ---[ end trace 0000000000000000 ]--- <7> [166.979335] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [166.979484] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [166.979560] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.979780] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <5> [166.979859] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14113, lrc_seqno=14113, guc_id=0, flags=0x73 in no process [-1] <7> [166.979863] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [166.979919] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.979958] ------------[ cut here ]------------ <4> [166.979959] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [166.979960] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#0: kworker/u64:29/2844 <4> [166.980047] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass <7> [166.980047] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.980080] snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [166.980110] CPU: 0 UID: 0 PID: 2844 Comm: kworker/u64:29 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [166.980113] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [166.980115] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [166.980116] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [166.980121] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [166.980188] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [166.980190] RSP: 0018:ffffc90004e87c98 EFLAGS: 00010246 <4> [166.980192] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [166.980193] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [166.980194] RBP: ffffc90004e87da8 R08: 0000000000000000 R09: 0000000000000000 <4> [166.980195] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [166.980197] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [166.980198] FS: 0000000000000000(0000) GS:ffff8888dacdd000(0000) knlGS:0000000000000000 <7> [166.980167] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [166.980200] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [166.980201] CR2: 00007e09ff4cd000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [166.980202] PKRU: 55555554 <4> [166.980203] Call Trace: <4> [166.980204] <TASK> <4> [166.980209] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [166.980213] ? lock_release+0xce/0x280 <4> [166.980219] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [166.980223] process_one_work+0x22e/0x6b0 <4> [166.980229] worker_thread+0x1e8/0x3d0 <4> [166.980232] ? __pfx_worker_thread+0x10/0x10 <4> [166.980234] kthread+0x11f/0x250 <4> [166.980237] ? __pfx_kthread+0x10/0x10 <4> [166.980241] ret_from_fork+0x344/0x3a0 <4> [166.980243] ? __pfx_kthread+0x10/0x10 <4> [166.980245] ret_from_fork_asm+0x1a/0x30 <4> [166.980253] </TASK> <4> [166.980254] irq event stamp: 62153 <4> [166.980255] hardirqs last enabled at (62159): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [166.980257] hardirqs last disabled at (62164): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [166.980259] softirqs last enabled at (61390): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.980262] softirqs last disabled at (61253): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [166.980264] ---[ end trace 0000000000000000 ]--- <6> [166.980266] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [166.980283] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <6> [166.980334] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [166.980339] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [166.980398] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.980443] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [166.980515] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.980629] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.980822] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.980993] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.981004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [166.981107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [166.981159] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.981193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [166.981270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [166.981346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [166.981390] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.981419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [166.981494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [166.981557] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.981566] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [166.981653] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [166.981721] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.981761] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [166.981899] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.982180] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.982582] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [166.982781] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [166.982792] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.982953] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [166.990791] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.990909] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.991016] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.991121] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.991226] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.991329] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.991432] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.991538] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.991641] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.991744] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.991845] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.991953] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.992056] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.992201] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [166.992307] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [166.992407] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [166.992506] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [166.992605] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [166.992706] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [166.992805] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [166.992912] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [166.992900] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [166.993020] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [166.993124] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [166.993171] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [166.993227] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [166.993330] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [166.993433] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [166.993555] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [166.993668] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [166.994479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [166.994553] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [166.994622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [166.994692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [166.994760] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [166.994843] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [166.994921] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [166.995011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [166.995081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [166.995148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [166.995214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [166.995282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [166.995348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [166.995414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [166.995479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [166.995544] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [166.995611] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [166.995675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [166.995739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [166.995813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [166.995886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [166.995978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [166.996066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [166.996135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [166.996205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [166.996274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [166.996349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [166.996421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [166.996491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [166.996559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [166.996629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [166.996704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [166.996777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [166.996850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [166.996935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [166.997028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [166.997099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [166.997168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [166.997236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [166.997306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [166.997374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [166.997440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [166.997507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [166.997576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [166.997642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [166.997710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [166.997776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [166.997843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [166.997916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [166.998002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [166.998072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [166.998139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [166.998204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [166.998271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [166.998339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [166.998402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [166.998465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [166.998535] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [166.999874] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [167.000731] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14113, lrc_seqno=14113, guc_id=0, flags=0x73 in no process [-1] <7> [167.000734] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [167.000792] ------------[ cut here ]------------ <4> [167.000793] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [167.000794] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#11: kworker/u64:1/118 <4> [167.000867] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [167.000931] efi_pstore nfnetlink autofs4 <4> [167.000935] CPU: 11 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [167.000938] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [167.000939] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [167.000941] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [167.000945] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [167.001010] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [167.001012] RSP: 0018:ffffc90000557c98 EFLAGS: 00010246 <4> [167.001014] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [167.001015] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [167.001016] RBP: ffffc90000557da8 R08: 0000000000000000 R09: 0000000000000000 <4> [167.001017] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [167.001018] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [167.001020] FS: 0000000000000000(0000) GS:ffff8888db25d000(0000) knlGS:0000000000000000 <4> [167.001021] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [167.001022] CR2: 0000785eaa343000 CR3: 0000000120a6c000 CR4: 0000000000f52ef0 <4> [167.001024] PKRU: 55555554 <4> [167.001025] Call Trace: <4> [167.001026] <TASK> <4> [167.001031] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [167.001035] ? lock_release+0xce/0x280 <4> [167.001041] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [167.001045] process_one_work+0x22e/0x6b0 <4> [167.001051] worker_thread+0x1e8/0x3d0 <4> [167.001054] ? __pfx_worker_thread+0x10/0x10 <4> [167.001056] kthread+0x11f/0x250 <4> [167.001059] ? __pfx_kthread+0x10/0x10 <4> [167.001062] ret_from_fork+0x344/0x3a0 <4> [167.001064] ? __pfx_kthread+0x10/0x10 <4> [167.001067] ret_from_fork_asm+0x1a/0x30 <4> [167.001074] </TASK> <4> [167.001075] irq event stamp: 108497 <4> [167.001076] hardirqs last enabled at (108503): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [167.001079] hardirqs last disabled at (108508): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [167.001081] softirqs last enabled at (105818): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.001084] softirqs last disabled at (105777): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.001086] ---[ end trace 0000000000000000 ]--- <6> [167.001088] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [167.001153] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <7> [167.001169] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [167.001266] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [167.001355] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [167.001762] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [167.002328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [167.002410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [167.002494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [167.002575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [167.002652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [167.002727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [167.002803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [167.002876] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [167.002979] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [167.003086] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [167.004091] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [167.013876] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [167.014132] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [167.015437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [167.015509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [167.015577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [167.015648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [167.015717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [167.015784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [167.015851] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [167.015933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [167.016000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [167.016063] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [167.016127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [167.016191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [167.016255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [167.016318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [167.016385] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [167.016449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [167.016513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [167.016577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [167.016640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [167.016713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [167.016784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [167.016853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [167.016941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [167.017009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [167.017076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [167.017146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [167.017218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [167.017287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [167.017355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [167.017425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [167.017496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [167.017571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [167.017645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [167.017719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [167.017790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [167.017866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [167.017936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [167.018004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [167.018070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [167.018139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [167.018206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [167.018272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [167.018336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [167.018404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [167.018471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [167.018535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [167.018600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [167.018667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [167.018732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [167.018796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [167.018870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [167.018938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [167.019002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [167.019064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [167.019128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [167.019190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [167.019252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [167.019317] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [167.020453] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [167.021306] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14113, lrc_seqno=14113, guc_id=0, flags=0x73 in no process [-1] <7> [167.021308] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [167.021365] ------------[ cut here ]------------ <4> [167.021366] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [167.021367] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#11: kworker/u64:1/118 <4> [167.021434] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [167.021491] efi_pstore nfnetlink autofs4 <4> [167.021494] CPU: 11 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [167.021497] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [167.021498] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [167.021499] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [167.021504] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [167.021568] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [167.021570] RSP: 0018:ffffc90000557c98 EFLAGS: 00010246 <4> [167.021572] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [167.021573] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [167.021574] RBP: ffffc90000557da8 R08: 0000000000000000 R09: 0000000000000000 <4> [167.021575] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [167.021576] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [167.021577] FS: 0000000000000000(0000) GS:ffff8888db25d000(0000) knlGS:0000000000000000 <4> [167.021579] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [167.021580] CR2: 0000785eaa343000 CR3: 0000000120a6c000 CR4: 0000000000f52ef0 <4> [167.021581] PKRU: 55555554 <4> [167.021582] Call Trace: <4> [167.021583] <TASK> <4> [167.021588] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [167.021593] ? lock_release+0xce/0x280 <4> [167.021598] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [167.021603] process_one_work+0x22e/0x6b0 <4> [167.021609] worker_thread+0x1e8/0x3d0 <4> [167.021611] ? __pfx_worker_thread+0x10/0x10 <4> [167.021613] kthread+0x11f/0x250 <4> [167.021616] ? __pfx_kthread+0x10/0x10 <4> [167.021620] ret_from_fork+0x344/0x3a0 <4> [167.021622] ? __pfx_kthread+0x10/0x10 <4> [167.021624] ret_from_fork_asm+0x1a/0x30 <4> [167.021632] </TASK> <4> [167.021633] irq event stamp: 119131 <4> [167.021634] hardirqs last enabled at (119137): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [167.021636] hardirqs last disabled at (119142): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [167.021638] softirqs last enabled at (115702): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.021640] softirqs last disabled at (115697): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.021643] ---[ end trace 0000000000000000 ]--- <7> [167.023162] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [167.023305] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [167.023398] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <5> [167.023511] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14161, lrc_seqno=14161, guc_id=0, flags=0x73 in no process [-1] <7> [167.023514] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [167.023527] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <4> [167.023572] ------------[ cut here ]------------ <4> [167.023572] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [167.023574] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#10: kworker/u64:44/2860 <4> [167.023643] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek <7> [167.023652] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [167.023685] snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [167.023704] CPU: 10 UID: 0 PID: 2860 Comm: kworker/u64:44 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [167.023707] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [167.023708] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [167.023709] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [167.023713] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [167.023778] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [167.023780] RSP: 0018:ffffc9000587fc98 EFLAGS: 00010246 <4> [167.023781] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [167.023783] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [167.023784] RBP: ffffc9000587fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [167.023785] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [167.023786] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [167.023787] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [167.023788] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [167.023789] CR2: 00007e09ff4cd000 CR3: 0000000120a6c000 CR4: 0000000000f52ef0 <4> [167.023791] PKRU: 55555554 <4> [167.023792] Call Trace: <4> [167.023793] <TASK> <7> [167.023766] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [167.023797] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [167.023802] ? lock_release+0xce/0x280 <4> [167.023807] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [167.023812] process_one_work+0x22e/0x6b0 <4> [167.023818] worker_thread+0x1e8/0x3d0 <4> [167.023820] ? __pfx_worker_thread+0x10/0x10 <4> [167.023822] kthread+0x11f/0x250 <4> [167.023825] ? __pfx_kthread+0x10/0x10 <4> [167.023828] ret_from_fork+0x344/0x3a0 <4> [167.023832] ? __pfx_kthread+0x10/0x10 <4> [167.023834] ret_from_fork_asm+0x1a/0x30 <4> [167.023842] </TASK> <4> [167.023842] irq event stamp: 190971 <4> [167.023844] hardirqs last enabled at (190977): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [167.023846] hardirqs last disabled at (190982): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [167.023848] softirqs last enabled at (188556): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.023850] softirqs last disabled at (188549): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.023853] ---[ end trace 0000000000000000 ]--- <6> [167.023861] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [167.023884] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <6> [167.023926] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [167.023933] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [167.023995] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.024046] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [167.024106] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [167.024219] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.024329] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.024511] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [167.024605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [167.024686] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.024689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [167.024774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [167.024862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [167.024875] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.024945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [167.025020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [167.025096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [167.025103] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [167.025168] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [167.025256] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [167.025276] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.025364] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [167.025441] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.025659] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.025898] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.026281] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [167.026373] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [167.026451] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.026614] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.034377] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [167.034488] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [167.034592] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [167.034694] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [167.034796] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [167.034946] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [167.035049] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [167.035151] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [167.035501] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [167.035604] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [167.035708] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [167.035812] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [167.035927] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [167.036077] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [167.036182] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [167.036282] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [167.036382] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [167.036484] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [167.036584] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [167.036685] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [167.036785] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [167.036849] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [167.036892] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [167.037000] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [167.037100] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [167.037109] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [167.037200] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [167.037302] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [167.037425] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [167.037539] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.038404] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [167.038476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [167.038545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [167.038613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [167.038680] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [167.038747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [167.038815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [167.038894] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [167.038961] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [167.039029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [167.039095] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [167.039160] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [167.039225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [167.039290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [167.039356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [167.039421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [167.039487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [167.039551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [167.039615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [167.039689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [167.039761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [167.039832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [167.039920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [167.039990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [167.040057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [167.040129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [167.040203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [167.040273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [167.040341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [167.040409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [167.040477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [167.040551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [167.040622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [167.040693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [167.040763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [167.040831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [167.040915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [167.040984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [167.041052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [167.041120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [167.041189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [167.041255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [167.041320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [167.041389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [167.041457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [167.041523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [167.041588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [167.041655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [167.041721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [167.041788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [167.041862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [167.041930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [167.041999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [167.042063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [167.042130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [167.042195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [167.042262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [167.042331] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [167.043628] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [167.043858] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14161, lrc_seqno=14161, guc_id=0, flags=0x73 in no process [-1] <7> [167.043865] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [167.044204] ------------[ cut here ]------------ <4> [167.044207] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [167.044210] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#11: kworker/u64:44/2860 <4> [167.044488] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [167.044550] efi_pstore nfnetlink autofs4 <4> [167.044554] CPU: 11 UID: 0 PID: 2860 Comm: kworker/u64:44 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [167.044556] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [167.044557] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [167.044559] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [167.044564] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [167.044648] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [167.044651] RSP: 0018:ffffc9000587fc98 EFLAGS: 00010246 <4> [167.044654] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [167.044656] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [167.044658] RBP: ffffc9000587fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [167.044660] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [167.044662] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [167.044664] FS: 0000000000000000(0000) GS:ffff8888db25d000(0000) knlGS:0000000000000000 <4> [167.044666] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [167.044668] CR2: 0000785eaa343000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [167.044671] PKRU: 55555554 <4> [167.044672] Call Trace: <4> [167.044674] <TASK> <7> [167.044616] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [167.044683] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [167.044691] ? lock_release+0xce/0x280 <4> [167.044700] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [167.044707] process_one_work+0x22e/0x6b0 <4> [167.044716] worker_thread+0x1e8/0x3d0 <4> [167.044720] ? __pfx_worker_thread+0x10/0x10 <4> [167.044723] kthread+0x11f/0x250 <4> [167.044727] ? __pfx_kthread+0x10/0x10 <4> [167.044732] ret_from_fork+0x344/0x3a0 <4> [167.044735] ? __pfx_kthread+0x10/0x10 <4> [167.044739] ret_from_fork_asm+0x1a/0x30 <4> [167.044751] </TASK> <4> [167.044756] irq event stamp: 201621 <4> [167.044758] hardirqs last enabled at (201627): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [167.044762] hardirqs last disabled at (201632): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [167.044765] softirqs last enabled at (198300): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.044768] softirqs last disabled at (198293): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.044771] ---[ end trace 0000000000000000 ]--- <7> [167.044758] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [167.044773] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [167.044909] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [167.044917] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [167.045328] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [167.045893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [167.045975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [167.046057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [167.046137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [167.046215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [167.046288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [167.046362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [167.046433] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [167.046520] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [167.046625] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [167.047632] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [167.057852] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [167.058124] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [167.059402] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [167.059475] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [167.059543] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [167.059612] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [167.059679] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [167.059746] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [167.059816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [167.059885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [167.059951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [167.060018] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [167.060083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [167.060148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [167.060214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [167.060279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [167.060343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [167.060408] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [167.060473] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [167.060541] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [167.060609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [167.060683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [167.060755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [167.060830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [167.060900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [167.060967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [167.061034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [167.061105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [167.061177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [167.061246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [167.061316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [167.061386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [167.061456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [167.061529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [167.061602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [167.061675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [167.061746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [167.061823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [167.061891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [167.061959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [167.062026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [167.062093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [167.062161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [167.062227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [167.062292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [167.062361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [167.062427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [167.062495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [167.062560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [167.062628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [167.062693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [167.062756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [167.062830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [167.062897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [167.062963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [167.063029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [167.063095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [167.063160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [167.063226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [167.063296] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [167.064489] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [167.065349] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14161, lrc_seqno=14161, guc_id=0, flags=0x73 in no process [-1] <7> [167.065352] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [167.065417] ------------[ cut here ]------------ <4> [167.065418] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [167.065419] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#11: kworker/u64:44/2860 <4> [167.065495] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [167.065555] efi_pstore nfnetlink autofs4 <4> [167.065558] CPU: 11 UID: 0 PID: 2860 Comm: kworker/u64:44 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [167.065561] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [167.065562] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [167.065563] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [167.065568] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [167.065632] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [167.065634] RSP: 0018:ffffc9000587fc98 EFLAGS: 00010246 <4> [167.065636] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [167.065637] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [167.065638] RBP: ffffc9000587fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [167.065639] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [167.065640] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [167.065641] FS: 0000000000000000(0000) GS:ffff8888db25d000(0000) knlGS:0000000000000000 <4> [167.065643] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [167.065644] CR2: 0000785eaa343000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [167.065645] PKRU: 55555554 <4> [167.065646] Call Trace: <4> [167.065647] <TASK> <4> [167.065653] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [167.065657] ? lock_release+0xce/0x280 <4> [167.065663] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [167.065668] process_one_work+0x22e/0x6b0 <4> [167.065673] worker_thread+0x1e8/0x3d0 <4> [167.065676] ? __pfx_worker_thread+0x10/0x10 <4> [167.065678] kthread+0x11f/0x250 <4> [167.065681] ? __pfx_kthread+0x10/0x10 <4> [167.065684] ret_from_fork+0x344/0x3a0 <4> [167.065686] ? __pfx_kthread+0x10/0x10 <4> [167.065689] ret_from_fork_asm+0x1a/0x30 <4> [167.065697] </TASK> <4> [167.065698] irq event stamp: 212271 <4> [167.065699] hardirqs last enabled at (212277): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [167.065701] hardirqs last disabled at (212282): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [167.065703] softirqs last enabled at (209050): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.065706] softirqs last disabled at (209043): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.065708] ---[ end trace 0000000000000000 ]--- <7> [167.067417] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [167.067512] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [167.067656] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.067892] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <5> [167.067974] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14209, lrc_seqno=14209, guc_id=0, flags=0x73 in no process [-1] <7> [167.067977] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [167.068035] ------------[ cut here ]------------ <4> [167.068036] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [167.068021] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [167.068038] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#11: kworker/u64:44/2860 <4> [167.068105] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [167.068161] efi_pstore nfnetlink autofs4 <4> [167.068165] CPU: 11 UID: 0 PID: 2860 Comm: kworker/u64:44 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [167.068168] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [167.068169] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <7> [167.068138] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [167.068170] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [167.068174] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [167.068239] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [167.068240] RSP: 0018:ffffc9000587fc98 EFLAGS: 00010246 <4> [167.068242] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [167.068243] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [167.068245] RBP: ffffc9000587fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [167.068246] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [167.068247] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [167.068248] FS: 0000000000000000(0000) GS:ffff8888db25d000(0000) knlGS:0000000000000000 <4> [167.068249] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [167.068250] CR2: 0000785eaa343000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [167.068252] PKRU: 55555554 <4> [167.068253] Call Trace: <4> [167.068253] <TASK> <4> [167.068259] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [167.068263] ? lock_release+0xce/0x280 <4> [167.068269] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [167.068273] process_one_work+0x22e/0x6b0 <4> [167.068279] worker_thread+0x1e8/0x3d0 <4> [167.068282] ? __pfx_worker_thread+0x10/0x10 <4> [167.068284] kthread+0x11f/0x250 <7> [167.068253] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [167.068287] ? __pfx_kthread+0x10/0x10 <4> [167.068290] ret_from_fork+0x344/0x3a0 <4> [167.068292] ? __pfx_kthread+0x10/0x10 <4> [167.068294] ret_from_fork_asm+0x1a/0x30 <4> [167.068302] </TASK> <4> [167.068303] irq event stamp: 213653 <4> [167.068303] hardirqs last enabled at (213659): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [167.068306] hardirqs last disabled at (213664): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [167.068308] softirqs last enabled at (209050): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.068310] softirqs last disabled at (209043): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.068312] ---[ end trace 0000000000000000 ]--- <6> [167.068313] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [167.068379] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [167.068385] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [167.068369] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.068482] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [167.068568] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [167.068598] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.068710] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.068910] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [167.069095] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.069209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [167.069262] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.069297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [167.069385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [167.069468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [167.069487] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [167.069550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [167.069630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [167.069660] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.069707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [167.069780] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [167.069835] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.069895] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [167.070005] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [167.070007] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.070205] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.070571] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [167.070928] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.071017] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [167.071091] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.078694] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [167.078811] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [167.078916] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [167.079020] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [167.079125] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [167.079227] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [167.079329] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [167.079432] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [167.079535] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [167.079637] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [167.079741] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [167.079853] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [167.079958] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [167.080111] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [167.080217] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [167.080319] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [167.080419] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [167.080521] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [167.080621] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [167.080720] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [167.080800] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [167.080825] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [167.080931] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [167.081031] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [167.081071] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [167.081132] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [167.081233] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [167.081337] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [167.081459] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [167.081572] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.082342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [167.082418] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [167.082488] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [167.082559] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [167.082630] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [167.082700] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [167.082765] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [167.082842] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [167.082909] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [167.082977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [167.083045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [167.083111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [167.083175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [167.083241] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [167.083304] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [167.083369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [167.083434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [167.083498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [167.083561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [167.083636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [167.083707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [167.083777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [167.083861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [167.083930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [167.083999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [167.084070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [167.084145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [167.084220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [167.084290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [167.084360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [167.084431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [167.084508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [167.084587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [167.084660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [167.084730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [167.084803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [167.084876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [167.084947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [167.085015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [167.085085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [167.085153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [167.085220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [167.085285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [167.085354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [167.085420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [167.085487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [167.085553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [167.085620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [167.085686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [167.085751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [167.085830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [167.085896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [167.085961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [167.086026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [167.086093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [167.086158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [167.086224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [167.086295] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [167.087538] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [167.088393] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14209, lrc_seqno=14209, guc_id=0, flags=0x73 in no process [-1] <7> [167.088395] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [167.088453] ------------[ cut here ]------------ <4> [167.088454] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [167.088455] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#6: kworker/u64:20/2835 <4> [167.088524] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [167.088582] efi_pstore nfnetlink autofs4 <4> [167.088586] CPU: 6 UID: 0 PID: 2835 Comm: kworker/u64:20 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [167.088589] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [167.088590] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [167.088591] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [167.088596] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [167.088661] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [167.088663] RSP: 0018:ffffc9000419bc98 EFLAGS: 00010246 <4> [167.088665] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [167.088666] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [167.088667] RBP: ffffc9000419bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [167.088668] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [167.088670] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [167.088671] FS: 0000000000000000(0000) GS:ffff8888dafdd000(0000) knlGS:0000000000000000 <4> [167.088672] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [167.088673] CR2: 0000785eaa34e000 CR3: 0000000114fa2000 CR4: 0000000000f52ef0 <4> [167.088675] PKRU: 55555554 <4> [167.088676] Call Trace: <4> [167.088677] <TASK> <4> [167.088682] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [167.088687] ? lock_release+0xce/0x280 <4> [167.088692] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [167.088697] process_one_work+0x22e/0x6b0 <4> [167.088703] worker_thread+0x1e8/0x3d0 <4> [167.088705] ? __pfx_worker_thread+0x10/0x10 <4> [167.088707] kthread+0x11f/0x250 <4> [167.088711] ? __pfx_kthread+0x10/0x10 <4> [167.088714] ret_from_fork+0x344/0x3a0 <4> [167.088716] ? __pfx_kthread+0x10/0x10 <4> [167.088718] ret_from_fork_asm+0x1a/0x30 <4> [167.088726] </TASK> <4> [167.088727] irq event stamp: 215693 <4> [167.088728] hardirqs last enabled at (215699): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [167.088731] hardirqs last disabled at (215704): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [167.088733] softirqs last enabled at (212472): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.088735] softirqs last disabled at (212467): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.088738] ---[ end trace 0000000000000000 ]--- <6> [167.088739] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [167.088815] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [167.088823] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [167.089237] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [167.089331] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [167.089430] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [167.089994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [167.090074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [167.090158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [167.090238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [167.090316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [167.090391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [167.090466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [167.090536] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [167.090623] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [167.090731] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [167.091739] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [167.101772] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [167.102029] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [167.103233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [167.103306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [167.103373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [167.103442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [167.103509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [167.103575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [167.103641] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [167.103706] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [167.103774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [167.103840] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [167.103904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [167.103968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [167.104032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [167.104097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [167.104163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [167.104229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [167.104293] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [167.104359] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [167.104425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [167.104499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [167.104572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [167.104642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [167.104715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [167.104793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [167.104865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [167.104937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [167.105011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [167.105081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [167.105148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [167.105216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [167.105286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [167.105359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [167.105434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [167.105510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [167.105581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [167.105652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [167.105718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [167.105793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [167.105860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [167.105930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [167.105998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [167.106065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [167.106130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [167.106198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [167.106265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [167.106330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [167.106395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [167.106462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [167.106526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [167.106591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [167.106661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [167.106726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [167.106803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [167.106869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [167.106936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [167.107001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [167.107066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [167.107136] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [167.108360] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [167.109207] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14209, lrc_seqno=14209, guc_id=0, flags=0x73 in no process [-1] <7> [167.109210] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [167.109268] ------------[ cut here ]------------ <4> [167.109269] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [167.109270] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#6: kworker/u64:20/2835 <4> [167.109337] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [167.109394] efi_pstore nfnetlink autofs4 <4> [167.109398] CPU: 6 UID: 0 PID: 2835 Comm: kworker/u64:20 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [167.109401] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [167.109402] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [167.109403] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [167.109408] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [167.109475] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [167.109477] RSP: 0018:ffffc9000419bc98 EFLAGS: 00010246 <4> [167.109479] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [167.109480] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [167.109481] RBP: ffffc9000419bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [167.109482] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [167.109483] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [167.109485] FS: 0000000000000000(0000) GS:ffff8888dafdd000(0000) knlGS:0000000000000000 <4> [167.109486] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [167.109487] CR2: 0000785eaa34e000 CR3: 0000000114fa2000 CR4: 0000000000f52ef0 <4> [167.109488] PKRU: 55555554 <4> [167.109489] Call Trace: <4> [167.109490] <TASK> <4> [167.109495] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [167.109500] ? lock_release+0xce/0x280 <4> [167.109505] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [167.109510] process_one_work+0x22e/0x6b0 <4> [167.109516] worker_thread+0x1e8/0x3d0 <4> [167.109518] ? __pfx_worker_thread+0x10/0x10 <4> [167.109520] kthread+0x11f/0x250 <4> [167.109523] ? __pfx_kthread+0x10/0x10 <4> [167.109527] ret_from_fork+0x344/0x3a0 <4> [167.109529] ? __pfx_kthread+0x10/0x10 <4> [167.109531] ret_from_fork_asm+0x1a/0x30 <4> [167.109539] </TASK> <4> [167.109540] irq event stamp: 226377 <4> [167.109541] hardirqs last enabled at (226383): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [167.109543] hardirqs last disabled at (226388): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [167.109545] softirqs last enabled at (223172): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.109548] softirqs last disabled at (223165): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.109550] ---[ end trace 0000000000000000 ]--- <7> [167.111048] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [167.111146] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [167.111293] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.111422] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [167.111547] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <5> [167.111598] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14257, lrc_seqno=14257, guc_id=0, flags=0x73 in no process [-1] <7> [167.111600] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [167.111656] ------------[ cut here ]------------ <4> [167.111657] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [167.111658] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#6: kworker/u64:20/2835 <7> [167.111660] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [167.111725] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [167.111788] efi_pstore nfnetlink autofs4 <4> [167.111792] CPU: 6 UID: 0 PID: 2835 Comm: kworker/u64:20 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [167.111794] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [167.111795] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [167.111796] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [167.111778] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [167.111801] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [167.111864] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [167.111866] RSP: 0018:ffffc9000419bc98 EFLAGS: 00010246 <4> [167.111868] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [167.111869] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [167.111870] RBP: ffffc9000419bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [167.111871] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [167.111872] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [167.111873] FS: 0000000000000000(0000) GS:ffff8888dafdd000(0000) knlGS:0000000000000000 <4> [167.111874] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [167.111875] CR2: 0000785eaa34e000 CR3: 0000000114fa2000 CR4: 0000000000f52ef0 <4> [167.111877] PKRU: 55555554 <4> [167.111878] Call Trace: <4> [167.111879] <TASK> <4> [167.111883] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [167.111888] ? lock_release+0xce/0x280 <4> [167.111893] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [167.111898] process_one_work+0x22e/0x6b0 <4> [167.111904] worker_thread+0x1e8/0x3d0 <4> [167.111906] ? __pfx_worker_thread+0x10/0x10 <4> [167.111908] kthread+0x11f/0x250 <4> [167.111911] ? __pfx_kthread+0x10/0x10 <4> [167.111914] ret_from_fork+0x344/0x3a0 <4> [167.111916] ? __pfx_kthread+0x10/0x10 <4> [167.111919] ret_from_fork_asm+0x1a/0x30 <7> [167.111889] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [167.111927] </TASK> <4> [167.111928] irq event stamp: 227543 <4> [167.111928] hardirqs last enabled at (227549): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [167.111931] hardirqs last disabled at (227554): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [167.111933] softirqs last enabled at (227032): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.111935] softirqs last disabled at (227025): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.111937] ---[ end trace 0000000000000000 ]--- <6> [167.111938] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [167.112002] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [167.112009] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [167.112002] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [167.112115] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.112175] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [167.112242] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.112434] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [167.112620] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.112814] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.112949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [167.113036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [167.113047] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [167.113123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [167.113201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [167.113221] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.113277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [167.113353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [167.113382] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.113430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [167.113505] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [167.113547] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.113594] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [167.113702] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [167.113708] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.113942] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [167.114107] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.114267] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.114992] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [167.121996] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [167.122106] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [167.122210] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [167.122313] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [167.122416] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [167.122520] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [167.122624] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [167.122729] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [167.122848] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [167.122951] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [167.123054] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [167.123159] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [167.123262] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [167.123414] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [167.123752] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [167.123858] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [167.123960] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [167.124060] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [167.124160] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [167.124263] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [167.124363] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [167.124468] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [167.124568] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [167.124670] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [167.124780] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [167.124882] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [167.125002] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [167.125115] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.125758] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [167.126123] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [167.127566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [167.127684] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [167.127807] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [167.127924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [167.128040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [167.128156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [167.128271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [167.128387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [167.128502] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [167.128617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [167.128737] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [167.128853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [167.128968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [167.129083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [167.129199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [167.129314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [167.129429] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [167.129544] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [167.129659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [167.129786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [167.129909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [167.130028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [167.130149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [167.130267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [167.130385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [167.130507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [167.130632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [167.130759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [167.130880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [167.131001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [167.131123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [167.131251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [167.131377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [167.131503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [167.131627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [167.131756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [167.131877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [167.131997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [167.132116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [167.132238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [167.132359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [167.132479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [167.132598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [167.132721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [167.132845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [167.132965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [167.133083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [167.133203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [167.133321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [167.133439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [167.133562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [167.133681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [167.133805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [167.133923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [167.134044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [167.134162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [167.134280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [167.134403] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [167.135670] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [167.136537] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14257, lrc_seqno=14257, guc_id=0, flags=0x73 in no process [-1] <7> [167.136540] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [167.136599] ------------[ cut here ]------------ <4> [167.136600] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [167.136601] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#10: kworker/u64:25/2840 <4> [167.136669] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [167.136733] efi_pstore nfnetlink autofs4 <4> [167.136737] CPU: 10 UID: 0 PID: 2840 Comm: kworker/u64:25 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [167.136740] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [167.136741] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [167.136742] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [167.136747] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [167.136811] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [167.136813] RSP: 0018:ffffc90004eafc98 EFLAGS: 00010246 <4> [167.136815] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [167.136816] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [167.136817] RBP: ffffc90004eafda8 R08: 0000000000000000 R09: 0000000000000000 <4> [167.136819] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [167.136820] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [167.136821] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [167.136822] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [167.136823] CR2: 00007e09ff4cd000 CR3: 0000000120a6c000 CR4: 0000000000f52ef0 <4> [167.136825] PKRU: 55555554 <4> [167.136826] Call Trace: <4> [167.136827] <TASK> <4> [167.136832] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [167.136837] ? lock_release+0xce/0x280 <4> [167.136842] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [167.136847] process_one_work+0x22e/0x6b0 <4> [167.136853] worker_thread+0x1e8/0x3d0 <4> [167.136856] ? __pfx_worker_thread+0x10/0x10 <4> [167.136858] kthread+0x11f/0x250 <4> [167.136861] ? __pfx_kthread+0x10/0x10 <4> [167.136864] ret_from_fork+0x344/0x3a0 <4> [167.136866] ? __pfx_kthread+0x10/0x10 <4> [167.136869] ret_from_fork_asm+0x1a/0x30 <4> [167.136876] </TASK> <4> [167.136877] irq event stamp: 516875 <4> [167.136878] hardirqs last enabled at (516881): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [167.136881] hardirqs last disabled at (516886): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [167.136883] softirqs last enabled at (516600): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.136885] softirqs last disabled at (516593): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.136888] ---[ end trace 0000000000000000 ]--- <6> [167.136889] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [167.136956] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [167.136961] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [167.137375] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [167.137474] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [167.137572] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [167.138130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [167.138213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [167.138297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [167.138375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [167.138452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [167.138529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [167.138605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [167.138679] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [167.138775] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [167.138885] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [167.139890] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [167.149715] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [167.149972] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [167.151249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [167.151322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [167.151391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [167.151460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [167.151529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [167.151597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [167.151664] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [167.151747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [167.151813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [167.151878] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [167.151943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [167.152008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [167.152072] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [167.152137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [167.152203] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [167.152270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [167.152334] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [167.152398] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [167.152463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [167.152537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [167.152610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [167.152680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [167.152761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [167.152829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [167.152896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [167.152964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [167.153036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [167.153106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [167.153174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [167.153242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [167.153310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [167.153384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [167.153457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [167.153530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [167.153599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [167.153670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [167.153745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [167.153813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [167.153880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [167.153948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [167.154015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [167.154081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [167.154146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [167.154215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [167.154280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [167.154345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [167.154409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [167.154475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [167.154539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [167.154603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [167.154670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [167.154744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [167.154810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [167.154875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [167.154943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [167.155008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [167.155072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [167.155140] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [167.156258] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [167.157110] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14257, lrc_seqno=14257, guc_id=0, flags=0x73 in no process [-1] <7> [167.157112] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [167.157169] ------------[ cut here ]------------ <4> [167.157170] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [167.157172] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#10: kworker/u64:25/2840 <4> [167.157238] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [167.157295] efi_pstore nfnetlink autofs4 <4> [167.157299] CPU: 10 UID: 0 PID: 2840 Comm: kworker/u64:25 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [167.157301] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [167.157302] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [167.157303] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [167.157308] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [167.157372] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [167.157374] RSP: 0018:ffffc90004eafc98 EFLAGS: 00010246 <4> [167.157376] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [167.157377] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [167.157378] RBP: ffffc90004eafda8 R08: 0000000000000000 R09: 0000000000000000 <4> [167.157379] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [167.157380] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [167.157381] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [167.157383] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [167.157384] CR2: 00007e09ff4cd000 CR3: 0000000120a6c000 CR4: 0000000000f52ef0 <4> [167.157385] PKRU: 55555554 <4> [167.157386] Call Trace: <4> [167.157387] <TASK> <4> [167.157392] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [167.157397] ? lock_release+0xce/0x280 <4> [167.157402] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [167.157407] process_one_work+0x22e/0x6b0 <4> [167.157413] worker_thread+0x1e8/0x3d0 <4> [167.157415] ? __pfx_worker_thread+0x10/0x10 <4> [167.157418] kthread+0x11f/0x250 <4> [167.157421] ? __pfx_kthread+0x10/0x10 <4> [167.157424] ret_from_fork+0x344/0x3a0 <4> [167.157426] ? __pfx_kthread+0x10/0x10 <4> [167.157429] ret_from_fork_asm+0x1a/0x30 <4> [167.157436] </TASK> <4> [167.157437] irq event stamp: 527539 <4> [167.157438] hardirqs last enabled at (527545): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [167.157441] hardirqs last disabled at (527550): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [167.157443] softirqs last enabled at (524110): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.157445] softirqs last disabled at (524101): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.157448] ---[ end trace 0000000000000000 ]--- <7> [167.158951] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [167.159045] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [167.159189] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.159437] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <5> [167.159522] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14305, lrc_seqno=14305, guc_id=0, flags=0x73 in no process [-1] <7> [167.159525] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [167.159580] ------------[ cut here ]------------ <4> [167.159581] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [167.159569] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [167.159583] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#10: kworker/u64:25/2840 <4> [167.159650] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [167.159713] efi_pstore nfnetlink autofs4 <4> [167.159717] CPU: 10 UID: 0 PID: 2840 Comm: kworker/u64:25 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [167.159719] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [167.159720] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <7> [167.159684] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [167.159721] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [167.159726] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [167.159801] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [167.159802] RSP: 0018:ffffc90004eafc98 EFLAGS: 00010246 <4> [167.159804] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [167.159805] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [167.159806] RBP: ffffc90004eafda8 R08: 0000000000000000 R09: 0000000000000000 <4> [167.159808] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [167.159809] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [167.159810] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [167.159811] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [167.159812] CR2: 00007e09ff4cd000 CR3: 0000000120a6c000 CR4: 0000000000f52ef0 <4> [167.159813] PKRU: 55555554 <4> [167.159814] Call Trace: <4> [167.159815] <TASK> <4> [167.159820] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [167.159825] ? lock_release+0xce/0x280 <4> [167.159830] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [167.159835] process_one_work+0x22e/0x6b0 <4> [167.159840] worker_thread+0x1e8/0x3d0 <4> [167.159843] ? __pfx_worker_thread+0x10/0x10 <4> [167.159845] kthread+0x11f/0x250 <7> [167.159817] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [167.159848] ? __pfx_kthread+0x10/0x10 <4> [167.159851] ret_from_fork+0x344/0x3a0 <4> [167.159853] ? __pfx_kthread+0x10/0x10 <4> [167.159855] ret_from_fork_asm+0x1a/0x30 <4> [167.159863] </TASK> <4> [167.159863] irq event stamp: 528763 <4> [167.159864] hardirqs last enabled at (528769): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [167.159866] hardirqs last disabled at (528774): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [167.159868] softirqs last enabled at (528426): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.159871] softirqs last disabled at (528419): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.159873] ---[ end trace 0000000000000000 ]--- <6> [167.159874] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [167.159939] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [167.159945] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [167.159934] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.160048] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [167.160108] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [167.160168] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.160280] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.160478] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [167.160664] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.160672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [167.160774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [167.160844] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.160861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [167.160940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [167.161016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [167.161069] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [167.161090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [167.161165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [167.161246] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.161237] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [167.161326] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [167.161409] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.161435] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [167.161612] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.161872] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.162245] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [167.162445] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [167.162456] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.162619] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.170485] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [167.170606] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [167.170718] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [167.170824] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [167.170929] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [167.171033] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [167.171135] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [167.171239] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [167.171342] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [167.171446] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [167.171550] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [167.171652] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [167.171767] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [167.171916] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [167.172026] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [167.172131] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [167.172234] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [167.172336] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [167.172437] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [167.172539] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [167.172638] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [167.172689] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [167.172772] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [167.172872] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [167.172949] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [167.172973] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [167.173075] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [167.173176] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [167.173300] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [167.173415] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.174281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [167.174355] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [167.174422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [167.174491] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [167.174559] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [167.174627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [167.174701] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [167.174768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [167.174835] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [167.174901] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [167.174967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [167.175033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [167.175099] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [167.175165] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [167.175230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [167.175295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [167.175360] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [167.175426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [167.175494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [167.175569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [167.175641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [167.175720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [167.175790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [167.175857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [167.175924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [167.175993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [167.176065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [167.176135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [167.176205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [167.176273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [167.176341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [167.176415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [167.176488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [167.176561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [167.176632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [167.176708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [167.176778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [167.176843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [167.176908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [167.176975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [167.177042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [167.177108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [167.177173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [167.177241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [167.177307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [167.177372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [167.177436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [167.177503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [167.177569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [167.177632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [167.177708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [167.177774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [167.177839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [167.177903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [167.177969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [167.178033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [167.178097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [167.178165] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [167.179374] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [167.180231] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14305, lrc_seqno=14305, guc_id=0, flags=0x73 in no process [-1] <7> [167.180235] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [167.180292] ------------[ cut here ]------------ <4> [167.180293] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [167.180295] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#2: kworker/u64:6/194 <4> [167.180361] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [167.180423] efi_pstore nfnetlink autofs4 <4> [167.180427] CPU: 2 UID: 0 PID: 194 Comm: kworker/u64:6 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [167.180430] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [167.180431] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [167.180432] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [167.180438] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [167.180503] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [167.180504] RSP: 0018:ffffc900015dbc98 EFLAGS: 00010246 <4> [167.180506] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [167.180508] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [167.180509] RBP: ffffc900015dbda8 R08: 0000000000000000 R09: 0000000000000000 <4> [167.180510] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [167.180511] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [167.180512] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [167.180514] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [167.180515] CR2: 0000785eaa34f000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [167.180516] PKRU: 55555554 <4> [167.180517] Call Trace: <4> [167.180519] <TASK> <4> [167.180524] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [167.180528] ? lock_release+0xce/0x280 <4> [167.180534] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [167.180539] process_one_work+0x22e/0x6b0 <4> [167.180545] worker_thread+0x1e8/0x3d0 <4> [167.180547] ? __pfx_worker_thread+0x10/0x10 <4> [167.180550] kthread+0x11f/0x250 <4> [167.180553] ? __pfx_kthread+0x10/0x10 <4> [167.180556] ret_from_fork+0x344/0x3a0 <4> [167.180558] ? __pfx_kthread+0x10/0x10 <4> [167.180561] ret_from_fork_asm+0x1a/0x30 <4> [167.180569] </TASK> <4> [167.180570] irq event stamp: 654847 <4> [167.180571] hardirqs last enabled at (654853): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [167.180574] hardirqs last disabled at (654858): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [167.180576] softirqs last enabled at (651292): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.180579] softirqs last disabled at (651283): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.180581] ---[ end trace 0000000000000000 ]--- <6> [167.180583] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [167.180649] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [167.180655] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [167.180942] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [167.181036] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [167.181138] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [167.181707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [167.181842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [167.181943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [167.182023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [167.182102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [167.182178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [167.182255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [167.182328] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [167.182414] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [167.182520] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [167.183530] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [167.193664] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [167.193921] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [167.195230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [167.195301] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [167.195371] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [167.195441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [167.195509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [167.195577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [167.195643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [167.195727] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [167.195793] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [167.195859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [167.195924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [167.195989] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [167.196052] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [167.196117] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [167.196180] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [167.196243] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [167.196307] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [167.196371] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [167.196436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [167.196541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [167.196640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [167.196737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [167.196808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [167.196874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [167.196940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [167.197007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [167.197077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [167.197146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [167.197216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [167.197284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [167.197351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [167.197423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [167.197495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [167.197568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [167.197635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [167.197716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [167.197783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [167.197847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [167.197912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [167.197978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [167.198044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [167.198107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [167.198170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [167.198236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [167.198299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [167.198363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [167.198425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [167.198490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [167.198556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [167.198622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [167.198701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [167.198769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [167.198834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [167.198899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [167.198964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [167.199029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [167.199094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [167.199160] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [167.200276] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [167.201130] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14305, lrc_seqno=14305, guc_id=0, flags=0x73 in no process [-1] <7> [167.201133] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [167.201191] ------------[ cut here ]------------ <4> [167.201192] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [167.201193] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#2: kworker/u64:6/194 <4> [167.201260] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [167.201320] efi_pstore nfnetlink autofs4 <4> [167.201324] CPU: 2 UID: 0 PID: 194 Comm: kworker/u64:6 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [167.201327] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [167.201328] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [167.201329] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [167.201334] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [167.201398] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [167.201400] RSP: 0018:ffffc900015dbc98 EFLAGS: 00010246 <4> [167.201402] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [167.201403] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [167.201404] RBP: ffffc900015dbda8 R08: 0000000000000000 R09: 0000000000000000 <4> [167.201405] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [167.201406] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [167.201408] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [167.201409] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [167.201410] CR2: 0000785eaa34f000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [167.201412] PKRU: 55555554 <4> [167.201413] Call Trace: <4> [167.201414] <TASK> <4> [167.201419] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [167.201424] ? lock_release+0xce/0x280 <4> [167.201429] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [167.201434] process_one_work+0x22e/0x6b0 <4> [167.201440] worker_thread+0x1e8/0x3d0 <4> [167.201442] ? __pfx_worker_thread+0x10/0x10 <4> [167.201444] kthread+0x11f/0x250 <4> [167.201447] ? __pfx_kthread+0x10/0x10 <4> [167.201451] ret_from_fork+0x344/0x3a0 <4> [167.201453] ? __pfx_kthread+0x10/0x10 <4> [167.201456] ret_from_fork_asm+0x1a/0x30 <4> [167.201463] </TASK> <4> [167.201464] irq event stamp: 665487 <4> [167.201465] hardirqs last enabled at (665493): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [167.201468] hardirqs last disabled at (665498): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [167.201470] softirqs last enabled at (661940): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.201473] softirqs last disabled at (661935): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.201475] ---[ end trace 0000000000000000 ]--- <7> [167.202991] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [167.203097] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [167.203245] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.203371] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <5> [167.203521] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14353, lrc_seqno=14353, guc_id=0, flags=0x73 in no process [-1] <7> [167.203494] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.203524] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [167.203581] ------------[ cut here ]------------ <4> [167.203582] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [167.203583] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#2: kworker/u64:6/194 <7> [167.203610] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [167.203659] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [167.203718] efi_pstore nfnetlink autofs4 <4> [167.203722] CPU: 2 UID: 0 PID: 194 Comm: kworker/u64:6 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [167.203724] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [167.203725] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [167.203726] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [167.203731] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <7> [167.203738] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [167.203797] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [167.203799] RSP: 0018:ffffc900015dbc98 EFLAGS: 00010246 <4> [167.203800] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [167.203801] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [167.203803] RBP: ffffc900015dbda8 R08: 0000000000000000 R09: 0000000000000000 <4> [167.203804] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [167.203805] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [167.203807] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [167.203808] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [167.203809] CR2: 0000785eaa34f000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [167.203810] PKRU: 55555554 <4> [167.203811] Call Trace: <4> [167.203812] <TASK> <4> [167.203817] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [167.203822] ? lock_release+0xce/0x280 <4> [167.203827] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [167.203832] process_one_work+0x22e/0x6b0 <4> [167.203837] worker_thread+0x1e8/0x3d0 <4> [167.203840] ? __pfx_worker_thread+0x10/0x10 <4> [167.203842] kthread+0x11f/0x250 <4> [167.203845] ? __pfx_kthread+0x10/0x10 <4> [167.203848] ret_from_fork+0x344/0x3a0 <4> [167.203850] ? __pfx_kthread+0x10/0x10 <4> [167.203853] ret_from_fork_asm+0x1a/0x30 <4> [167.203860] </TASK> <4> [167.203861] irq event stamp: 666917 <4> [167.203862] hardirqs last enabled at (666923): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [167.203865] hardirqs last disabled at (666928): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [167.203867] softirqs last enabled at (666174): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.203869] softirqs last disabled at (666169): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.203871] ---[ end trace 0000000000000000 ]--- <7> [167.203851] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <6> [167.203873] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [167.203937] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [167.203945] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [167.203965] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [167.204077] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.204140] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [167.204202] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.204386] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [167.204548] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.204715] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.204895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [167.204941] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [167.204989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [167.205077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [167.205110] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.205156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [167.205236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [167.205274] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.205310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [167.205384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [167.205435] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.205457] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [167.205547] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [167.205594] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.205660] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [167.205901] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [167.206165] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.206388] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.206677] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [167.214116] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [167.214224] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [167.214327] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [167.214431] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [167.214531] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [167.214635] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [167.214738] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [167.214838] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [167.214940] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [167.215040] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [167.215140] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [167.215240] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [167.215344] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [167.215493] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [167.215597] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [167.215729] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [167.215831] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [167.215932] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [167.216032] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [167.216335] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [167.216446] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [167.216567] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [167.216638] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [167.216674] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [167.216784] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [167.216885] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [167.216899] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [167.216989] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [167.217112] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [167.217228] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.218223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [167.218294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [167.218362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [167.218431] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [167.218498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [167.218564] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [167.218640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [167.218709] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [167.218777] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [167.218845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [167.218910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [167.218976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [167.219040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [167.219104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [167.219169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [167.219234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [167.219297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [167.219372] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [167.219438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [167.219512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [167.219585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [167.219667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [167.219737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [167.219804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [167.219871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [167.219940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [167.220010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [167.220078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [167.220145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [167.220212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [167.220279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [167.220351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [167.220423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [167.220495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [167.220566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [167.220643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [167.220712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [167.220778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [167.220844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [167.220913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [167.220980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [167.221047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [167.221110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [167.221178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [167.221244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [167.221313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [167.221379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [167.221447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [167.221512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [167.221578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [167.221657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [167.221723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [167.221789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [167.221853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [167.221919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [167.221982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [167.222046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [167.222112] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [167.223556] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [167.224410] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14353, lrc_seqno=14353, guc_id=0, flags=0x73 in no process [-1] <7> [167.224413] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [167.224502] ------------[ cut here ]------------ <4> [167.224504] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [167.224505] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#0: kworker/u64:20/2835 <4> [167.224579] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [167.224646] efi_pstore nfnetlink autofs4 <4> [167.224651] CPU: 0 UID: 0 PID: 2835 Comm: kworker/u64:20 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [167.224654] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [167.224656] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [167.224657] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [167.224662] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [167.224727] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [167.224729] RSP: 0018:ffffc9000419bc98 EFLAGS: 00010246 <4> [167.224731] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [167.224732] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [167.224734] RBP: ffffc9000419bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [167.224735] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [167.224736] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [167.224737] FS: 0000000000000000(0000) GS:ffff8888dacdd000(0000) knlGS:0000000000000000 <4> [167.224738] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [167.224739] CR2: 00007e09ff4cd000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [167.224741] PKRU: 55555554 <4> [167.224742] Call Trace: <4> [167.224743] <TASK> <4> [167.224748] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [167.224753] ? lock_release+0xce/0x280 <4> [167.224759] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [167.224764] process_one_work+0x22e/0x6b0 <4> [167.224770] worker_thread+0x1e8/0x3d0 <4> [167.224773] ? __pfx_worker_thread+0x10/0x10 <4> [167.224775] kthread+0x11f/0x250 <4> [167.224778] ? __pfx_kthread+0x10/0x10 <4> [167.224781] ret_from_fork+0x344/0x3a0 <4> [167.224784] ? __pfx_kthread+0x10/0x10 <4> [167.224786] ret_from_fork_asm+0x1a/0x30 <4> [167.224794] </TASK> <4> [167.224795] irq event stamp: 242343 <4> [167.224796] hardirqs last enabled at (242349): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [167.224799] hardirqs last disabled at (242354): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [167.224801] softirqs last enabled at (239010): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.224804] softirqs last disabled at (239003): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.224806] ---[ end trace 0000000000000000 ]--- <6> [167.224808] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [167.224874] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <7> [167.224892] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [167.225008] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [167.225103] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [167.225510] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [167.226079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [167.226161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [167.226243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [167.226332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [167.226426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [167.226524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [167.226603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [167.226698] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [167.226787] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [167.226897] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [167.227906] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [167.238618] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [167.238904] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [167.240203] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [167.240276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [167.240344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [167.240412] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [167.240479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [167.240549] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [167.240619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [167.240686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [167.240749] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [167.240814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [167.240877] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [167.240940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [167.241004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [167.241066] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [167.241128] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [167.241197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [167.241279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [167.241375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [167.241451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [167.241530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [167.241609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [167.241681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [167.241752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [167.241820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [167.241887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [167.241956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [167.242030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [167.242101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [167.242170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [167.242238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [167.242307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [167.242382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [167.242457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [167.242533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [167.242610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [167.242680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [167.242749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [167.242815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [167.242879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [167.242947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [167.243021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [167.243087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [167.243152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [167.243222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [167.243287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [167.243352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [167.243416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [167.243483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [167.243548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [167.243617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [167.243688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [167.243754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [167.243819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [167.243883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [167.243948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [167.244012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [167.244076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [167.244145] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [167.245395] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [167.246251] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14353, lrc_seqno=14353, guc_id=0, flags=0x73 in no process [-1] <7> [167.246253] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [167.246341] ------------[ cut here ]------------ <4> [167.246342] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [167.246343] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#0: kworker/u64:20/2835 <4> [167.246416] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [167.246475] efi_pstore nfnetlink autofs4 <4> [167.246479] CPU: 0 UID: 0 PID: 2835 Comm: kworker/u64:20 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [167.246482] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [167.246483] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [167.246484] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [167.246489] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [167.246554] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [167.246555] RSP: 0018:ffffc9000419bc98 EFLAGS: 00010246 <4> [167.246557] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [167.246559] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [167.246560] RBP: ffffc9000419bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [167.246561] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [167.246562] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [167.246563] FS: 0000000000000000(0000) GS:ffff8888dacdd000(0000) knlGS:0000000000000000 <4> [167.246564] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [167.246566] CR2: 00007e09ff4cd000 CR3: 0000000003448000 CR4: 0000000000f52ef0 <4> [167.246567] PKRU: 55555554 <4> [167.246568] Call Trace: <4> [167.246569] <TASK> <4> [167.246574] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [167.246579] ? lock_release+0xce/0x280 <4> [167.246585] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [167.246590] process_one_work+0x22e/0x6b0 <4> [167.246603] worker_thread+0x1e8/0x3d0 <4> [167.246606] ? __pfx_worker_thread+0x10/0x10 <4> [167.246608] kthread+0x11f/0x250 <4> [167.246611] ? __pfx_kthread+0x10/0x10 <4> [167.246615] ret_from_fork+0x344/0x3a0 <4> [167.246617] ? __pfx_kthread+0x10/0x10 <4> [167.246620] ret_from_fork_asm+0x1a/0x30 <4> [167.246628] </TASK> <4> [167.246629] irq event stamp: 253007 <4> [167.246630] hardirqs last enabled at (253013): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [167.246633] hardirqs last disabled at (253018): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [167.246635] softirqs last enabled at (252958): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.246638] softirqs last disabled at (252951): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.246640] ---[ end trace 0000000000000000 ]--- <7> [167.248376] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [167.248505] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [167.248684] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.248936] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [167.249060] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.249177] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <5> [167.249243] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14401, lrc_seqno=14401, guc_id=0, flags=0x73 in no process [-1] <7> [167.249247] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [167.249310] ------------[ cut here ]------------ <4> [167.249312] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [167.249292] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [167.249313] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#2: kworker/u64:20/2835 <4> [167.249384] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad <7> [167.249403] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [167.249436] pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [167.249445] CPU: 2 UID: 0 PID: 2835 Comm: kworker/u64:20 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [167.249447] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [167.249448] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [167.249449] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [167.249454] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [167.249519] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [167.249520] RSP: 0018:ffffc9000419bc98 EFLAGS: 00010246 <4> [167.249522] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [167.249524] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [167.249525] RBP: ffffc9000419bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [167.249526] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [167.249527] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [167.249528] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [167.249529] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [167.249530] CR2: 0000785eaa34f000 CR3: 0000000114fa2000 CR4: 0000000000f52ef0 <4> [167.249532] PKRU: 55555554 <4> [167.249533] Call Trace: <4> [167.249534] <TASK> <4> [167.249539] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [167.249543] ? lock_release+0xce/0x280 <7> [167.249516] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <4> [167.249548] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [167.249553] process_one_work+0x22e/0x6b0 <4> [167.249559] worker_thread+0x1e8/0x3d0 <4> [167.249561] ? __pfx_worker_thread+0x10/0x10 <4> [167.249563] kthread+0x11f/0x250 <4> [167.249566] ? __pfx_kthread+0x10/0x10 <4> [167.249569] ret_from_fork+0x344/0x3a0 <4> [167.249571] ? __pfx_kthread+0x10/0x10 <4> [167.249574] ret_from_fork_asm+0x1a/0x30 <4> [167.249581] </TASK> <4> [167.249582] irq event stamp: 254169 <4> [167.249583] hardirqs last enabled at (254175): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [167.249586] hardirqs last disabled at (254180): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [167.249588] softirqs last enabled at (252958): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.249597] softirqs last disabled at (254191): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.249600] ---[ end trace 0000000000000000 ]--- <6> [167.249601] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [167.249668] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <7> [167.249638] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <6> [167.249674] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [167.249752] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.249836] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [167.249940] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [167.250105] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.250303] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.250399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [167.250485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [167.250529] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [167.250575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [167.250673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [167.250712] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.250752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [167.250828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [167.250873] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.250905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [167.250979] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [167.251057] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.251068] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [167.251175] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [167.251249] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.251615] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [167.251897] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.252113] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.252184] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [167.259749] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [167.259861] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [167.259965] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [167.260068] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [167.260175] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [167.260280] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [167.260383] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [167.260487] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [167.260596] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [167.260699] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [167.260803] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [167.260907] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [167.261009] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [167.261157] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [167.261262] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [167.261366] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [167.261469] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [167.261571] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [167.261863] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [167.261988] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [167.262091] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [167.262193] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [167.262294] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [167.262395] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [167.262495] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [167.262591] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [167.262599] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [167.262725] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [167.262836] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.262851] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [167.264173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [167.264246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [167.264314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [167.264384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [167.264453] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [167.264521] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [167.264594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [167.264663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [167.264729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [167.264794] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [167.264862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [167.264927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [167.264994] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [167.265061] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [167.265128] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [167.265193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [167.265259] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [167.265323] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [167.265389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [167.265463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [167.265536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [167.265617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [167.265688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [167.265757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [167.265824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [167.265892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [167.265965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [167.266035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [167.266103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [167.266171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [167.266240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [167.266313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [167.266386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [167.266459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [167.266531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [167.266607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [167.266676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [167.266742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [167.266808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [167.266876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [167.266945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [167.267011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [167.267076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [167.267145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [167.267212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [167.267277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [167.267342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [167.267409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [167.267472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [167.267536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [167.267614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [167.267681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [167.267746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [167.267810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [167.267877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [167.267940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [167.268004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [167.268073] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [167.269388] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [167.270247] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14401, lrc_seqno=14401, guc_id=0, flags=0x73 in no process [-1] <7> [167.270250] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [167.270307] ------------[ cut here ]------------ <4> [167.270308] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [167.270309] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#10: kworker/u64:12/984 <4> [167.270381] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [167.270441] efi_pstore nfnetlink autofs4 <4> [167.270445] CPU: 10 UID: 0 PID: 984 Comm: kworker/u64:12 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [167.270448] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [167.270449] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [167.270450] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [167.270455] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [167.270519] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [167.270521] RSP: 0018:ffffc9000355fc98 EFLAGS: 00010246 <4> [167.270523] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [167.270524] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [167.270525] RBP: ffffc9000355fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [167.270526] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [167.270527] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [167.270529] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [167.270530] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [167.270531] CR2: 00007e09ff4cc000 CR3: 00000001f019c000 CR4: 0000000000f52ef0 <4> [167.270533] PKRU: 55555554 <4> [167.270534] Call Trace: <4> [167.270535] <TASK> <4> [167.270540] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [167.270545] ? lock_release+0xce/0x280 <4> [167.270550] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [167.270555] process_one_work+0x22e/0x6b0 <4> [167.270561] worker_thread+0x1e8/0x3d0 <4> [167.270563] ? __pfx_worker_thread+0x10/0x10 <4> [167.270566] kthread+0x11f/0x250 <4> [167.270574] ? __pfx_kthread+0x10/0x10 <4> [167.270577] ret_from_fork+0x344/0x3a0 <4> [167.270580] ? __pfx_kthread+0x10/0x10 <4> [167.270583] ret_from_fork_asm+0x1a/0x30 <4> [167.270590] </TASK> <4> [167.270591] irq event stamp: 120035 <4> [167.270593] hardirqs last enabled at (120041): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [167.270595] hardirqs last disabled at (120046): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [167.270597] softirqs last enabled at (120000): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.270600] softirqs last disabled at (119995): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.270602] ---[ end trace 0000000000000000 ]--- <6> [167.270603] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [167.270668] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <7> [167.270684] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [167.270780] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [167.270871] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [167.271281] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [167.271847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [167.271928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [167.272012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [167.272091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [167.272168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [167.272246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [167.272322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [167.272393] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [167.272484] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [167.272601] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [167.273628] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [167.283561] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [167.283820] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [167.285135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [167.285206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [167.285274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [167.285342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [167.285409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [167.285479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [167.285545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [167.285627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [167.285694] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [167.285759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [167.285824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [167.285889] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [167.285953] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [167.286018] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [167.286082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [167.286146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [167.286210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [167.286274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [167.286340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [167.286412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [167.286484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [167.286562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [167.286645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [167.286718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [167.286785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [167.286855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [167.286929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [167.287000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [167.287070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [167.287138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [167.287207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [167.287281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [167.287355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [167.287429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [167.287500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [167.287573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [167.287639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [167.287704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [167.287772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [167.287845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [167.287916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [167.287985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [167.288051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [167.288121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [167.288187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [167.288254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [167.288319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [167.288387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [167.288452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [167.288517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [167.288593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [167.288658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [167.288725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [167.288791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [167.288858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [167.288923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [167.288987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [167.289056] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [167.290325] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [167.291183] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14401, lrc_seqno=14401, guc_id=0, flags=0x73 in no process [-1] <7> [167.291186] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [167.291243] ------------[ cut here ]------------ <4> [167.291244] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [167.291245] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#10: kworker/u64:12/984 <4> [167.291311] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [167.291370] efi_pstore nfnetlink autofs4 <4> [167.291374] CPU: 10 UID: 0 PID: 984 Comm: kworker/u64:12 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [167.291376] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [167.291377] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [167.291379] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [167.291383] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [167.291447] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [167.291449] RSP: 0018:ffffc9000355fc98 EFLAGS: 00010246 <4> [167.291451] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [167.291452] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [167.291453] RBP: ffffc9000355fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [167.291454] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [167.291455] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [167.291456] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [167.291458] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [167.291459] CR2: 00007e09ff4cc000 CR3: 00000001f019c000 CR4: 0000000000f52ef0 <4> [167.291460] PKRU: 55555554 <4> [167.291462] Call Trace: <4> [167.291462] <TASK> <4> [167.291468] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [167.291472] ? lock_release+0xce/0x280 <4> [167.291478] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [167.291483] process_one_work+0x22e/0x6b0 <4> [167.291488] worker_thread+0x1e8/0x3d0 <4> [167.291491] ? __pfx_worker_thread+0x10/0x10 <4> [167.291493] kthread+0x11f/0x250 <4> [167.291496] ? __pfx_kthread+0x10/0x10 <4> [167.291500] ret_from_fork+0x344/0x3a0 <4> [167.291502] ? __pfx_kthread+0x10/0x10 <4> [167.291505] ret_from_fork_asm+0x1a/0x30 <4> [167.291512] </TASK> <4> [167.291513] irq event stamp: 130697 <4> [167.291514] hardirqs last enabled at (130703): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [167.291516] hardirqs last disabled at (130708): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [167.291518] softirqs last enabled at (127372): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.291521] softirqs last disabled at (127365): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.291523] ---[ end trace 0000000000000000 ]--- <7> [167.294104] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [167.294218] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [167.294548] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <5> [167.294722] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=14457, lrc_seqno=14457, guc_id=0, flags=0x73 in no process [-1] <7> [167.294725] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [167.294785] ------------[ cut here ]------------ <4> [167.294786] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [167.294761] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <4> [167.294787] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13f7/0x23e0 [xe], CPU#10: kworker/u64:12/984 <4> [167.294856] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [167.294915] efi_pstore nfnetlink autofs4 <4> [167.294919] CPU: 10 UID: 0 PID: 984 Comm: kworker/u64:12 Tainted: G S U W 6.19.0-rc6-lgci-xe-xe-4428-dc0b90be8d513256a+ #1 PREEMPT(voluntary) <4> [167.294922] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [167.294923] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [167.294925] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [167.294929] RIP: 0010:guc_exec_queue_timedout_job+0x1400/0x23e0 [xe] <4> [167.294995] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49 <4> [167.294997] RSP: 0018:ffffc9000355fc98 EFLAGS: 00010246 <4> [167.294999] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [167.295000] RDX: ffff888104048490 RSI: ffffffffa11f716d RDI: ffffffffa1003db0 <4> [167.295001] RBP: ffffc9000355fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [167.295002] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [167.295003] R13: ffff888104048490 R14: ffff88816669b818 R15: 00000000ffffffc2 <4> [167.295004] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [167.295006] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [167.295007] CR2: 00007e09ff4cc000 CR3: 0000000120a6c000 CR4: 0000000000f52ef0 <4> [167.295008] PKRU: 55555554 <4> [167.295009] Call Trace: <4> [167.295010] <TASK> <4> [167.295015] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [167.295020] ? lock_release+0xce/0x280 <4> [167.295025] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <7> [167.294977] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <4> [167.295030] process_one_work+0x22e/0x6b0 <4> [167.295036] worker_thread+0x1e8/0x3d0 <4> [167.295038] ? __pfx_worker_thread+0x10/0x10 <4> [167.295040] kthread+0x11f/0x250 <4> [167.295043] ? __pfx_kthread+0x10/0x10 <4> [167.295046] ret_from_fork+0x344/0x3a0 <4> [167.295048] ? __pfx_kthread+0x10/0x10 <4> [167.295051] ret_from_fork_asm+0x1a/0x30 <4> [167.295058] </TASK> <4> [167.295059] irq event stamp: 132357 <4> [167.295059] hardirqs last enabled at (132363): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [167.295062] hardirqs last disabled at (132368): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [167.295064] softirqs last enabled at (130746): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.295066] softirqs last disabled at (130741): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [167.295068] ---[ end trace 0000000000000000 ]--- <6> [167.295069] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [167.295136] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [167.295143] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [167.295179] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.295346] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [167.295383] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.295611] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.295812] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [167.295977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [167.296010] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.296064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [167.296150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [167.296230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [167.296222] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.296307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [167.296382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [167.296459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [167.296532] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [167.296544] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [167.296658] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [167.296774] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [167.296834] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.297222] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 4096 & 4096 <7> [167.297772] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [167.297793] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [167.298061] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.298357] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.298660] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.298941] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.299298] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 1048576 & 1048576 <7> [167.299592] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.299873] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 65536 & 65536 <7> [167.307542] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [167.307858] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [167.308719] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [167.308941] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [167.309132] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [167.309306] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [167.309331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [167.309434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [167.309489] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [167.309532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [167.309626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [167.309682] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [167.309717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [167.309805] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [167.309853] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [167.309893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [167.309984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [167.310025] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [167.310074] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [167.310164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [167.310204] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [167.310250] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [167.310339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [167.310375] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [167.310425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [167.310521] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [167.310544] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [167.310647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [167.310724] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [167.310734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [167.310824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [167.310886] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [167.310915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [167.311010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [167.311105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [167.311164] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 8388608 & 8388608 <7> [167.311200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [167.311294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [167.311334] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 1, sizes: 8388608 & 8388608 <7> [167.311386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [167.311474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [167.311502] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 2, sizes: 8388608 & 8388608 <7> [167.311589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [167.311692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [167.311703] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 3, sizes: 8388608 & 8388608 <7> [167.311792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [167.311885] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 4, sizes: 8388608 & 8388608 <7> [167.311892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [167.311983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [167.312054] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 5, sizes: 8388608 & 8388608 <7> [167.312075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [167.312169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [167.312214] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 6, sizes: 8388608 & 8388608 <7> [167.312270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [167.312367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [167.312380] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 7, sizes: 8388608 & 8388608 <7> [167.312465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [167.312562] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 8, sizes: 8388608 & 8388608 <7> [167.312575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [167.312669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [167.312732] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 9, sizes: 8388608 & 8388608 <7> [167.312760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [167.312852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [167.312901] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 10, sizes: 8388608 & 8388608 <7> [167.312941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [167.313033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [167.313138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [167.313243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [167.313318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [167.313394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [167.313466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [167.313558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [167.313602] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 11, sizes: 8388608 & 8388608 <7> [167.313657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [167.313755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [167.313772] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 12, sizes: 4194304 & 4194304 <7> [167.313848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [167.313938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [167.313997] xe 0000:03:00.0: [drm:xe_migrate_copy [xe]] Pass 0, sizes: 32768 & 32768 <7> [167.314031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs

<4> [163.276252] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [163.276488] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [163.303519] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [163.303664] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [163.325883] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [163.326028] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.012845] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.012982] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.015485] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei

<4> [166.015624] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.036036] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.036177] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.056806] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.056941] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.059567] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad

<4> [166.059782] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.084990] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.085129] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.105755] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.105892] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.108575] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux

<4> [166.108662] nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [166.108867] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.137391] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.137535] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.159393] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.159520] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.162516] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel

<4> [166.162588] mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [166.162731] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.184581] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.184740] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.206151] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.206286] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.209349] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801

<4> [166.209415] snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [166.209575] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.233802] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.233946] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.254665] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.254816] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.258680] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.258844] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.279993] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.280214] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.301374] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.301565] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.304454] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate

<4> [166.304513] snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [166.304671] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.325503] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.325648] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.347230] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.347373] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.350481] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.350618] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.371296] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.371434] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.393839] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.394055] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.397091] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.397228] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.418538] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.418686] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.439800] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.439959] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.442071] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.442226] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.463798] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.463934] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.485412] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.485566] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.488205] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.488343] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.509393] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.509537] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.530093] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.530230] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.532454] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.532695] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.553438] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.553576] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.574033] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.574169] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.576756] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor

<4> [166.576781] mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [166.576894] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.597277] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.597433] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.617964] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.618186] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.620463] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd

<4> [166.620507] idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [166.620599] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.641132] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.641269] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.661847] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.662053] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.664645] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.664857] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.685995] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.686132] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.706910] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.707047] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.709175] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.709327] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.730212] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.730350] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.753953] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.754080] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.756382] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.756514] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.777349] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.777492] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.799060] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.799208] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.801680] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.801817] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.822881] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.823053] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.843722] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.843858] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.846439] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.846571] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.867889] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.868027] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.888686] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.888821] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.891033] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci

<4> [166.891078] snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [166.891169] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.911976] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.912123] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.933481] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.933666] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.935915] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.936056] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.956832] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.956988] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.977659] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [166.977798] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [166.980047] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass

<4> [166.980080] snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [166.980188] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [167.000867] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [167.001010] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [167.021434] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [167.021568] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [167.023643] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek

<4> [167.023685] snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [167.023778] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [167.044488] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [167.044648] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [167.065495] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [167.065632] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [167.068105] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [167.068239] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [167.088524] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [167.088661] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [167.109337] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [167.109475] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [167.111725] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [167.111864] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [167.136669] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [167.136811] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [167.157238] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [167.157372] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [167.159650] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [167.159801] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [167.180361] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [167.180503] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [167.201260] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [167.201398] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [167.203659] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [167.203797] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [167.224579] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [167.224727] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [167.246416] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [167.246554] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [167.249384] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad

<4> [167.249519] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [167.270381] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [167.270519] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [167.291311] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [167.291447] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

<4> [167.294856] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp asus_nb_wmi cmdlinepart hid_generic asus_wmi spi_nor mei_pxp sparse_keymap mei_hdcp mtd platform_profile kvm_intel wmi_bmof binfmt_misc kvm snd_hda_intel irqbypass snd_intel_dspcfg ghash_clmulni_intel snd_hda_codec aesni_intel snd_hda_core r8169 usbhid video snd_hwdep rapl hid intel_cstate snd_pcm i2c_i801 realtek snd_timer i2c_mux nls_iso8859_1 spi_intel_pci snd idma64 i2c_smbus soundcore spi_intel mei_me intel_pmc_core mei pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake wmi intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [167.294995] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 43 1a 5a e1 48 89 c6 48 8d 3d 39 bf 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 f2 ee ff ff 8b 70 08 49

Results for igt@xe_compute_preempt@compute-preempt-many-vram-evict@engine-drm_xe_engine_class_compute