Result: 192 Warning(s)
i915_display_info22 igt_runner22 results22.json results22-xe-load.json guc_logs22.tar i915_display_info_post_exec22 boot22 dmesg22
| Detail | Value |
|---|---|
| Duration | unknown |
| Hostname |
shard-bmg-7 |
| Igt-Version |
IGT-Version: 2.4-gac27f1506 (x86_64) (Linux: 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ x86_64) |
| Out |
Using IGT_SRANDOM=1776163094 for randomisation Opened device: /dev/dri/card0 Starting subtest: compute-preempt-many-vram Starting dynamic subtest: engine-DRM_XE_ENGINE_CLASS_COMPUTE Stack trace: Stack trace: Stack trace: #0 ../lib/igt_core.c:2075 __igt_fail_assert() #0 ../lib/igt_core.c:2075 __igt_fail_assert() #0 ../lib/igt_core.c:2075 __igt_fail_assert() #1 [xe_wait_ufence+0x57] #1 [xe_wait_ufence+0x57] #1 [xe_wait_ufence+0x57] #2 ../lib/intel_compute.c:487 bo_execenv_sync() #3 ../lib/intel_compute.c:2626 xe2lpg_compute_preempt_exec() #4 ../lib/intel_compute.c:2955 run_intel_compute_kernel_preempt() #2 ../lib/intel_compute.c:487 bo_execenv_sync() #2 ../lib/intel_compute.c:487 bo_execenv_sync() #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #6 ../tests/intel/xe_compute_preempt.c:162 __igt_unique____real_main65() #3 ../lib/intel_compute.c:2626 xe2lpg_compute_preempt_exec() #3 ../lib/intel_compute.c:2626 xe2lpg_compute_preempt_exec() #7 ../tests/intel/xe_compute_preempt.c:65 main() #4 ../lib/intel_compute.c:2955 run_intel_compute_kernel_preempt() #4 ../lib/intel_compute.c:2955 run_intel_compute_kernel_preempt() #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #6 ../tests/intel/xe_compute_preempt.c:162 __igt_unique____real_main65() #6 ../tests/intel/xe_compute_preempt.c:162 __igt_unique____real_main65() #7 ../tests/intel/xe_compute_preempt.c:65 main() #7 ../tests/intel/xe_compute_preempt.c:65 main() #8 [__libc_init_first+0x8a] #8 [__libc_init_first+0x8a] #8 [__libc_init_first+0x8a] #9 [__libc_start_main+0x8b] #10 [_start+0x25] #9 [__libc_start_main+0x8b] #9 [__libc_start_main+0x8b] #10 [_start+0x25] #10 [_start+0x25] Dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE: FAIL (1.300s) Subtest compute-preempt-many-vram: FAIL (1.301s) This test caused an abort condition: Kernel badly tainted (0x244, 0x200) (check dmesg for details): TAINT_WARN: WARN_ON has happened. |
| Err |
Starting subtest: compute-preempt-many-vram Starting dynamic subtest: engine-DRM_XE_ENGINE_CLASS_COMPUTE (xe_compute_preempt:5069) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:763: (xe_compute_preempt:5069) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:5074) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:763: (xe_compute_preempt:5069) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:5074) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:5069) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:5074) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:5074) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:5066) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:763: (xe_compute_preempt:5066) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:5066) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:5066) xe/xe_ioctl-CRITICAL: error: -5 != 0 Dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE failed. **** DEBUG **** (xe_compute_preempt:5065) DEBUG: VRAM: 12216, child count: 30 (xe_compute_preempt:5074) intel_compute-DEBUG: [i: 0 name: instr state base] data: 0x7a1125e12000, handle: 15, addr: 83e0000, size: 1000 (xe_compute_preempt:5074) intel_compute-DEBUG: [i: 1 name: dynamic state base] data: 0x7a11239fc000, handle: 18, addr: 300000, size: 100000 (xe_compute_preempt:5074) intel_compute-DEBUG: [i: 2 name: surface state base] data: 0x7a11239ec000, handle: 22, addr: 200000, size: 10000 (xe_compute_preempt:5074) intel_compute-DEBUG: [i: 3 name: indirect object base] data: 0x7a11239dc000, handle: 25, addr: 63d0000, size: 10000 (xe_compute_preempt:5074) intel_compute-DEBUG: [i: 4 name: addr input] data: 0x7a11239cc000, handle: 27, addr: 40000000, size: 10000 (xe_compute_preempt:5074) intel_compute-DEBUG: [i: 5 name: addr output] data: 0x7a11239bc000, handle: 29, addr: 80000000, size: 10000 (xe_compute_preempt:5074) intel_compute-DEBUG: [i: 6 name: general state base] data: 0x7a11238bc000, handle: 30, addr: 6000000, size: 100000 (xe_compute_preempt:5074) intel_compute-DEBUG: [i: 7 name: binding table] data: 0x7a11238ac000, handle: 31, addr: 210000, size: 10000 (xe_compute_preempt:5074) intel_compute-DEBUG: [i: 8 name: batch] data: 0x7a112389c000, handle: 32, addr: 100000, size: 10000 (xe_compute_preempt:5074) intel_compute-DEBUG: [i: 9 name: state context data base] data: 0x7a111d49c000, handle: 33, addr: 9000000, size: 6400000 (xe_compute_preempt:5074) intel_compute-DEBUG: [i: 10 name: sip kernel] data: 0x7a111d494000, handle: 132, addr: 107ff0000, size: 8000 (xe_compute_preempt:5074) intel_compute-DEBUG: [i: 0 name: instr state base] data: 0x7a1124d14000, handle: 134, addr: 83e0000, size: 1000 (xe_compute_preempt:5074) intel_compute-DEBUG: [i: 1 name: dynamic state base] data: 0x7a111d394000, handle: 136, addr: 300000, size: 100000 (xe_compute_preempt:5074) intel_compute-DEBUG: [i: 2 name: surface state base] data: 0x7a111d384000, handle: 140, addr: 200000, size: 10000 (xe_compute_preempt:5074) intel_compute-DEBUG: [i: 3 name: indirect object base] data: 0x7a111d374000, handle: 143, addr: 63d0000, size: 10000 (xe_compute_preempt:5074) intel_compute-DEBUG: [i: 4 name: addr input] data: 0x7a111d364000, handle: 145, addr: 40000000, size: 10000 (xe_compute_preempt:5074) intel_compute-DEBUG: [i: 5 name: addr output] data: 0x7a111d354000, handle: 148, addr: 80000000, size: 10000 (xe_compute_preempt:5074) intel_compute-DEBUG: [i: 6 name: general state base] data: 0x7a111d254000, handle: 150, addr: 6000000, size: 100000 (xe_compute_preempt:5074) intel_compute-DEBUG: [i: 7 name: binding table] data: 0x7a111d244000, handle: 153, addr: 210000, size: 10000 (xe_compute_preempt:5074) intel_compute-DEBUG: [i: 8 name: batch] data: 0x7a111d234000, handle: 155, addr: 100000, size: 10000 (xe_compute_preempt:5074) intel_compute-DEBUG: [i: 9 name: state context data base] data: 0x7a1116e34000, handle: 159, addr: 9000000, size: 6400000 (xe_compute_preempt:5074) intel_compute-DEBUG: [i: 10 name: sip kernel] data: 0x7a1116e2c000, handle: 298, addr: 107ff0000, size: 8000 (xe_compute_preempt:5074) intel_compute-DEBUG: general state base: 6000000 (xe_compute_preempt:5074) intel_compute-DEBUG: surface state base: 200000 (xe_compute_preempt:5074) intel_compute-DEBUG: dynamic state base: 300000 (xe_compute_preempt:5074) intel_compute-DEBUG: instruct base addr: 8000000 (xe_compute_preempt:5074) intel_compute-DEBUG: bindless base addr: 200000 (xe_compute_preempt:5074) intel_compute-DEBUG: state context data base addr: 9000000 (xe_compute_preempt:5074) intel_compute-DEBUG: offset indirect addr: 3d0000 (xe_compute_preempt:5074) intel_compute-DEBUG: kernel start pointer: 3e0000 (xe_compute_preempt:5074) intel_compute-DEBUG: sip start pointer: ffff0000 (xe_compute_preempt:5074) intel_compute-DEBUG: general state base: 6000000 (xe_compute_preempt:5074) intel_compute-DEBUG: surface state base: 200000 (xe_compute_preempt:5074) intel_compute-DEBUG: dynamic state base: 300000 (xe_compute_preempt:5074) intel_compute-DEBUG: instruct base addr: 8000000 (xe_compute_preempt:5074) intel_compute-DEBUG: bindless base addr: 200000 (xe_compute_preempt:5074) intel_compute-DEBUG: state context data base addr: 9000000 (xe_compute_preempt:5074) intel_compute-DEBUG: offset indirect addr: 3d0000 (xe_compute_preempt:5074) intel_compute-DEBUG: kernel start pointer: 3e0000 (xe_compute_preempt:5074) intel_compute-DEBUG: sip start pointer: ffff0000 (xe_compute_preempt:5074) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:763: (xe_compute_preempt:5074) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:5074) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:5074) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:5074) igt_core-INFO: Stack trace: (xe_compute_preempt:5074) igt_core-INFO: #0 ../lib/igt_core.c:2075 __igt_fail_assert() (xe_compute_preempt:5074) igt_core-INFO: #1 [xe_wait_ufence+0x57] (xe_compute_preempt:5074) igt_core-INFO: #2 ../lib/intel_compute.c:487 bo_execenv_sync() (xe_compute_preempt:5074) igt_core-INFO: #3 ../lib/intel_compute.c:2626 xe2lpg_compute_preempt_exec() (xe_compute_preempt:5074) igt_core-INFO: #4 ../lib/intel_compute.c:2955 run_intel_compute_kernel_preempt() (xe_compute_preempt:5074) igt_core-INFO: #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() (xe_compute_preempt:5074) igt_core-INFO: #6 ../tests/intel/xe_compute_preempt.c:162 __igt_unique____real_main65() (xe_compute_preempt:5074) igt_core-INFO: #7 ../tests/intel/xe_compute_preempt.c:65 main() (xe_compute_preempt:5074) igt_core-INFO: #8 [__libc_init_first+0x8a] (xe_compute_preempt:5074) igt_core-INFO: #9 [__libc_start_main+0x8b] (xe_compute_preempt:5074) igt_core-INFO: #10 [_start+0x25] **** END **** Dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE failed. **** DEBUG **** (xe_compute_preempt:5065) DEBUG: VRAM: 12216, child count: 30 (xe_compute_preempt:5066) intel_compute-DEBUG: [i: 0 name: instr state base] data: 0x7a1125e12000, handle: 2, addr: 83e0000, size: 1000 (xe_compute_preempt:5066) intel_compute-DEBUG: [i: 1 name: dynamic state base] data: 0x7a11239fc000, handle: 3, addr: 300000, size: 100000 (xe_compute_preempt:5066) intel_compute-DEBUG: [i: 2 name: surface state base] data: 0x7a11239ec000, handle: 4, addr: 200000, size: 10000 (xe_compute_preempt:5066) intel_compute-DEBUG: [i: 3 name: indirect object base] data: 0x7a11239dc000, handle: 6, addr: 63d0000, size: 10000 (xe_compute_preempt:5066) intel_compute-DEBUG: [i: 4 name: addr input] data: 0x7a11239cc000, handle: 8, addr: 40000000, size: 10000 (xe_compute_preempt:5066) intel_compute-DEBUG: [i: 5 name: addr output] data: 0x7a11239bc000, handle: 10, addr: 80000000, size: 10000 (xe_compute_preempt:5066) intel_compute-DEBUG: [i: 6 name: general state base] data: 0x7a11238bc000, handle: 11, addr: 6000000, size: 100000 (xe_compute_preempt:5066) intel_compute-DEBUG: [i: 7 name: binding table] data: 0x7a11238ac000, handle: 14, addr: 210000, size: 10000 Dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE failed. (xe_compute_preempt:5066) intel_compute-DEBUG: [i: 8 name: batch] data: 0x7a112389c000, handle: 19, addr: 100000, size: 10000 (xe_compute_preempt:5066) intel_compute-DEBUG: [i: 9 name: state context data base] data: 0x7a111d49c000, handle: 23, addr: 9000000, size: 6400000 **** DEBUG **** (xe_compute_preempt:5066) intel_compute-DEBUG: [i: 10 name: sip kernel] data: 0x7a111d494000, handle: 123, addr: 107ff0000, size: 8000 (xe_compute_preempt:5065) DEBUG: VRAM: 12216, child count: 30 (xe_compute_preempt:5066) intel_compute-DEBUG: [i: 0 name: instr state base] data: 0x7a1124d14000, handle: 128, addr: 83e0000, size: 1000 (xe_compute_preempt:5069) intel_compute-DEBUG: [i: 0 name: instr state base] data: 0x7a1125e12000, handle: 7, addr: 83e0000, size: 1000 (xe_compute_preempt:5069) intel_compute-DEBUG: [i: 1 name: dynamic state base] data: 0x7a11239fc000, handle: 9, addr: 300000, size: 100000 (xe_compute_preempt:5066) intel_compute-DEBUG: [i: 1 name: dynamic state base] data: 0x7a111d394000, handle: 131, addr: 300000, size: 100000 (xe_compute_preempt:5066) intel_compute-DEBUG: [i: 2 name: surface state base] data: 0x7a111d384000, handle: 135, addr: 200000, size: 10000 (xe_compute_preempt:5069) intel_compute-DEBUG: [i: 2 name: surface state base] data: 0x7a11239ec000, handle: 12, addr: 200000, size: 10000 (xe_compute_preempt:5066) intel_compute-DEBUG: [i: 3 name: indirect object base] data: 0x7a111d374000, handle: 138, addr: 63d0000, size: 10000 (xe_compute_preempt:5069) intel_compute-DEBUG: [i: 3 name: indirect object base] data: 0x7a11239dc000, handle: 16, addr: 63d0000, size: 10000 (xe_compute_preempt:5069) intel_compute-DEBUG: [i: 4 name: addr input] data: 0x7a11239cc000, handle: 17, addr: 40000000, size: 10000 (xe_compute_preempt:5066) intel_compute-DEBUG: [i: 4 name: addr input] data: 0x7a111d364000, handle: 141, addr: 40000000, size: 10000 (xe_compute_preempt:5069) intel_compute-DEBUG: [i: 5 name: addr output] data: 0x7a11239bc000, handle: 20, addr: 80000000, size: 10000 (xe_compute_preempt:5066) intel_compute-DEBUG: [i: 5 name: addr output] data: 0x7a111d354000, handle: 144, addr: 80000000, size: 10000 (xe_compute_preempt:5069) intel_compute-DEBUG: [i: 6 name: general state base] data: 0x7a11238bc000, handle: 21, addr: 6000000, size: 100000 (xe_compute_preempt:5066) intel_compute-DEBUG: [i: 6 name: general state base] data: 0x7a111d254000, handle: 147, addr: 6000000, size: 100000 (xe_compute_preempt:5069) intel_compute-DEBUG: [i: 7 name: binding table] data: 0x7a11238ac000, handle: 24, addr: 210000, size: 10000 (xe_compute_preempt:5066) intel_compute-DEBUG: [i: 7 name: binding table] data: 0x7a111d244000, handle: 152, addr: 210000, size: 10000 (xe_compute_preempt:5069) intel_compute-DEBUG: [i: 8 name: batch] data: 0x7a112389c000, handle: 26, addr: 100000, size: 10000 (xe_compute_preempt:5066) intel_compute-DEBUG: [i: 8 name: batch] data: 0x7a111d234000, handle: 154, addr: 100000, size: 10000 (xe_compute_preempt:5069) intel_compute-DEBUG: [i: 9 name: state context data base] data: 0x7a111d49c000, handle: 28, addr: 9000000, size: 6400000 (xe_compute_preempt:5066) intel_compute-DEBUG: [i: 9 name: state context data base] data: 0x7a1116e34000, handle: 158, addr: 9000000, size: 6400000 (xe_compute_preempt:5069) intel_compute-DEBUG: [i: 10 name: sip kernel] data: 0x7a111d494000, handle: 114, addr: 107ff0000, size: 8000 (xe_compute_preempt:5066) intel_compute-DEBUG: [i: 10 name: sip kernel] data: 0x7a1116e2c000, handle: 297, addr: 107ff0000, size: 8000 (xe_compute_preempt:5069) intel_compute-DEBUG: [i: 0 name: instr state base] data: 0x7a1124d14000, handle: 118, addr: 83e0000, size: 1000 (xe_compute_preempt:5066) intel_compute-DEBUG: general state base: 6000000 (xe_compute_preempt:5069) intel_compute-DEBUG: [i: 1 name: dynamic state base] data: 0x7a111d394000, handle: 120, addr: 300000, size: 100000 (xe_compute_preempt:5066) intel_compute-DEBUG: surface state base: 200000 (xe_compute_preempt:5069) intel_compute-DEBUG: [i: 2 name: surface state base] data: 0x7a111d384000, handle: 122, addr: 200000, size: 10000 (xe_compute_preempt:5069) intel_compute-DEBUG: [i: 3 name: indirect object base] data: 0x7a111d374000, handle: 125, addr: 63d0000, size: 10000 (xe_compute_preempt:5066) intel_compute-DEBUG: dynamic state base: 300000 (xe_compute_preempt:5069) intel_compute-DEBUG: [i: 4 name: addr input] data: 0x7a111d364000, handle: 127, addr: 40000000, size: 10000 (xe_compute_preempt:5066) intel_compute-DEBUG: instruct base addr: 8000000 (xe_compute_preempt:5069) intel_compute-DEBUG: [i: 5 name: addr output] data: 0x7a111d354000, handle: 130, addr: 80000000, size: 10000 (xe_compute_preempt:5066) intel_compute-DEBUG: bindless base addr: 200000 (xe_compute_preempt:5069) intel_compute-DEBUG: [i: 6 name: general state base] data: 0x7a111d254000, handle: 133, addr: 6000000, size: 100000 (xe_compute_preempt:5066) intel_compute-DEBUG: state context data base addr: 9000000 (xe_compute_preempt:5069) intel_compute-DEBUG: [i: 7 name: binding table] data: 0x7a111d244000, handle: 137, addr: 210000, size: 10000 (xe_compute_preempt:5066) intel_compute-DEBUG: offset indirect addr: 3d0000 (xe_compute_preempt:5069) intel_compute-DEBUG: [i: 8 name: batch] data: 0x7a111d234000, handle: 139, addr: 100000, size: 10000 (xe_compute_preempt:5066) intel_compute-DEBUG: kernel start pointer: 3e0000 (xe_compute_preempt:5069) intel_compute-DEBUG: [i: 9 name: state context data base] data: 0x7a1116e34000, handle: 142, addr: 9000000, size: 6400000 (xe_compute_preempt:5066) intel_compute-DEBUG: sip start pointer: ffff0000 (xe_compute_preempt:5069) intel_compute-DEBUG: [i: 10 name: sip kernel] data: 0x7a1116e2c000, handle: 281, addr: 107ff0000, size: 8000 (xe_compute_preempt:5069) intel_compute-DEBUG: general state base: 6000000 (xe_compute_preempt:5066) intel_compute-DEBUG: general state base: 6000000 (xe_compute_preempt:5069) intel_compute-DEBUG: surface state base: 200000 (xe_compute_preempt:5066) intel_compute-DEBUG: surface state base: 200000 (xe_compute_preempt:5069) intel_compute-DEBUG: dynamic state base: 300000 (xe_compute_preempt:5066) intel_compute-DEBUG: dynamic state base: 300000 (xe_compute_preempt:5069) intel_compute-DEBUG: instruct base addr: 8000000 (xe_compute_preempt:5066) intel_compute-DEBUG: instruct base addr: 8000000 (xe_compute_preempt:5069) intel_compute-DEBUG: bindless base addr: 200000 (xe_compute_preempt:5066) intel_compute-DEBUG: bindless base addr: 200000 (xe_compute_preempt:5069) intel_compute-DEBUG: state context data base addr: 9000000 (xe_compute_preempt:5066) intel_compute-DEBUG: state context data base addr: 9000000 (xe_compute_preempt:5069) intel_compute-DEBUG: offset indirect addr: 3d0000 (xe_compute_preempt:5069) intel_compute-DEBUG: kernel start pointer: 3e0000 (xe_compute_preempt:5066) intel_compute-DEBUG: offset indirect addr: 3d0000 (xe_compute_preempt:5069) intel_compute-DEBUG: sip start pointer: ffff0000 (xe_compute_preempt:5066) intel_compute-DEBUG: kernel start pointer: 3e0000 (xe_compute_preempt:5069) intel_compute-DEBUG: general state base: 6000000 (xe_compute_preempt:5066) intel_compute-DEBUG: sip start pointer: ffff0000 (xe_compute_preempt:5069) intel_compute-DEBUG: surface state base: 200000 (xe_compute_preempt:5066) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:763: (xe_compute_preempt:5069) intel_compute-DEBUG: dynamic state base: 300000 (xe_compute_preempt:5066) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:5069) intel_compute-DEBUG: instruct base addr: 8000000 (xe_compute_preempt:5066) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:5069) intel_compute-DEBUG: bindless base addr: 200000 (xe_compute_preempt:5066) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:5069) intel_compute-DEBUG: state context data base addr: 9000000 (xe_compute_preempt:5066) igt_core-INFO: Stack trace: (xe_compute_preempt:5069) intel_compute-DEBUG: offset indirect addr: 3d0000 (xe_compute_preempt:5066) igt_core-INFO: #0 ../lib/igt_core.c:2075 __igt_fail_assert() (xe_compute_preempt:5069) intel_compute-DEBUG: kernel start pointer: 3e0000 (xe_compute_preempt:5066) igt_core-INFO: #1 [xe_wait_ufence+0x57] (xe_compute_preempt:5069) intel_compute-DEBUG: sip start pointer: ffff0000 (xe_compute_preempt:5066) igt_core-INFO: #2 ../lib/intel_compute.c:487 bo_execenv_sync() (xe_compute_preempt:5069) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:763: (xe_compute_preempt:5066) igt_core-INFO: #3 ../lib/intel_compute.c:2626 xe2lpg_compute_preempt_exec() (xe_compute_preempt:5069) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:5066) igt_core-INFO: #4 ../lib/intel_compute.c:2955 run_intel_compute_kernel_preempt() (xe_compute_preempt:5069) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:5069) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:5066) igt_core-INFO: #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() (xe_compute_preempt:5069) igt_core-INFO: Stack trace: (xe_compute_preempt:5066) igt_core-INFO: #6 ../tests/intel/xe_compute_preempt.c:162 __igt_unique____real_main65() (xe_compute_preempt:5069) igt_core-INFO: #0 ../lib/igt_core.c:2075 __igt_fail_assert() (xe_compute_preempt:5066) igt_core-INFO: #7 ../tests/intel/xe_compute_preempt.c:65 main() (xe_compute_preempt:5069) igt_core-INFO: #1 [xe_wait_ufence+0x57] (xe_compute_preempt:5066) igt_core-INFO: #8 [__libc_init_first+0x8a] (xe_compute_preempt:5069) igt_core-INFO: #2 ../lib/intel_compute.c:487 bo_execenv_sync() (xe_compute_preempt:5066) igt_core-INFO: #9 [__libc_start_main+0x8b] (xe_compute_preempt:5069) igt_core-INFO: #3 ../lib/intel_compute.c:2626 xe2lpg_compute_preempt_exec() (xe_compute_preempt:5066) igt_core-INFO: #10 [_start+0x25] (xe_compute_preempt:5069) igt_core-INFO: #4 ../lib/intel_compute.c:2955 run_intel_compute_kernel_preempt() **** END **** (xe_compute_preempt:5069) igt_core-INFO: #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() (xe_compute_preempt:5069) igt_core-INFO: #6 ../tests/intel/xe_compute_preempt.c:162 __igt_unique____real_main65() (xe_compute_preempt:5069) igt_core-INFO: #7 ../tests/intel/xe_compute_preempt.c:65 main() (xe_compute_preempt:5069) igt_core-INFO: #8 [__libc_init_first+0x8a] (xe_compute_preempt:5069) igt_core-INFO: #9 [__libc_start_main+0x8b] (xe_compute_preempt:5069) igt_core-INFO: #10 [_start+0x25] **** END **** Dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE failed. **** DEBUG **** (xe_compute_preempt:5065) DEBUG: VRAM: 12216, child count: 30 **** END **** Dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE: FAIL (1.300s) Subtest compute-preempt-many-vram: FAIL (1.301s) |
| Dmesg |
<6> [171.455887] Console: switching to colour dummy device 80x25
<6> [171.456216] [IGT] xe_compute_preempt: executing
<7> [171.535936] xe 0000:03:00.0: [drm:drm_pagemap_shrinker_scan [drm_gpusvm_helper]] Shrinking dpagemap ffff88817ccd0ed0.
<6> [171.555166] [IGT] xe_compute_preempt: starting subtest compute-preempt-many-vram
<6> [171.555916] [IGT] xe_compute_preempt: starting dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE
<6> [171.927223] xe 0000:03:00.0: [drm] Tile0: GT0:
ASID: 0
Faulted Address: 0x0000000001790000
FaultType: 0
AccessType: 1
FaultLevel: 0
EngineClass: 3 bcs
EngineInstance: 8
<6> [171.927248] xe 0000:03:00.0: [drm] Tile0: GT0: Fault response: Unsuccessful -EINVAL
<6> [171.927736] xe 0000:03:00.0: [drm] Tile0: GT0: Engine memory CAT error [18]: class=bcs, logical_mask: 0x2, guc_id=0
<7> [171.931659] xe 0000:03:00.0: [drm:xe_hw_engine_snapshot_capture [xe]] Tile0: GT0: Proceeding with manual engine snapshot
<6> [171.933540] xe 0000:03:00.0: [drm] Tile0: GT0: Engine reset: engine_class=bcs, logical_mask: 0x2, guc_id=0, state=0x249
<5> [171.933579] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1738, lrc_seqno=1738, guc_id=0, flags=0x73 in no process [-1]
<6> [172.128350] xe 0000:03:00.0: [drm] Xe device coredump has been created
<6> [172.128375] xe 0000:03:00.0: [drm] Check your /sys/class/drm/card0/device/devcoredump/data
<4> [172.128378] ------------[ cut here ]------------
<4> [172.128380] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.128381] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:4/204
<4> [172.128476] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.128576] autofs4 [last unloaded: xe]
<4> [172.128580] CPU: 3 UID: 0 PID: 204 Comm: kworker/u64:4 Tainted: G S U 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.128583] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER
<4> [172.128584] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.128586] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.128591] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.128656] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.128657] RSP: 0018:ffffc90001627ca0 EFLAGS: 00010246
<4> [172.128660] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.128661] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.128662] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.128663] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.128664] R13: ffff8881116e8590 R14: ffff8881257ba000 R15: 00000000fffffffb
<4> [172.128665] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000
<4> [172.128667] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.128668] CR2: 00007a111da8c000 CR3: 000000015a2ce001 CR4: 0000000000f72ef0
<4> [172.128670] PKRU: 55555554
<4> [172.128671] Call Trace:
<4> [172.128672] <TASK>
<4> [172.128676] ? lock_sync+0x100/0x100
<4> [172.128681] ? __pfx_autoremove_wake_function+0x10/0x10
<4> [172.128686] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.128691] process_one_work+0x239/0x760
<4> [172.128697] worker_thread+0x200/0x3f0
<4> [172.128700] ? __pfx_worker_thread+0x10/0x10
<4> [172.128702] kthread+0x10d/0x150
<4> [172.128705] ? __pfx_kthread+0x10/0x10
<4> [172.128708] ret_from_fork+0x3d4/0x480
<4> [172.128711] ? __pfx_kthread+0x10/0x10
<4> [172.128714] ret_from_fork_asm+0x1a/0x30
<4> [172.128721] </TASK>
<4> [172.128722] irq event stamp: 666743
<4> [172.128723] hardirqs last enabled at (666749): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.128726] hardirqs last disabled at (666754): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.128728] softirqs last enabled at (665856): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.128731] softirqs last disabled at (665851): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.128733] ---[ end trace 0000000000000000 ]---
<6> [172.128735] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.128800] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.129152] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.129341] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.130275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.130374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.130464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.130546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.130625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.130705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.130783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.130863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.130938] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.131026] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.131135] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.132261] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.143034] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.143345] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.145070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.145165] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.145270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.145356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.145440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.145524] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.145608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.145690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.145772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.145855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.145937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.146016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.146096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.146174] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.146270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.146349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.146429] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.146508] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.146587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.146674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.146763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.146849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.146935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.147018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.147099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.147182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.147264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.147351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.147438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.147523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.147608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.147691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.147782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.147876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.147967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.148054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.148139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.148229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.148311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.148391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.148476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.148560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.148642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.148723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.148812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.148897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.148982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.149064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.149148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.149237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.149319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.149402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.149484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.149566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.149651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.149737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.149821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.149903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.149989] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.151020] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.151026] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1738, lrc_seqno=1738, guc_id=0, flags=0x73 in no process [-1]
<7> [172.151029] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.151097] ------------[ cut here ]------------
<4> [172.151099] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.151100] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:4/204
<4> [172.151194] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.151262] autofs4 [last unloaded: xe]
<4> [172.151266] CPU: 8 UID: 0 PID: 204 Comm: kworker/u64:4 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.151270] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.151271] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.151273] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.151279] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.151357] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.151359] RSP: 0018:ffffc90001627ca0 EFLAGS: 00010246
<4> [172.151361] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.151363] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.151364] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.151365] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.151366] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.151368] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [172.151369] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.151371] CR2: 0000638b5c263f28 CR3: 000000013e9d2003 CR4: 0000000000f72ef0
<4> [172.151372] PKRU: 55555554
<4> [172.151373] Call Trace:
<4> [172.151375] <TASK>
<4> [172.151379] ? lock_sync+0x100/0x100
<4> [172.151384] ? lock_release+0xd0/0x2b0
<4> [172.151390] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.151395] process_one_work+0x239/0x760
<4> [172.151403] worker_thread+0x200/0x3f0
<4> [172.151406] ? __pfx_worker_thread+0x10/0x10
<4> [172.151408] kthread+0x10d/0x150
<4> [172.151412] ? __pfx_kthread+0x10/0x10
<4> [172.151415] ret_from_fork+0x3d4/0x480
<4> [172.151418] ? __pfx_kthread+0x10/0x10
<4> [172.151421] ret_from_fork_asm+0x1a/0x30
<4> [172.151429] </TASK>
<4> [172.151431] irq event stamp: 672503
<4> [172.151432] hardirqs last enabled at (672509): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.151436] hardirqs last disabled at (672514): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.151438] softirqs last enabled at (671760): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.151441] softirqs last disabled at (671729): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.151443] ---[ end trace 0000000000000000 ]---
<6> [172.153154] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.153241] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<5> [172.153250] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=5, flags=0x0 in xe_compute_pree [5065]
<7> [172.153255] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<7> [172.153533] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<5> [172.153948] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=10, flags=0x0 in xe_compute_pree [5065]
<7> [172.153945] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [172.153955] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<5> [172.154067] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=12, flags=0x0 in xe_compute_pree [5065]
<7> [172.154071] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<5> [172.154497] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=16, flags=0x0 in xe_compute_pree [5065]
<7> [172.154500] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<5> [172.154572] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=20, flags=0x0 in xe_compute_pree [5065]
<7> [172.154753] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<5> [172.154822] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=24, flags=0x0 in xe_compute_pree [5065]
<7> [172.154827] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<5> [172.154929] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=28, flags=0x0 in xe_compute_pree [5065]
<7> [172.154933] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<5> [172.155035] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=32, flags=0x0 in xe_compute_pree [5065]
<7> [172.155039] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<5> [172.155137] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=40, flags=0x0 in xe_compute_pree [5065]
<7> [172.155140] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<6> [172.155269] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.155343] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.155895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.156024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.156160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.156321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.156447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.156570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.156696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.156821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.156945] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.157080] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.157243] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.158382] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.168239] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.168507] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.169549] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.169668] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.169782] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.169895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.170010] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.170123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.170254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.170366] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.170480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.170593] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.170705] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.170816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.170927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.171039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.171151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.171290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.171400] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.171512] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.171604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.171687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.171771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.171852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.171934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.172012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.172089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.172166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.172257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.172337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.172417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.172494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.172574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.172656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.172743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.172828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.172913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.172997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.173080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.173159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.173254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.173332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.173412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.173489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.173567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.173647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.173730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.173809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.173887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.173964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.174042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.174118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.174200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.174286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.174367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.174446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.174524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.174603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.174679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.174756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.174835] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.175437] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.175443] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1738, lrc_seqno=1738, guc_id=0, flags=0x73 in no process [-1]
<7> [172.175445] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.175506] ------------[ cut here ]------------
<4> [172.175508] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.175509] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#1: kworker/u64:15/4395
<4> [172.175582] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.175652] autofs4 [last unloaded: xe]
<4> [172.175656] CPU: 1 UID: 0 PID: 4395 Comm: kworker/u64:15 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.175659] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.175661] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.175662] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.175668] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.175738] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.175739] RSP: 0018:ffffc90002cabca0 EFLAGS: 00010246
<4> [172.175742] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.175743] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.175745] RBP: ffffc90002cabdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.175746] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.175747] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.175748] FS: 0000000000000000(0000) GS:ffff8888dad17000(0000) knlGS:0000000000000000
<4> [172.175750] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.175751] CR2: 00007a112388c000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [172.175753] PKRU: 55555554
<4> [172.175754] Call Trace:
<4> [172.175755] <TASK>
<4> [172.175759] ? lock_sync+0x100/0x100
<4> [172.175765] ? lock_release+0xd0/0x2b0
<4> [172.175770] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.175776] process_one_work+0x239/0x760
<4> [172.175783] worker_thread+0x200/0x3f0
<4> [172.175786] ? __pfx_worker_thread+0x10/0x10
<4> [172.175788] kthread+0x10d/0x150
<4> [172.175791] ? __pfx_kthread+0x10/0x10
<4> [172.175795] ret_from_fork+0x3d4/0x480
<4> [172.175797] ? __pfx_kthread+0x10/0x10
<4> [172.175801] ret_from_fork_asm+0x1a/0x30
<4> [172.175808] </TASK>
<4> [172.175809] irq event stamp: 10025
<4> [172.175811] hardirqs last enabled at (10031): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.175814] hardirqs last disabled at (10036): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.175816] softirqs last enabled at (8176): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.175819] softirqs last disabled at (8169): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.175821] ---[ end trace 0000000000000000 ]---
<7> [172.177520] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<5> [172.177615] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1762, lrc_seqno=1762, guc_id=0, flags=0x73 in no process [-1]
<7> [172.177620] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.177687] ------------[ cut here ]------------
<4> [172.177689] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.177691] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:12/2686
<7> [172.177676] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<4> [172.177766] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.177838] autofs4 [last unloaded: xe]
<4> [172.177842] CPU: 8 UID: 0 PID: 2686 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.177845] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.177847] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.177848] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.177854] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.177925] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.177927] RSP: 0000:ffffc90007947ca0 EFLAGS: 00010246
<4> [172.177929] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.177931] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.177932] RBP: ffffc90007947db0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.177933] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.177934] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.177936] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [172.177937] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.177939] CR2: 00007a1123afc000 CR3: 0000000177766005 CR4: 0000000000f72ef0
<4> [172.177940] PKRU: 55555554
<4> [172.177941] Call Trace:
<4> [172.177942] <TASK>
<4> [172.177946] ? lock_sync+0x100/0x100
<4> [172.177952] ? lock_release+0xd0/0x2b0
<4> [172.177957] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.177963] process_one_work+0x239/0x760
<4> [172.177970] worker_thread+0x200/0x3f0
<4> [172.177972] ? __pfx_worker_thread+0x10/0x10
<4> [172.177975] kthread+0x10d/0x150
<4> [172.177978] ? __pfx_kthread+0x10/0x10
<4> [172.177982] ret_from_fork+0x3d4/0x480
<4> [172.177984] ? __pfx_kthread+0x10/0x10
<4> [172.177988] ret_from_fork_asm+0x1a/0x30
<4> [172.177995] </TASK>
<4> [172.177996] irq event stamp: 364009
<4> [172.177998] hardirqs last enabled at (364015): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.178001] hardirqs last disabled at (364020): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.178003] softirqs last enabled at (362412): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.178006] softirqs last disabled at (362407): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.178008] ---[ end trace 0000000000000000 ]---
<6> [172.178010] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.178080] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.178088] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.178141] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.178546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.178640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.178738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.178830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.178918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.179004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.179091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.179188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.179271] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.179366] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.179486] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.180567] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.191187] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.191458] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.192554] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.192634] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.192711] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.192790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.192868] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.192951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.193030] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.193110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.193197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.193273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.193350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.193427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.193506] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.193583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.193667] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.193743] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.193818] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.193896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.193976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.194058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.194139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.194232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.194316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.194397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.194475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.194551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.194627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.194705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.194793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.194872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.194951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.195031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.195119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.195213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.195297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.195378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.195458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.195536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.195617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.195698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.195780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.195859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.195937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.196015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.196096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.196181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.196264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.196343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.196422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.196498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.196575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.196654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.196731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.196808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.196884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.196965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.197045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.197123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.197211] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.197847] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.197855] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1762, lrc_seqno=1762, guc_id=0, flags=0x73 in no process [-1]
<7> [172.197859] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.197921] ------------[ cut here ]------------
<4> [172.197922] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.197923] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:13/4148
<4> [172.197995] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.198068] autofs4 [last unloaded: xe]
<4> [172.198073] CPU: 2 UID: 0 PID: 4148 Comm: kworker/u64:13 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.198077] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.198078] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.198080] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.198086] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.198156] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.198158] RSP: 0000:ffffc90002a0bca0 EFLAGS: 00010246
<4> [172.198161] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.198163] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.198164] RBP: ffffc90002a0bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.198166] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.198167] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.198169] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [172.198171] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.198173] CR2: 00007a1118f24000 CR3: 000000012105e005 CR4: 0000000000f72ef0
<4> [172.198174] PKRU: 55555554
<4> [172.198181] Call Trace:
<4> [172.198183] <TASK>
<4> [172.198188] ? lock_sync+0x100/0x100
<4> [172.198194] ? lock_release+0xd0/0x2b0
<4> [172.198201] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.198206] process_one_work+0x239/0x760
<4> [172.198214] worker_thread+0x200/0x3f0
<4> [172.198217] ? __pfx_worker_thread+0x10/0x10
<4> [172.198219] kthread+0x10d/0x150
<4> [172.198223] ? __pfx_kthread+0x10/0x10
<4> [172.198227] ret_from_fork+0x3d4/0x480
<4> [172.198230] ? __pfx_kthread+0x10/0x10
<4> [172.198234] ret_from_fork_asm+0x1a/0x30
<4> [172.198242] </TASK>
<4> [172.198243] irq event stamp: 257727
<4> [172.198245] hardirqs last enabled at (257733): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.198249] hardirqs last disabled at (257738): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.198251] softirqs last enabled at (255750): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.198254] softirqs last disabled at (255743): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.198257] ---[ end trace 0000000000000000 ]---
<6> [172.198259] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.198330] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.198337] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.198387] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.198872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.198966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.199062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.199169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.199354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.199445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.199535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.199626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.199710] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.199805] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.199929] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.201012] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.211744] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.211992] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.213412] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.213487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.213558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.213629] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.213699] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.213769] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.213839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.213908] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.213978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.214049] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.214118] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.214199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.214282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.214357] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.214431] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.214505] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.214579] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.214652] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.214726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.214808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.214891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.214971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.215055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.215135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.215227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.215306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.215383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.215463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.215543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.215622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.215700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.215781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.215869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.215955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.216040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.216121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.216210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.216287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.216365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.216441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.216524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.216605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.216685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.216762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.216843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.216920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.216998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.217075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.217153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.217239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.217315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.217394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.217471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.217548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.217624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.217701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.217777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.217853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.217932] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.218522] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.218527] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1762, lrc_seqno=1762, guc_id=0, flags=0x73 in no process [-1]
<7> [172.218529] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.218590] ------------[ cut here ]------------
<4> [172.218591] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.218593] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:13/4148
<4> [172.218666] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.218740] autofs4 [last unloaded: xe]
<4> [172.218745] CPU: 2 UID: 0 PID: 4148 Comm: kworker/u64:13 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.218748] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.218749] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.218751] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.218757] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.218827] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.218829] RSP: 0018:ffffc90002a0bca0 EFLAGS: 00010246
<4> [172.218832] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.218833] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.218835] RBP: ffffc90002a0bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.218837] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.218838] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.218840] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [172.218842] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.218844] CR2: 00007a1118f24000 CR3: 000000013e9d2006 CR4: 0000000000f72ef0
<4> [172.218846] PKRU: 55555554
<4> [172.218847] Call Trace:
<4> [172.218849] <TASK>
<4> [172.218853] ? lock_sync+0x100/0x100
<4> [172.218858] ? lock_release+0xd0/0x2b0
<4> [172.218864] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.218870] process_one_work+0x239/0x760
<4> [172.218877] worker_thread+0x200/0x3f0
<4> [172.218880] ? __pfx_worker_thread+0x10/0x10
<4> [172.218882] kthread+0x10d/0x150
<4> [172.218886] ? __pfx_kthread+0x10/0x10
<4> [172.218890] ret_from_fork+0x3d4/0x480
<4> [172.218893] ? __pfx_kthread+0x10/0x10
<4> [172.218896] ret_from_fork_asm+0x1a/0x30
<4> [172.218904] </TASK>
<4> [172.218906] irq event stamp: 264009
<4> [172.218907] hardirqs last enabled at (264015): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.218910] hardirqs last disabled at (264020): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.218913] softirqs last enabled at (261966): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.218916] softirqs last disabled at (261959): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.218918] ---[ end trace 0000000000000000 ]---
<7> [172.220443] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [172.220596] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [172.221066] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1783, lrc_seqno=1783, guc_id=0, flags=0x73 in no process [-1]
<7> [172.221070] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.221133] ------------[ cut here ]------------
<4> [172.221134] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.221136] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:13/4148
<4> [172.221226] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.221293] autofs4 [last unloaded: xe]
<4> [172.221297] CPU: 3 UID: 0 PID: 4148 Comm: kworker/u64:13 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.221300] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.221301] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.221303] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.221308] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.221381] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.221383] RSP: 0018:ffffc90002a0bca0 EFLAGS: 00010246
<4> [172.221385] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.221387] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.221388] RBP: ffffc90002a0bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.221389] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.221390] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.221392] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000
<4> [172.221393] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.221395] CR2: 00007a1123afc000 CR3: 000000015979a005 CR4: 0000000000f72ef0
<4> [172.221396] PKRU: 55555554
<4> [172.221398] Call Trace:
<4> [172.221399] <TASK>
<4> [172.221403] ? lock_sync+0x100/0x100
<4> [172.221408] ? lock_release+0xd0/0x2b0
<4> [172.221413] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.221419] process_one_work+0x239/0x760
<4> [172.221425] worker_thread+0x200/0x3f0
<4> [172.221428] ? __pfx_worker_thread+0x10/0x10
<4> [172.221431] kthread+0x10d/0x150
<4> [172.221434] ? __pfx_kthread+0x10/0x10
<4> [172.221437] ret_from_fork+0x3d4/0x480
<4> [172.221440] ? __pfx_kthread+0x10/0x10
<4> [172.221443] ret_from_fork_asm+0x1a/0x30
<4> [172.221450] </TASK>
<4> [172.221452] irq event stamp: 265639
<4> [172.221453] hardirqs last enabled at (265645): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.221456] hardirqs last disabled at (265650): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.221458] softirqs last enabled at (264896): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.221460] softirqs last disabled at (264891): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.221463] ---[ end trace 0000000000000000 ]---
<6> [172.221465] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.221537] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.221544] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.221557] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.221918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.222011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.222105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.222202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.222290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.222374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.222463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.222555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.222639] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.222734] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.222851] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.223861] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.234185] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.234437] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.235479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.235559] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.235635] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.235712] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.235789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.235865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.235941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.236016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.236091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.236167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.236271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.236348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.236424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.236498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.236572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.236645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.236719] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.236793] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.236867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.236947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.237028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.237107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.237197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.237278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.237359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.237437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.237514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.237594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.237675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.237753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.237832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.237916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.238004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.238089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.238174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.238271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.238351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.238428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.238507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.238588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.238670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.238749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.238827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.238904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.238985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.239066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.239143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.239229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.239308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.239384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.239460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.239539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.239616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.239693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.239769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.239851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.239931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.240009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.240090] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.240885] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.240890] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1783, lrc_seqno=1783, guc_id=0, flags=0x73 in no process [-1]
<7> [172.240892] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.240957] ------------[ cut here ]------------
<4> [172.240958] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.240960] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:13/4148
<4> [172.241035] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.241101] autofs4 [last unloaded: xe]
<4> [172.241105] CPU: 3 UID: 0 PID: 4148 Comm: kworker/u64:13 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.241108] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.241110] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.241111] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.241116] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.241194] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.241196] RSP: 0018:ffffc90002a0bca0 EFLAGS: 00010246
<4> [172.241199] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.241201] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.241202] RBP: ffffc90002a0bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.241203] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.241204] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.241206] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000
<4> [172.241208] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.241209] CR2: 00007a1123afc000 CR3: 000000015979a005 CR4: 0000000000f72ef0
<4> [172.241211] PKRU: 55555554
<4> [172.241212] Call Trace:
<4> [172.241213] <TASK>
<4> [172.241217] ? lock_sync+0x100/0x100
<4> [172.241222] ? lock_release+0xd0/0x2b0
<4> [172.241227] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.241233] process_one_work+0x239/0x760
<4> [172.241240] worker_thread+0x200/0x3f0
<4> [172.241242] ? __pfx_worker_thread+0x10/0x10
<4> [172.241245] kthread+0x10d/0x150
<4> [172.241248] ? __pfx_kthread+0x10/0x10
<4> [172.241252] ret_from_fork+0x3d4/0x480
<4> [172.241254] ? __pfx_kthread+0x10/0x10
<4> [172.241257] ret_from_fork_asm+0x1a/0x30
<4> [172.241267] </TASK>
<4> [172.241269] irq event stamp: 271921
<4> [172.241271] hardirqs last enabled at (271927): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.241274] hardirqs last disabled at (271932): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.241276] softirqs last enabled at (270166): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.241279] softirqs last disabled at (270157): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.241281] ---[ end trace 0000000000000000 ]---
<6> [172.242141] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<7> [172.242241] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [172.242348] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<6> [172.242449] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<5> [172.242461] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=44, flags=0x0 in xe_compute_pree [5065]
<7> [172.242468] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<5> [172.242593] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=56, flags=0x0 in xe_compute_pree [5065]
<7> [172.242597] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<6> [172.242708] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.242725] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.243209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.243346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.243485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.243619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.243751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.243882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.244015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.244150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.244295] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.244403] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.244526] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.245538] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.256194] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.256448] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.257451] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.257536] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.257616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.257695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.257773] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.257848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.257924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.258000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.258076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.258151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.258236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.258311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.258387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.258462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.258537] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.258611] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.258689] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.258767] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.258844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.258927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.259008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.259088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.259169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.259260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.259343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.259423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.259502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.259583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.259663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.259743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.259823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.259903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.259988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.260072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.260157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.260251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.260334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.260413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.260492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.260569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.260652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.260734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.260815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.260894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.260975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.261052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.261130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.261215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.261293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.261369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.261449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.261533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.261615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.261697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.261774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.261854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.261932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.262009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.262090] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.262667] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.262671] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1783, lrc_seqno=1783, guc_id=0, flags=0x73 in no process [-1]
<7> [172.262674] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.262733] ------------[ cut here ]------------
<4> [172.262734] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.262736] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:0/12
<4> [172.262808] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.262876] autofs4 [last unloaded: xe]
<4> [172.262880] CPU: 8 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.262883] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.262884] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.262886] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.262891] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.262962] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.262963] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [172.262966] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.262968] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.262969] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.262970] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.262971] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.262973] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [172.262974] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.262976] CR2: 00007a1123afc000 CR3: 000000015a2ce001 CR4: 0000000000f72ef0
<4> [172.262977] PKRU: 55555554
<4> [172.262978] Call Trace:
<4> [172.262979] <TASK>
<4> [172.262983] ? lock_sync+0x100/0x100
<4> [172.262988] ? lock_release+0xd0/0x2b0
<4> [172.262994] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.262999] process_one_work+0x239/0x760
<4> [172.263006] worker_thread+0x200/0x3f0
<4> [172.263009] ? __pfx_worker_thread+0x10/0x10
<4> [172.263011] kthread+0x10d/0x150
<4> [172.263015] ? __pfx_kthread+0x10/0x10
<4> [172.263018] ret_from_fork+0x3d4/0x480
<4> [172.263020] ? __pfx_kthread+0x10/0x10
<4> [172.263024] ret_from_fork_asm+0x1a/0x30
<4> [172.263031] </TASK>
<4> [172.263032] irq event stamp: 413977
<4> [172.263033] hardirqs last enabled at (413983): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.263036] hardirqs last disabled at (413988): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.263039] softirqs last enabled at (412106): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.263041] softirqs last disabled at (412101): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.263043] ---[ end trace 0000000000000000 ]---
<5> [172.263126] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=36, flags=0x0 in xe_compute_pree [5065]
<7> [172.263129] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<5> [172.263227] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=48, flags=0x0 in xe_compute_pree [5065]
<7> [172.263234] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<7> [172.264251] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<5> [172.264339] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1798, lrc_seqno=1798, guc_id=0, flags=0x73 in no process [-1]
<7> [172.264345] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.264457] ------------[ cut here ]------------
<4> [172.264459] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<7> [172.264399] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<4> [172.264462] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#14: kworker/u64:2/119
<4> [172.264584] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.264681] autofs4 [last unloaded: xe]
<4> [172.264686] CPU: 14 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.264691] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.264692] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.264695] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.264703] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.264817] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.264820] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246
<4> [172.264823] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.264825] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.264827] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.264829] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.264831] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.264833] FS: 0000000000000000(0000) GS:ffff8888db397000(0000) knlGS:0000000000000000
<4> [172.264835] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.264837] CR2: 00007a1123afc000 CR3: 00000001d73ac002 CR4: 0000000000f72ef0
<4> [172.264839] PKRU: 55555554
<4> [172.264841] Call Trace:
<4> [172.264843] <TASK>
<4> [172.264849] ? lock_sync+0x100/0x100
<4> [172.264856] ? lock_release+0xd0/0x2b0
<4> [172.264865] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.264874] process_one_work+0x239/0x760
<4> [172.264885] worker_thread+0x200/0x3f0
<4> [172.264889] ? __pfx_worker_thread+0x10/0x10
<4> [172.264892] kthread+0x10d/0x150
<4> [172.264896] ? __pfx_kthread+0x10/0x10
<4> [172.264901] ret_from_fork+0x3d4/0x480
<4> [172.264905] ? __pfx_kthread+0x10/0x10
<4> [172.264910] ret_from_fork_asm+0x1a/0x30
<4> [172.264922] </TASK>
<4> [172.264923] irq event stamp: 195167
<4> [172.264925] hardirqs last enabled at (195173): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.264929] hardirqs last disabled at (195178): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.264932] softirqs last enabled at (194124): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.264936] softirqs last disabled at (194117): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.264939] ---[ end trace 0000000000000000 ]---
<6> [172.264941] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.265056] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.265065] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.265082] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.265570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.265707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.265845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.265979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.266112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.266250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.266384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.266519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.266650] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.266792] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.266958] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.268367] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.278192] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.278505] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.279655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.279788] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.279911] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.280034] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.280157] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.280297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.280382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.280462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.280539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.280615] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.280692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.280766] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.280842] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.280919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.280997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.281073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.281148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.281254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.281332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.281418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.281500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.281579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.281659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.281737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.281814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.281892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.281969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.282053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.282137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.282229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.282309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.282389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.282475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.282560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.282644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.282728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.282812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.282892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.282971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.283050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.283132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.283222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.283304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.283384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.283466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.283544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.283622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.283698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.283776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.283852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.283928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.284007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.284084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.284162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.284257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.284341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.284422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.284501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.284582] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.285334] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.285339] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1798, lrc_seqno=1798, guc_id=0, flags=0x73 in no process [-1]
<7> [172.285342] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.285404] ------------[ cut here ]------------
<4> [172.285405] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.285406] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:2/119
<4> [172.285481] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.285549] autofs4 [last unloaded: xe]
<4> [172.285553] CPU: 8 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.285556] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.285558] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.285560] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.285565] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.285636] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.285638] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246
<4> [172.285640] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.285642] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.285643] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.285645] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.285646] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.285648] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [172.285649] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.285651] CR2: 00007a1123afc000 CR3: 00000001eb6dd005 CR4: 0000000000f72ef0
<4> [172.285653] PKRU: 55555554
<4> [172.285654] Call Trace:
<4> [172.285655] <TASK>
<4> [172.285660] ? lock_sync+0x100/0x100
<4> [172.285665] ? lock_release+0xd0/0x2b0
<4> [172.285670] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.285676] process_one_work+0x239/0x760
<4> [172.285683] worker_thread+0x200/0x3f0
<4> [172.285686] ? __pfx_worker_thread+0x10/0x10
<4> [172.285689] kthread+0x10d/0x150
<4> [172.285691] ? __pfx_kthread+0x10/0x10
<4> [172.285695] ret_from_fork+0x3d4/0x480
<4> [172.285698] ? __pfx_kthread+0x10/0x10
<4> [172.285701] ret_from_fork_asm+0x1a/0x30
<4> [172.285709] </TASK>
<4> [172.285710] irq event stamp: 201479
<4> [172.285711] hardirqs last enabled at (201485): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.285714] hardirqs last disabled at (201490): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.285717] softirqs last enabled at (200682): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.285719] softirqs last disabled at (200675): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.285722] ---[ end trace 0000000000000000 ]---
<6> [172.285724] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.285793] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<5> [172.285800] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=52, flags=0x0 in xe_compute_pree [5065]
<7> [172.285803] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<5> [172.285870] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=68, flags=0x0 in xe_compute_pree [5065]
<7> [172.285872] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<5> [172.285936] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=84, flags=0x0 in xe_compute_pree [5065]
<7> [172.285938] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<6> [172.286000] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.287261] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [172.287384] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [172.287629] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.287988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.288083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.288181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.288274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.288363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.288452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.288541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.288629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.288712] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.288807] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.288925] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.289937] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.300545] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.300869] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.302050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.302140] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.302241] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.302323] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.302404] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.302482] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.302559] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.302635] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.302710] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.302784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.302858] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.302932] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.303007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.303082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.303156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.303243] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.303322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.303400] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.303475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.303558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.303641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.303720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.303800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.303878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.303956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.304034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.304111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.304198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.304282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.304365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.304446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.304526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.304611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.304696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.304779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.304862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.304946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.305027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.305107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.305188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.305268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.305347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.305423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.305500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.305580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.305657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.305735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.305811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.305888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.305965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.306046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.306128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.306218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.306296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.306374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.306452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.306528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.306605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.306684] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.307338] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.307344] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1798, lrc_seqno=1798, guc_id=0, flags=0x73 in no process [-1]
<7> [172.307347] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.307410] ------------[ cut here ]------------
<4> [172.307411] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.307413] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:12/2686
<4> [172.307485] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.307557] autofs4 [last unloaded: xe]
<4> [172.307561] CPU: 2 UID: 0 PID: 2686 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.307564] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.307566] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.307567] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.307573] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.307644] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.307646] RSP: 0018:ffffc90007947ca0 EFLAGS: 00010246
<4> [172.307648] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.307650] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.307651] RBP: ffffc90007947db0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.307652] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.307654] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.307655] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [172.307657] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.307658] CR2: 00007a1124d14000 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [172.307660] PKRU: 55555554
<4> [172.307661] Call Trace:
<4> [172.307662] <TASK>
<4> [172.307666] ? lock_sync+0x100/0x100
<4> [172.307672] ? lock_release+0xd0/0x2b0
<4> [172.307677] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.307683] process_one_work+0x239/0x760
<4> [172.307690] worker_thread+0x200/0x3f0
<4> [172.307693] ? __pfx_worker_thread+0x10/0x10
<4> [172.307695] kthread+0x10d/0x150
<4> [172.307699] ? __pfx_kthread+0x10/0x10
<4> [172.307702] ret_from_fork+0x3d4/0x480
<4> [172.307705] ? __pfx_kthread+0x10/0x10
<4> [172.307708] ret_from_fork_asm+0x1a/0x30
<4> [172.307716] </TASK>
<4> [172.307717] irq event stamp: 373275
<4> [172.307718] hardirqs last enabled at (373281): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.307722] hardirqs last disabled at (373286): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.307724] softirqs last enabled at (371440): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.307727] softirqs last disabled at (371435): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.307730] ---[ end trace 0000000000000000 ]---
<5> [172.310499] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1812, lrc_seqno=1812, guc_id=0, flags=0x73 in no process [-1]
<7> [172.310505] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.310589] ------------[ cut here ]------------
<4> [172.310591] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.310593] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:12/2686
<4> [172.310670] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.310758] autofs4 [last unloaded: xe]
<4> [172.310762] CPU: 2 UID: 0 PID: 2686 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.310765] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.310766] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.310768] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.310773] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.310845] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.310847] RSP: 0018:ffffc90007947ca0 EFLAGS: 00010246
<4> [172.310849] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.310851] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.310852] RBP: ffffc90007947db0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.310853] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.310854] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.310856] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [172.310857] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.310859] CR2: 00007a1124d14000 CR3: 00000001fa4de004 CR4: 0000000000f72ef0
<4> [172.310860] PKRU: 55555554
<4> [172.310862] Call Trace:
<4> [172.310863] <TASK>
<4> [172.310867] ? lock_sync+0x100/0x100
<4> [172.310872] ? lock_release+0xd0/0x2b0
<4> [172.310877] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.310883] process_one_work+0x239/0x760
<4> [172.310890] worker_thread+0x200/0x3f0
<4> [172.310893] ? __pfx_worker_thread+0x10/0x10
<4> [172.310895] kthread+0x10d/0x150
<4> [172.310898] ? __pfx_kthread+0x10/0x10
<4> [172.310902] ret_from_fork+0x3d4/0x480
<4> [172.310904] ? __pfx_kthread+0x10/0x10
<4> [172.310908] ret_from_fork_asm+0x1a/0x30
<4> [172.310916] </TASK>
<4> [172.310917] irq event stamp: 374733
<4> [172.310918] hardirqs last enabled at (374739): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.310921] hardirqs last disabled at (374744): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.310923] softirqs last enabled at (371440): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.310926] softirqs last disabled at (371435): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.310929] ---[ end trace 0000000000000000 ]---
<6> [172.310931] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.311002] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.311012] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.311055] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [172.311160] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [172.311382] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.311756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.311851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.311949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.312040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.312129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.312227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.312314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.312402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.312495] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.312591] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.312708] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.313720] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.324186] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.324441] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.325532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.325613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.325691] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.325770] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.325848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.325924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.326000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.326075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.326150] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.326234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.326308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.326383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.326457] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.326531] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.326604] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.326678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.326752] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.326825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.326900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.326984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.327067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.327148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.327238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.327316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.327393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.327470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.327548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.327628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.327708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.327788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.327871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.327953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.328041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.328127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.328218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.328299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.328378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.328455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.328533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.328609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.328694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.328775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.328855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.328933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.329015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.329093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.329170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.329260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.329338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.329414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.329493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.329576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.329655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.329734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.329811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.329893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.329972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.330050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.330130] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.330711] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.330716] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1812, lrc_seqno=1812, guc_id=0, flags=0x73 in no process [-1]
<7> [172.330718] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.330777] ------------[ cut here ]------------
<4> [172.330778] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.330779] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:15/4395
<4> [172.330851] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.330917] autofs4 [last unloaded: xe]
<4> [172.330922] CPU: 6 UID: 0 PID: 4395 Comm: kworker/u64:15 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.330925] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.330926] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.330927] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.330933] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.331002] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.331004] RSP: 0018:ffffc90002cabca0 EFLAGS: 00010246
<4> [172.331006] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.331008] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.331009] RBP: ffffc90002cabdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.331010] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.331011] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.331013] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [172.331014] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.331016] CR2: 000055e00f3ffe50 CR3: 00000001d73ac004 CR4: 0000000000f72ef0
<4> [172.331017] PKRU: 55555554
<4> [172.331018] Call Trace:
<4> [172.331020] <TASK>
<4> [172.331024] ? lock_sync+0x100/0x100
<4> [172.331029] ? lock_release+0xd0/0x2b0
<4> [172.331034] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.331040] process_one_work+0x239/0x760
<4> [172.331046] worker_thread+0x200/0x3f0
<4> [172.331049] ? __pfx_worker_thread+0x10/0x10
<4> [172.331052] kthread+0x10d/0x150
<4> [172.331055] ? __pfx_kthread+0x10/0x10
<4> [172.331059] ret_from_fork+0x3d4/0x480
<4> [172.331061] ? __pfx_kthread+0x10/0x10
<4> [172.331064] ret_from_fork_asm+0x1a/0x30
<4> [172.331072] </TASK>
<4> [172.331073] irq event stamp: 16923
<4> [172.331074] hardirqs last enabled at (16929): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.331077] hardirqs last disabled at (16934): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.331079] softirqs last enabled at (14868): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.331082] softirqs last disabled at (14859): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.331084] ---[ end trace 0000000000000000 ]---
<6> [172.331086] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.331156] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.331162] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.331595] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.331947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.332037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.332131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.332230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.332317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.332404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.332493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.332583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.332667] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.332761] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.332879] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.333886] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.344184] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.344435] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.345412] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.345492] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.345569] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.345649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.345726] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.345803] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.345877] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.345953] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.346031] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.346108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.346190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.346266] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.346340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.346414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.346491] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.346568] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.346646] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.346722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.346797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.346879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.346961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.347041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.347123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.347210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.347288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.347365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.347443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.347522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.347602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.347681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.347761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.347841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.347926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.348011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.348096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.348181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.348261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.348343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.348423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.348503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.348584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.348663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.348741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.348818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.348902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.348983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.349066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.349149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.349239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.349318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.349395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.349476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.349558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.349639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.349718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.349799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.349882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.349963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.350044] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.350592] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.350596] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1812, lrc_seqno=1812, guc_id=0, flags=0x73 in no process [-1]
<7> [172.350599] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.350657] ------------[ cut here ]------------
<4> [172.350658] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.350660] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:15/4395
<4> [172.350731] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.350796] autofs4 [last unloaded: xe]
<4> [172.350800] CPU: 6 UID: 0 PID: 4395 Comm: kworker/u64:15 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.350802] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.350804] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.350805] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.350810] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.350879] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.350881] RSP: 0018:ffffc90002cabca0 EFLAGS: 00010246
<4> [172.350883] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.350884] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.350885] RBP: ffffc90002cabdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.350887] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.350888] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.350889] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [172.350891] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.350892] CR2: 000055e00f3ffe50 CR3: 00000001d73ac004 CR4: 0000000000f72ef0
<4> [172.350894] PKRU: 55555554
<4> [172.350895] Call Trace:
<4> [172.350896] <TASK>
<4> [172.350900] ? lock_sync+0x100/0x100
<4> [172.350904] ? lock_release+0xd0/0x2b0
<4> [172.350910] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.350915] process_one_work+0x239/0x760
<4> [172.350921] worker_thread+0x200/0x3f0
<4> [172.350924] ? __pfx_worker_thread+0x10/0x10
<4> [172.350926] kthread+0x10d/0x150
<4> [172.350929] ? __pfx_kthread+0x10/0x10
<4> [172.350933] ret_from_fork+0x3d4/0x480
<4> [172.350935] ? __pfx_kthread+0x10/0x10
<4> [172.350938] ret_from_fork_asm+0x1a/0x30
<4> [172.350946] </TASK>
<4> [172.350947] irq event stamp: 23227
<4> [172.350948] hardirqs last enabled at (23233): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.350951] hardirqs last disabled at (23238): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.350953] softirqs last enabled at (21366): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.350956] softirqs last disabled at (21359): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.350958] ---[ end trace 0000000000000000 ]---
<7> [172.352374] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [172.352498] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [172.352857] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1826, lrc_seqno=1826, guc_id=0, flags=0x73 in no process [-1]
<7> [172.352861] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.352926] ------------[ cut here ]------------
<4> [172.352928] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.352929] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:6/993
<4> [172.353004] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.353071] autofs4 [last unloaded: xe]
<4> [172.353075] CPU: 7 UID: 0 PID: 993 Comm: kworker/u64:6 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.353078] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.353079] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.353080] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.353086] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.353157] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.353159] RSP: 0018:ffffc9000212bca0 EFLAGS: 00010246
<4> [172.353161] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.353163] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.353164] RBP: ffffc9000212bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.353165] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.353166] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.353168] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000
<4> [172.353169] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.353170] CR2: 000055e00f3ffe50 CR3: 00000001fb2e3005 CR4: 0000000000f72ef0
<4> [172.353172] PKRU: 55555554
<4> [172.353173] Call Trace:
<4> [172.353174] <TASK>
<4> [172.353191] ? lock_sync+0x100/0x100
<4> [172.353199] ? lock_release+0xd0/0x2b0
<4> [172.353207] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.353215] process_one_work+0x239/0x760
<4> [172.353226] worker_thread+0x200/0x3f0
<4> [172.353231] ? __pfx_worker_thread+0x10/0x10
<4> [172.353235] kthread+0x10d/0x150
<4> [172.353239] ? __pfx_kthread+0x10/0x10
<4> [172.353245] ret_from_fork+0x3d4/0x480
<4> [172.353248] ? __pfx_kthread+0x10/0x10
<4> [172.353254] ret_from_fork_asm+0x1a/0x30
<4> [172.353266] </TASK>
<4> [172.353268] irq event stamp: 943799
<4> [172.353270] hardirqs last enabled at (943805): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.353274] hardirqs last disabled at (943810): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.353277] softirqs last enabled at (943726): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.353281] softirqs last disabled at (943717): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.353285] ---[ end trace 0000000000000000 ]---
<6> [172.353288] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.353396] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.353406] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.353457] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.353895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.353988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.354082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.354172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.354277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.354367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.354458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.354550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.354634] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.354729] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.354847] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.355859] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.366187] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.366438] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.367475] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.367555] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.367631] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.367709] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.367789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.367867] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.367944] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.368019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.368095] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.368169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.368262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.368337] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.368413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.368490] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.368566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.368641] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.368716] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.368791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.368866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.368947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.369028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.369107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.369194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.369274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.369352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.369429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.369506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.369588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.369669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.369752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.369835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.369916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.370001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.370087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.370171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.370268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.370348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.370425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.370501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.370577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.370656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.370733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.370810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.370886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.370970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.371051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.371130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.371217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.371297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.371374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.371450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.371529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.371607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.371684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.371760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.371837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.371912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.371988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.372067] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.372640] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.372645] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1826, lrc_seqno=1826, guc_id=0, flags=0x73 in no process [-1]
<7> [172.372647] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.372706] ------------[ cut here ]------------
<4> [172.372707] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.372709] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:6/993
<4> [172.372782] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.372847] autofs4 [last unloaded: xe]
<4> [172.372851] CPU: 7 UID: 0 PID: 993 Comm: kworker/u64:6 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.372854] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.372855] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.372857] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.372861] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.372931] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.372933] RSP: 0018:ffffc9000212bca0 EFLAGS: 00010246
<4> [172.372935] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.372937] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.372938] RBP: ffffc9000212bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.372939] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.372940] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.372942] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000
<4> [172.372943] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.372945] CR2: 000055e00f3ffe50 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [172.372946] PKRU: 55555554
<4> [172.372947] Call Trace:
<4> [172.372949] <TASK>
<4> [172.372953] ? lock_sync+0x100/0x100
<4> [172.372957] ? lock_release+0xd0/0x2b0
<4> [172.372963] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.372969] process_one_work+0x239/0x760
<4> [172.372975] worker_thread+0x200/0x3f0
<4> [172.372978] ? __pfx_worker_thread+0x10/0x10
<4> [172.372980] kthread+0x10d/0x150
<4> [172.372983] ? __pfx_kthread+0x10/0x10
<4> [172.372987] ret_from_fork+0x3d4/0x480
<4> [172.372989] ? __pfx_kthread+0x10/0x10
<4> [172.372992] ret_from_fork_asm+0x1a/0x30
<4> [172.373000] </TASK>
<4> [172.373001] irq event stamp: 949975
<4> [172.373002] hardirqs last enabled at (949981): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.373005] hardirqs last disabled at (949986): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.373007] softirqs last enabled at (947920): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.373010] softirqs last disabled at (947913): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.373012] ---[ end trace 0000000000000000 ]---
<6> [172.373014] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.373084] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.373090] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.373499] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.373850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.373939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.374031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.374121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.374218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.374308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.374396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.374486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.374569] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.374665] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.374782] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.375799] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.386532] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.386784] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.387827] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.387906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.387982] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.388061] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.388166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.388280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.388356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.388432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.388507] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.388582] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.388656] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.388730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.388803] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.388877] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.388950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.389024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.389098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.389172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.389262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.389344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.389428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.389508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.389588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.389665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.389741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.389818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.389893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.389983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.390067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.390148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.390240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.390320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.390406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.390491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.390575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.390656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.390737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.390815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.390898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.390979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.391060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.391140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.391228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.391306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.391387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.391463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.391540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.391617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.391694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.391770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.391846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.391925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.392001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.392077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.392156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.392251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.392330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.392408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.392489] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.393019] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.393023] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1826, lrc_seqno=1826, guc_id=0, flags=0x73 in no process [-1]
<7> [172.393025] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.393085] ------------[ cut here ]------------
<4> [172.393086] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.393087] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:6/993
<4> [172.393160] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.393230] autofs4 [last unloaded: xe]
<4> [172.393234] CPU: 7 UID: 0 PID: 993 Comm: kworker/u64:6 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.393237] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.393239] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.393240] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.393245] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.393316] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.393318] RSP: 0018:ffffc9000212bca0 EFLAGS: 00010246
<4> [172.393320] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.393321] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.393323] RBP: ffffc9000212bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.393324] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.393325] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.393326] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000
<4> [172.393328] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.393329] CR2: 000055e00f3ffe50 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [172.393331] PKRU: 55555554
<4> [172.393332] Call Trace:
<4> [172.393333] <TASK>
<4> [172.393337] ? lock_sync+0x100/0x100
<4> [172.393341] ? lock_release+0xd0/0x2b0
<4> [172.393347] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.393352] process_one_work+0x239/0x760
<4> [172.393359] worker_thread+0x200/0x3f0
<4> [172.393361] ? __pfx_worker_thread+0x10/0x10
<4> [172.393364] kthread+0x10d/0x150
<4> [172.393367] ? __pfx_kthread+0x10/0x10
<4> [172.393370] ret_from_fork+0x3d4/0x480
<4> [172.393372] ? __pfx_kthread+0x10/0x10
<4> [172.393376] ret_from_fork_asm+0x1a/0x30
<4> [172.393383] </TASK>
<4> [172.393384] irq event stamp: 956187
<4> [172.393385] hardirqs last enabled at (956193): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.393388] hardirqs last disabled at (956198): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.393390] softirqs last enabled at (954372): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.393392] softirqs last disabled at (954361): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.393395] ---[ end trace 0000000000000000 ]---
<7> [172.394823] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [172.394974] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [172.395089] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1840, lrc_seqno=1840, guc_id=0, flags=0x73 in no process [-1]
<7> [172.395094] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.395193] ------------[ cut here ]------------
<4> [172.395238] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.395240] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:6/993
<4> [172.395348] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.395465] autofs4 [last unloaded: xe]
<4> [172.395469] CPU: 7 UID: 0 PID: 993 Comm: kworker/u64:6 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.395472] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.395474] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.395475] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.395481] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.395554] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.395556] RSP: 0018:ffffc9000212bca0 EFLAGS: 00010246
<4> [172.395559] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.395560] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.395562] RBP: ffffc9000212bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.395563] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.395564] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.395565] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000
<4> [172.395567] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.395568] CR2: 000055e00f3ffe50 CR3: 00000001eb6dd003 CR4: 0000000000f72ef0
<4> [172.395570] PKRU: 55555554
<4> [172.395571] Call Trace:
<4> [172.395572] <TASK>
<4> [172.395576] ? lock_sync+0x100/0x100
<4> [172.395581] ? lock_release+0xd0/0x2b0
<4> [172.395587] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.395592] process_one_work+0x239/0x760
<4> [172.395599] worker_thread+0x200/0x3f0
<4> [172.395601] ? __pfx_worker_thread+0x10/0x10
<4> [172.395604] kthread+0x10d/0x150
<4> [172.395607] ? __pfx_kthread+0x10/0x10
<4> [172.395610] ret_from_fork+0x3d4/0x480
<4> [172.395612] ? __pfx_kthread+0x10/0x10
<4> [172.395616] ret_from_fork_asm+0x1a/0x30
<4> [172.395623] </TASK>
<4> [172.395625] irq event stamp: 957665
<4> [172.395626] hardirqs last enabled at (957671): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.395629] hardirqs last disabled at (957676): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.395631] softirqs last enabled at (954372): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.395633] softirqs last disabled at (954361): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.395636] ---[ end trace 0000000000000000 ]---
<6> [172.395638] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.395711] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.395760] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.395836] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.396219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.396310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.396406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.396496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.396584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.396669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.396756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.396843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.396925] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.397020] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.397136] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.398155] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.408191] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.408464] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.409513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.409600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.409680] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.409761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.409838] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.409914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.409988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.410064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.410139] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.410225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.410300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.410375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.410449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.410524] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.410601] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.410678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.410753] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.410827] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.410902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.410985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.411067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.411147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.411238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.411317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.411395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.411472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.411550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.411630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.411711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.411791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.411875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.411958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.412045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.412131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.412225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.412307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.412387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.412464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.412543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.412620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.412703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.412784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.412863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.412940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.413022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.413100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.413183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.413265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.413343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.413420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.413496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.413576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.413653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.413733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.413812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.413892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.413968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.414045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.414125] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.414989] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.414995] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1840, lrc_seqno=1840, guc_id=0, flags=0x73 in no process [-1]
<7> [172.414997] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.415065] ------------[ cut here ]------------
<4> [172.415066] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.415067] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:6/993
<4> [172.415139] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.415217] autofs4 [last unloaded: xe]
<4> [172.415221] CPU: 7 UID: 0 PID: 993 Comm: kworker/u64:6 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.415224] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.415226] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.415227] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.415233] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.415305] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.415308] RSP: 0018:ffffc9000212bca0 EFLAGS: 00010246
<4> [172.415310] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.415312] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.415314] RBP: ffffc9000212bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.415315] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.415316] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.415318] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000
<4> [172.415320] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.415321] CR2: 000055e00f3ffe50 CR3: 00000001eb6dd003 CR4: 0000000000f72ef0
<4> [172.415323] PKRU: 55555554
<4> [172.415324] Call Trace:
<4> [172.415326] <TASK>
<4> [172.415330] ? lock_sync+0x100/0x100
<4> [172.415336] ? lock_release+0xd0/0x2b0
<4> [172.415342] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.415348] process_one_work+0x239/0x760
<4> [172.415355] worker_thread+0x200/0x3f0
<4> [172.415358] ? __pfx_worker_thread+0x10/0x10
<4> [172.415361] kthread+0x10d/0x150
<4> [172.415364] ? __pfx_kthread+0x10/0x10
<4> [172.415368] ret_from_fork+0x3d4/0x480
<4> [172.415370] ? __pfx_kthread+0x10/0x10
<4> [172.415374] ret_from_fork_asm+0x1a/0x30
<4> [172.415382] </TASK>
<4> [172.415384] irq event stamp: 963999
<4> [172.415385] hardirqs last enabled at (964005): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.415388] hardirqs last disabled at (964010): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.415391] softirqs last enabled at (962210): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.415394] softirqs last disabled at (962193): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.415396] ---[ end trace 0000000000000000 ]---
<6> [172.416569] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.416648] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.416654] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.416711] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [172.416817] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [172.417185] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.417543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.417633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.417727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.417816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.417903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.417987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.418073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.418160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.418256] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.418350] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.418467] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.419477] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.430184] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.430436] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.431467] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.431548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.431626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.431703] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.431780] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.431855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.431930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.432005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.432080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.432154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.432238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.432313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.432387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.432461] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.432535] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.432609] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.432682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.432757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.432834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.432918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.432999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.433078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.433158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.433246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.433324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.433401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.433477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.433556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.433636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.433714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.433797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.433881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.433968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.434054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.434139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.434232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.434317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.434397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.434474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.434553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.434632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.434710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.434788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.434864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.434945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.435021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.435101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.435184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.435264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.435342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.435418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.435499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.435576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.435657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.435737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.435817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.435895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.435973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.436054] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.436620] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.436625] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1840, lrc_seqno=1840, guc_id=0, flags=0x73 in no process [-1]
<7> [172.436627] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.436686] ------------[ cut here ]------------
<4> [172.436688] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.436689] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:6/993
<4> [172.436762] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.436830] autofs4 [last unloaded: xe]
<4> [172.436834] CPU: 7 UID: 0 PID: 993 Comm: kworker/u64:6 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.436837] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.436839] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.436840] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.436846] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.436916] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.436917] RSP: 0018:ffffc9000212bca0 EFLAGS: 00010246
<4> [172.436920] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.436921] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.436922] RBP: ffffc9000212bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.436924] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.436925] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.436926] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000
<4> [172.436928] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.436929] CR2: 000055e00f3ffe50 CR3: 00000001eb6dd003 CR4: 0000000000f72ef0
<4> [172.436931] PKRU: 55555554
<4> [172.436932] Call Trace:
<4> [172.436933] <TASK>
<4> [172.436937] ? lock_sync+0x100/0x100
<4> [172.436942] ? lock_release+0xd0/0x2b0
<4> [172.436948] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.436953] process_one_work+0x239/0x760
<4> [172.436960] worker_thread+0x200/0x3f0
<4> [172.436963] ? __pfx_worker_thread+0x10/0x10
<4> [172.436965] kthread+0x10d/0x150
<4> [172.436969] ? __pfx_kthread+0x10/0x10
<4> [172.436972] ret_from_fork+0x3d4/0x480
<4> [172.436974] ? __pfx_kthread+0x10/0x10
<4> [172.436978] ret_from_fork_asm+0x1a/0x30
<4> [172.436986] </TASK>
<4> [172.436987] irq event stamp: 970187
<4> [172.436988] hardirqs last enabled at (970193): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.436991] hardirqs last disabled at (970198): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.436993] softirqs last enabled at (968514): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.436996] softirqs last disabled at (968509): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.436998] ---[ end trace 0000000000000000 ]---
<5> [172.437895] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1854, lrc_seqno=1854, guc_id=0, flags=0x73 in no process [-1]
<7> [172.437906] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.438054] ------------[ cut here ]------------
<4> [172.438058] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.438062] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:8/1980
<4> [172.438199] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.438326] autofs4 [last unloaded: xe]
<7> [172.438261] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<4> [172.438332] CPU: 9 UID: 0 PID: 1980 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.438336] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.438338] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.438340] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.438346] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.438430] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.438432] RSP: 0018:ffffc900037efca0 EFLAGS: 00010246
<4> [172.438435] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.438436] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.438438] RBP: ffffc900037efdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.438439] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.438440] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.438442] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000
<4> [172.438443] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.438445] CR2: 00007a111d364000 CR3: 00000001fa4de005 CR4: 0000000000f72ef0
<4> [172.438446] PKRU: 55555554
<4> [172.438448] Call Trace:
<4> [172.438449] <TASK>
<4> [172.438453] ? lock_sync+0x100/0x100
<4> [172.438458] ? lock_release+0xd0/0x2b0
<4> [172.438463] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.438469] process_one_work+0x239/0x760
<4> [172.438476] worker_thread+0x200/0x3f0
<4> [172.438479] ? __pfx_worker_thread+0x10/0x10
<4> [172.438481] kthread+0x10d/0x150
<4> [172.438484] ? __pfx_kthread+0x10/0x10
<4> [172.438488] ret_from_fork+0x3d4/0x480
<4> [172.438490] ? __pfx_kthread+0x10/0x10
<4> [172.438494] ret_from_fork_asm+0x1a/0x30
<4> [172.438501] </TASK>
<4> [172.438502] irq event stamp: 637531
<4> [172.438504] hardirqs last enabled at (637537): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.438507] hardirqs last disabled at (637542): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.438509] softirqs last enabled at (636788): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.438512] softirqs last disabled at (636783): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.438514] ---[ end trace 0000000000000000 ]---
<7> [172.438414] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<6> [172.438517] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.438590] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.438602] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.438935] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.439300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.439395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.439490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.439579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.439666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.439751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.439837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.439923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.440005] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.440102] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.440233] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.441246] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.451188] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.451440] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.452470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.452551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.452628] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.452706] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.452786] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.452864] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.452940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.453014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.453089] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.453163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.453252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.453326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.453401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.453474] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.453547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.453623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.453700] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.453775] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.453850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.453932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.454013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.454092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.454180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.454261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.454340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.454417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.454493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.454572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.454652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.454729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.454808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.454887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.454971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.455054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.455140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.455241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.455324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.455404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.455486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.455565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.455648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.455726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.455804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.455881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.455962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.456039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.456117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.456202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.456286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.456365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.456444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.456524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.456602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.456681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.456763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.456845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.456924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.457004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.457085] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.457649] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.457653] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1854, lrc_seqno=1854, guc_id=0, flags=0x73 in no process [-1]
<7> [172.457656] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.457715] ------------[ cut here ]------------
<4> [172.457716] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.457717] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:8/1980
<4> [172.457789] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.457855] autofs4 [last unloaded: xe]
<4> [172.457859] CPU: 9 UID: 0 PID: 1980 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.457862] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.457863] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.457865] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.457870] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.457942] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.457944] RSP: 0018:ffffc900037efca0 EFLAGS: 00010246
<4> [172.457946] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.457948] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.457950] RBP: ffffc900037efdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.457951] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.457952] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.457954] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000
<4> [172.457956] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.457957] CR2: 00007a111d364000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [172.457959] PKRU: 55555554
<4> [172.457961] Call Trace:
<4> [172.457962] <TASK>
<4> [172.457966] ? lock_sync+0x100/0x100
<4> [172.457971] ? lock_release+0xd0/0x2b0
<4> [172.457976] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.457982] process_one_work+0x239/0x760
<4> [172.457989] worker_thread+0x200/0x3f0
<4> [172.457992] ? __pfx_worker_thread+0x10/0x10
<4> [172.457995] kthread+0x10d/0x150
<4> [172.457998] ? __pfx_kthread+0x10/0x10
<4> [172.458002] ret_from_fork+0x3d4/0x480
<4> [172.458004] ? __pfx_kthread+0x10/0x10
<4> [172.458008] ret_from_fork_asm+0x1a/0x30
<4> [172.458015] </TASK>
<4> [172.458017] irq event stamp: 643723
<4> [172.458018] hardirqs last enabled at (643729): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.458021] hardirqs last disabled at (643734): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.458024] softirqs last enabled at (641768): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.458027] softirqs last disabled at (641759): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.458029] ---[ end trace 0000000000000000 ]---
<6> [172.458031] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.458103] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.458110] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.459357] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [172.459466] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [172.459576] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.459938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.460030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.460124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.460224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.460310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.460397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.460488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.460577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.460661] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.460756] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.460873] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.461885] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.472536] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.472789] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.473839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.473922] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.474001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.474079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.474155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.474244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.474321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.474395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.474470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.474545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.474622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.474700] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.474777] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.474852] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.474927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.475002] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.475076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.475149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.475235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.475327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.475409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.475491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.475573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.475652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.475731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.475808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.475885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.475964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.476044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.476122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.476228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.476309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.476393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.476477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.476565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.476649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.476730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.476808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.476886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.476962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.477042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.477120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.477211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.477294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.477377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.477455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.477533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.477609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.477687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.477763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.477837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.477916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.477992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.478069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.478145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.478231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.478306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.478380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.478462] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.479023] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.479027] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1854, lrc_seqno=1854, guc_id=0, flags=0x73 in no process [-1]
<7> [172.479030] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.479089] ------------[ cut here ]------------
<4> [172.479090] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.479092] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:3/191
<4> [172.479164] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.479258] autofs4 [last unloaded: xe]
<4> [172.479262] CPU: 11 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.479265] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.479266] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.479268] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.479273] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.479342] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.479344] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246
<4> [172.479346] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.479348] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.479349] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.479350] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.479352] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.479353] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [172.479354] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.479356] CR2: 00007a111d364000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [172.479357] PKRU: 55555554
<4> [172.479358] Call Trace:
<4> [172.479360] <TASK>
<4> [172.479364] ? lock_sync+0x100/0x100
<4> [172.479369] ? lock_release+0xd0/0x2b0
<4> [172.479374] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.479380] process_one_work+0x239/0x760
<4> [172.479386] worker_thread+0x200/0x3f0
<4> [172.479389] ? __pfx_worker_thread+0x10/0x10
<4> [172.479392] kthread+0x10d/0x150
<4> [172.479394] ? __pfx_kthread+0x10/0x10
<4> [172.479398] ret_from_fork+0x3d4/0x480
<4> [172.479400] ? __pfx_kthread+0x10/0x10
<4> [172.479404] ret_from_fork_asm+0x1a/0x30
<4> [172.479411] </TASK>
<4> [172.479412] irq event stamp: 587711
<4> [172.479413] hardirqs last enabled at (587717): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.479416] hardirqs last disabled at (587722): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.479418] softirqs last enabled at (585808): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.479421] softirqs last disabled at (585801): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.479423] ---[ end trace 0000000000000000 ]---
<7> [172.480852] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [172.481041] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [172.481799] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1868, lrc_seqno=1868, guc_id=0, flags=0x73 in no process [-1]
<7> [172.481806] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.481896] ------------[ cut here ]------------
<4> [172.481899] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.481901] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:8/1980
<4> [172.481986] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.482055] autofs4 [last unloaded: xe]
<4> [172.482059] CPU: 6 UID: 0 PID: 1980 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.482062] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.482063] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.482065] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.482070] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.482144] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.482146] RSP: 0018:ffffc900037efca0 EFLAGS: 00010246
<4> [172.482148] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.482150] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.482151] RBP: ffffc900037efdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.482152] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.482153] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.482155] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [172.482156] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.482158] CR2: 00007a111d364000 CR3: 00000001eb6dd004 CR4: 0000000000f72ef0
<4> [172.482159] PKRU: 55555554
<4> [172.482161] Call Trace:
<4> [172.482162] <TASK>
<4> [172.482166] ? lock_sync+0x100/0x100
<4> [172.482171] ? lock_release+0xd0/0x2b0
<4> [172.482184] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.482190] process_one_work+0x239/0x760
<4> [172.482197] worker_thread+0x200/0x3f0
<4> [172.482200] ? __pfx_worker_thread+0x10/0x10
<4> [172.482202] kthread+0x10d/0x150
<4> [172.482205] ? __pfx_kthread+0x10/0x10
<4> [172.482209] ret_from_fork+0x3d4/0x480
<4> [172.482211] ? __pfx_kthread+0x10/0x10
<4> [172.482215] ret_from_fork_asm+0x1a/0x30
<4> [172.482222] </TASK>
<4> [172.482224] irq event stamp: 645745
<4> [172.482225] hardirqs last enabled at (645751): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.482228] hardirqs last disabled at (645756): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.482230] softirqs last enabled at (645684): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.482232] softirqs last disabled at (645675): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.482235] ---[ end trace 0000000000000000 ]---
<6> [172.482237] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.482311] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.482318] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.482500] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.483034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.483129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.483238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.483328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.483416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.483501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.483587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.483673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.483755] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.483850] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.483969] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.484989] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.495187] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.495455] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.496528] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.496614] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.496695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.496774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.496852] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.496928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.497004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.497079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.497154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.497244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.497319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.497394] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.497469] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.497544] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.497624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.497701] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.497779] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.497855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.497930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.498012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.498094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.498175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.498273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.498352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.498430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.498508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.498585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.498670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.498756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.498838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.498919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.498999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.499083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.499168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.499266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.499347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.499427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.499505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.499586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.499667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.499751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.499832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.499911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.499989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.500070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.500150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.500244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.500323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.500401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.500478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.500554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.500633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.500713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.500793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.500872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.500950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.501028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.501106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.501194] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.501769] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.501774] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1868, lrc_seqno=1868, guc_id=0, flags=0x73 in no process [-1]
<7> [172.501777] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.501839] ------------[ cut here ]------------
<4> [172.501840] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.501841] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:8/1980
<4> [172.501913] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.501984] autofs4 [last unloaded: xe]
<4> [172.501988] CPU: 6 UID: 0 PID: 1980 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.501991] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.501992] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.501994] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.501999] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.502070] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.502072] RSP: 0018:ffffc900037efca0 EFLAGS: 00010246
<4> [172.502074] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.502076] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.502077] RBP: ffffc900037efdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.502078] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.502080] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.502081] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [172.502083] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.502084] CR2: 0000744570e4e000 CR3: 00000001154ef005 CR4: 0000000000f72ef0
<4> [172.502086] PKRU: 55555554
<4> [172.502087] Call Trace:
<4> [172.502088] <TASK>
<4> [172.502092] ? lock_sync+0x100/0x100
<4> [172.502097] ? lock_release+0xd0/0x2b0
<4> [172.502103] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.502109] process_one_work+0x239/0x760
<4> [172.502116] worker_thread+0x200/0x3f0
<4> [172.502118] ? __pfx_worker_thread+0x10/0x10
<4> [172.502121] kthread+0x10d/0x150
<4> [172.502124] ? __pfx_kthread+0x10/0x10
<4> [172.502128] ret_from_fork+0x3d4/0x480
<4> [172.502130] ? __pfx_kthread+0x10/0x10
<4> [172.502133] ret_from_fork_asm+0x1a/0x30
<4> [172.502140] </TASK>
<4> [172.502141] irq event stamp: 651959
<4> [172.502143] hardirqs last enabled at (651965): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.502146] hardirqs last disabled at (651970): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.502148] softirqs last enabled at (650164): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.502151] softirqs last disabled at (650157): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.502153] ---[ end trace 0000000000000000 ]---
<6> [172.502155] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.503400] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.503408] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.503494] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [172.503603] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [172.503711] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.504066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.504155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.504258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.504349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.504439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.504525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.504612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.504699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.504780] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.504874] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.504990] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.505996] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.516185] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.516438] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.517476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.517555] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.517632] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.517712] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.517791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.517870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.517946] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.518021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.518096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.518169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.518257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.518334] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.518411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.518486] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.518561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.518636] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.518710] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.518785] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.518858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.518939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.519021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.519101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.519185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.519264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.519342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.519420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.519497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.519580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.519665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.519746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.519827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.519908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.519993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.520078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.520162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.520256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.520336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.520413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.520490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.520567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.520645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.520722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.520801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.520881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.520965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.521045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.521124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.521207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.521286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.521363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.521441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.521520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.521597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.521674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.521752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.521830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.521905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.521982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.522065] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.522635] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.522639] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1868, lrc_seqno=1868, guc_id=0, flags=0x73 in no process [-1]
<7> [172.522642] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.522702] ------------[ cut here ]------------
<4> [172.522703] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.522705] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:8/1980
<4> [172.522777] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.522843] autofs4 [last unloaded: xe]
<4> [172.522847] CPU: 6 UID: 0 PID: 1980 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.522850] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.522851] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.522853] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.522858] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.522928] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.522930] RSP: 0018:ffffc900037efca0 EFLAGS: 00010246
<4> [172.522933] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.522934] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.522935] RBP: ffffc900037efdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.522937] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.522938] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.522939] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [172.522941] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.522942] CR2: 0000744570e4e000 CR3: 00000001154ef005 CR4: 0000000000f72ef0
<4> [172.522944] PKRU: 55555554
<4> [172.522945] Call Trace:
<4> [172.522946] <TASK>
<4> [172.522950] ? lock_sync+0x100/0x100
<4> [172.522955] ? lock_release+0xd0/0x2b0
<4> [172.522960] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.522966] process_one_work+0x239/0x760
<4> [172.522973] worker_thread+0x200/0x3f0
<4> [172.522975] ? __pfx_worker_thread+0x10/0x10
<4> [172.522978] kthread+0x10d/0x150
<4> [172.522981] ? __pfx_kthread+0x10/0x10
<4> [172.522985] ret_from_fork+0x3d4/0x480
<4> [172.522987] ? __pfx_kthread+0x10/0x10
<4> [172.522990] ret_from_fork_asm+0x1a/0x30
<4> [172.522998] </TASK>
<4> [172.522999] irq event stamp: 658171
<4> [172.523000] hardirqs last enabled at (658177): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.523003] hardirqs last disabled at (658182): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.523005] softirqs last enabled at (656480): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.523008] softirqs last disabled at (656469): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.523010] ---[ end trace 0000000000000000 ]---
<5> [172.525192] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1882, lrc_seqno=1882, guc_id=0, flags=0x73 in no process [-1]
<7> [172.525197] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.525284] ------------[ cut here ]------------
<4> [172.525285] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.525287] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:8/1980
<4> [172.525362] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.525484] autofs4 [last unloaded: xe]
<4> [172.525491] CPU: 6 UID: 0 PID: 1980 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.525496] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.525498] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.525501] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.525510] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.525730] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.525733] RSP: 0018:ffffc900037efca0 EFLAGS: 00010246
<4> [172.525737] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.525739] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.525741] RBP: ffffc900037efdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.525743] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.525745] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.525747] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [172.525750] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.525753] CR2: 0000744570e4e000 CR3: 00000001fe69a005 CR4: 0000000000f72ef0
<4> [172.525755] PKRU: 55555554
<4> [172.525757] Call Trace:
<4> [172.525759] <TASK>
<4> [172.525766] ? lock_sync+0x100/0x100
<4> [172.525775] ? lock_release+0xd0/0x2b0
<4> [172.525784] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.525795] process_one_work+0x239/0x760
<4> [172.525807] worker_thread+0x200/0x3f0
<4> [172.525812] ? __pfx_worker_thread+0x10/0x10
<4> [172.525816] kthread+0x10d/0x150
<4> [172.525821] ? __pfx_kthread+0x10/0x10
<4> [172.525826] ret_from_fork+0x3d4/0x480
<4> [172.525830] ? __pfx_kthread+0x10/0x10
<4> [172.525836] ret_from_fork_asm+0x1a/0x30
<4> [172.525849] </TASK>
<4> [172.525851] irq event stamp: 659637
<4> [172.525853] hardirqs last enabled at (659643): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.525858] hardirqs last disabled at (659648): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.525861] softirqs last enabled at (658302): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.525865] softirqs last disabled at (658295): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.525955] ---[ end trace 0000000000000000 ]---
<6> [172.525958] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.526043] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.526053] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.526430] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [172.526537] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [172.526665] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.527031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.527121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.527228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.527319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.527407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.527492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.527579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.527666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.527748] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.527843] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.527959] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.528974] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.539186] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.539438] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.540503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.540583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.540660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.540736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.540813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.540888] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.540962] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.541037] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.541110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.541191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.541266] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.541339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.541412] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.541486] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.541560] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.541633] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.541707] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.541779] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.541852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.541934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.542016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.542095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.542175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.542266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.542345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.542425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.542504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.542585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.542669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.542749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.542830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.542912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.542997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.543080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.543164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.543259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.543342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.543421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.543500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.543576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.543656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.543734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.543811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.543887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.543971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.544050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.544129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.544214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.544292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.544368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.544443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.544522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.544599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.544676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.544752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.544833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.544914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.544992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.545074] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.545695] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.545699] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1882, lrc_seqno=1882, guc_id=0, flags=0x73 in no process [-1]
<7> [172.545702] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.545760] ------------[ cut here ]------------
<4> [172.545761] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.545763] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:8/1980
<4> [172.545834] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.545901] autofs4 [last unloaded: xe]
<4> [172.545905] CPU: 6 UID: 0 PID: 1980 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.545908] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.545909] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.545911] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.545915] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.545985] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.545987] RSP: 0018:ffffc900037efca0 EFLAGS: 00010246
<4> [172.545989] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.545990] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.545992] RBP: ffffc900037efdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.545993] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.545994] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.545995] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [172.545997] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.545998] CR2: 0000744570e4e000 CR3: 00000001fe69a005 CR4: 0000000000f72ef0
<4> [172.546000] PKRU: 55555554
<4> [172.546001] Call Trace:
<4> [172.546002] <TASK>
<4> [172.546006] ? lock_sync+0x100/0x100
<4> [172.546011] ? lock_release+0xd0/0x2b0
<4> [172.546016] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.546022] process_one_work+0x239/0x760
<4> [172.546028] worker_thread+0x200/0x3f0
<4> [172.546031] ? __pfx_worker_thread+0x10/0x10
<4> [172.546033] kthread+0x10d/0x150
<4> [172.546036] ? __pfx_kthread+0x10/0x10
<4> [172.546039] ret_from_fork+0x3d4/0x480
<4> [172.546041] ? __pfx_kthread+0x10/0x10
<4> [172.546045] ret_from_fork_asm+0x1a/0x30
<4> [172.546052] </TASK>
<4> [172.546053] irq event stamp: 665833
<4> [172.546054] hardirqs last enabled at (665839): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.546057] hardirqs last disabled at (665844): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.546059] softirqs last enabled at (663878): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.546062] softirqs last disabled at (663871): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.546064] ---[ end trace 0000000000000000 ]---
<6> [172.546066] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.546136] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.546143] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.547387] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [172.547493] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [172.547602] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.547974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.548066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.548160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.548262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.548349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.548435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.548520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.548606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.548688] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.548783] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.548902] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.549912] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.560534] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.560785] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.561828] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.561907] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.561985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.562065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.562142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.562231] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.562308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.562385] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.562459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.562533] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.562608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.562681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.562756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.562834] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.562911] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.562988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.563063] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.563137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.563222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.563303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.563386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.563465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.563546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.563626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.563704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.563781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.563859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.563939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.564022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.564105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.564193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.564275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.564365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.564454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.564541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.564624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.564703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.564780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.564857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.564933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.565013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.565091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.565167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.565258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.565339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.565415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.565491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.565570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.565652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.565732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.565811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.565891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.565970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.566048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.566125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.566214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.566290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.566367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.566446] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.566995] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.566999] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1882, lrc_seqno=1882, guc_id=0, flags=0x73 in no process [-1]
<7> [172.567002] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.567062] ------------[ cut here ]------------
<4> [172.567063] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.567064] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:6/993
<4> [172.567136] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.567210] autofs4 [last unloaded: xe]
<4> [172.567214] CPU: 7 UID: 0 PID: 993 Comm: kworker/u64:6 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.567217] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.567218] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.567220] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.567225] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.567295] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.567297] RSP: 0018:ffffc9000212bca0 EFLAGS: 00010246
<4> [172.567299] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.567300] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.567302] RBP: ffffc9000212bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.567303] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.567304] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.567305] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000
<4> [172.567307] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.567309] CR2: 00007a111d344000 CR3: 000000000344c003 CR4: 0000000000f72ef0
<4> [172.567310] PKRU: 55555554
<4> [172.567311] Call Trace:
<4> [172.567312] <TASK>
<4> [172.567317] ? lock_sync+0x100/0x100
<4> [172.567321] ? lock_release+0xd0/0x2b0
<4> [172.567327] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.567332] process_one_work+0x239/0x760
<4> [172.567339] worker_thread+0x200/0x3f0
<4> [172.567342] ? __pfx_worker_thread+0x10/0x10
<4> [172.567344] kthread+0x10d/0x150
<4> [172.567347] ? __pfx_kthread+0x10/0x10
<4> [172.567351] ret_from_fork+0x3d4/0x480
<4> [172.567353] ? __pfx_kthread+0x10/0x10
<4> [172.567356] ret_from_fork_asm+0x1a/0x30
<4> [172.567364] </TASK>
<4> [172.567365] irq event stamp: 980613
<4> [172.567366] hardirqs last enabled at (980619): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.567369] hardirqs last disabled at (980624): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.567371] softirqs last enabled at (978798): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.567374] softirqs last disabled at (978791): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.567376] ---[ end trace 0000000000000000 ]---
<7> [172.568805] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [172.568924] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [172.569134] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1896, lrc_seqno=1896, guc_id=0, flags=0x73 in no process [-1]
<7> [172.569140] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.569232] ------------[ cut here ]------------
<4> [172.569233] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.569235] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:2/119
<4> [172.569320] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.569400] autofs4 [last unloaded: xe]
<4> [172.569405] CPU: 4 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.569408] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.569409] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.569411] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.569417] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.569497] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.569499] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246
<4> [172.569501] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.569503] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.569504] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.569505] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.569506] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.569508] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [172.569509] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.569511] CR2: 00007a111d344000 CR3: 00000001be638004 CR4: 0000000000f72ef0
<4> [172.569512] PKRU: 55555554
<4> [172.569513] Call Trace:
<4> [172.569515] <TASK>
<4> [172.569521] ? lock_sync+0x100/0x100
<4> [172.569532] ? lock_release+0xd0/0x2b0
<4> [172.569540] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.569552] process_one_work+0x239/0x760
<4> [172.569559] worker_thread+0x200/0x3f0
<4> [172.569562] ? __pfx_worker_thread+0x10/0x10
<4> [172.569565] kthread+0x10d/0x150
<4> [172.569568] ? __pfx_kthread+0x10/0x10
<4> [172.569571] ret_from_fork+0x3d4/0x480
<4> [172.569574] ? __pfx_kthread+0x10/0x10
<4> [172.569577] ret_from_fork_asm+0x1a/0x30
<4> [172.569584] </TASK>
<4> [172.569586] irq event stamp: 205523
<4> [172.569587] hardirqs last enabled at (205529): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.569590] hardirqs last disabled at (205534): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.569592] softirqs last enabled at (204762): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.569595] softirqs last disabled at (204757): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.569597] ---[ end trace 0000000000000000 ]---
<6> [172.569599] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.569680] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.569687] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.569741] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.570261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.570354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.570449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.570538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.570627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.570712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.570802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.570894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.570980] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.571076] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.571200] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.572219] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.582185] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.582450] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.583441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.583521] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.583599] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.583676] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.583753] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.583829] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.583904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.583979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.584054] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.584127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.584216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.584290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.584367] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.584445] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.584521] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.584597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.584672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.584746] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.584822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.584904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.585004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.585101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.585188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.585269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.585350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.585428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.585506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.585586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.585666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.585744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.585823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.585902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.585987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.586071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.586155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.586247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.586332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.586414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.586494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.586572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.586653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.586733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.586811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.586888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.586969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.587047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.587129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.587216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.587298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.587376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.587454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.587533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.587611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.587689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.587766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.587848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.587925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.588004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.588083] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.588718] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.588723] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1896, lrc_seqno=1896, guc_id=0, flags=0x73 in no process [-1]
<7> [172.588726] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.588784] ------------[ cut here ]------------
<4> [172.588786] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.588787] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:2/119
<4> [172.588859] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.588928] autofs4 [last unloaded: xe]
<4> [172.588932] CPU: 4 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.588935] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.588936] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.588938] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.588943] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.589012] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.589014] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246
<4> [172.589016] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.589018] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.589019] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.589020] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.589021] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.589023] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [172.589025] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.589026] CR2: 00007a111d344000 CR3: 000000012542e001 CR4: 0000000000f72ef0
<4> [172.589027] PKRU: 55555554
<4> [172.589029] Call Trace:
<4> [172.589030] <TASK>
<4> [172.589034] ? lock_sync+0x100/0x100
<4> [172.589039] ? lock_release+0xd0/0x2b0
<4> [172.589044] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.589050] process_one_work+0x239/0x760
<4> [172.589057] worker_thread+0x200/0x3f0
<4> [172.589060] ? __pfx_worker_thread+0x10/0x10
<4> [172.589062] kthread+0x10d/0x150
<4> [172.589065] ? __pfx_kthread+0x10/0x10
<4> [172.589069] ret_from_fork+0x3d4/0x480
<4> [172.589071] ? __pfx_kthread+0x10/0x10
<4> [172.589074] ret_from_fork_asm+0x1a/0x30
<4> [172.589082] </TASK>
<4> [172.589083] irq event stamp: 211707
<4> [172.589084] hardirqs last enabled at (211713): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.589087] hardirqs last disabled at (211718): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.589089] softirqs last enabled at (209652): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.589092] softirqs last disabled at (209645): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.589094] ---[ end trace 0000000000000000 ]---
<6> [172.589096] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.589168] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.589180] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.590425] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [172.590534] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [172.590643] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.591035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.591125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.591233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.591323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.591411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.591497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.591583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.591670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.591753] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.591850] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.591966] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.592976] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.603534] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.603786] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.604808] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.604889] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.604967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.605044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.605121] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.605203] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.605279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.605353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.605427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.605500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.605577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.605655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.605730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.605803] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.605878] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.605952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.606026] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.606100] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.606173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.606272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.606356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.606438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.606519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.606596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.606673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.606751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.606827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.606907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.606987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.607066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.607145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.607233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.607321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.607409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.607496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.607579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.607660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.607737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.607814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.607891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.607971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.608049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.608126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.608208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.608289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.608368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.608450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.608530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.608608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.608685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.608762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.608841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.608918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.608996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.609073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.609151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.609235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.609311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.609391] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.610006] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.610011] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1896, lrc_seqno=1896, guc_id=0, flags=0x73 in no process [-1]
<7> [172.610013] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.610072] ------------[ cut here ]------------
<4> [172.610074] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.610075] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:14/4359
<4> [172.610148] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.610221] autofs4 [last unloaded: xe]
<4> [172.610226] CPU: 5 UID: 0 PID: 4359 Comm: kworker/u64:14 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.610229] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.610230] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.610231] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.610237] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.610307] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.610308] RSP: 0018:ffffc90001753ca0 EFLAGS: 00010246
<4> [172.610311] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.610312] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.610314] RBP: ffffc90001753db0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.610315] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.610316] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.610317] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000
<4> [172.610319] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.610320] CR2: 00007a111d244000 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [172.610322] PKRU: 55555554
<4> [172.610323] Call Trace:
<4> [172.610324] <TASK>
<4> [172.610328] ? lock_sync+0x100/0x100
<4> [172.610333] ? lock_release+0xd0/0x2b0
<4> [172.610339] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.610344] process_one_work+0x239/0x760
<4> [172.610351] worker_thread+0x200/0x3f0
<4> [172.610354] ? __pfx_worker_thread+0x10/0x10
<4> [172.610356] kthread+0x10d/0x150
<4> [172.610359] ? __pfx_kthread+0x10/0x10
<4> [172.610363] ret_from_fork+0x3d4/0x480
<4> [172.610365] ? __pfx_kthread+0x10/0x10
<4> [172.610368] ret_from_fork_asm+0x1a/0x30
<4> [172.610376] </TASK>
<4> [172.610377] irq event stamp: 8237
<4> [172.610378] hardirqs last enabled at (8243): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.610381] hardirqs last disabled at (8248): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.610383] softirqs last enabled at (6046): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.610386] softirqs last disabled at (6037): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.610388] ---[ end trace 0000000000000000 ]---
<7> [172.612275] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [172.612445] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [172.612586] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1910, lrc_seqno=1910, guc_id=0, flags=0x73 in no process [-1]
<7> [172.612589] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.612651] ------------[ cut here ]------------
<4> [172.612653] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.612654] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:14/4359
<4> [172.612730] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.612838] autofs4 [last unloaded: xe]
<4> [172.612845] CPU: 5 UID: 0 PID: 4359 Comm: kworker/u64:14 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.612849] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.612852] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.612855] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.612863] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.612968] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.612971] RSP: 0018:ffffc90001753ca0 EFLAGS: 00010246
<4> [172.612975] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.612977] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.612980] RBP: ffffc90001753db0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.612982] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.612985] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.612987] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000
<4> [172.612990] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.612992] CR2: 00007a111d244000 CR3: 0000000103a73002 CR4: 0000000000f72ef0
<4> [172.612995] PKRU: 55555554
<4> [172.612997] Call Trace:
<4> [172.612999] <TASK>
<4> [172.613006] ? lock_sync+0x100/0x100
<4> [172.613014] ? lock_release+0xd0/0x2b0
<4> [172.613023] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.613034] process_one_work+0x239/0x760
<4> [172.613044] worker_thread+0x200/0x3f0
<4> [172.613049] ? __pfx_worker_thread+0x10/0x10
<4> [172.613053] kthread+0x10d/0x150
<4> [172.613058] ? __pfx_kthread+0x10/0x10
<4> [172.613064] ret_from_fork+0x3d4/0x480
<4> [172.613067] ? __pfx_kthread+0x10/0x10
<4> [172.613072] ret_from_fork_asm+0x1a/0x30
<4> [172.613085] </TASK>
<4> [172.613088] irq event stamp: 9721
<4> [172.613090] hardirqs last enabled at (9727): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.613093] hardirqs last disabled at (9732): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.613097] softirqs last enabled at (8712): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.613101] softirqs last disabled at (8705): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.613104] ---[ end trace 0000000000000000 ]---
<6> [172.613107] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.613227] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.613242] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.613293] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.613804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.613900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.613994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.614084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.614184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.614274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.614361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.614448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.614530] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.614627] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.614747] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.615762] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.626185] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.626463] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.627505] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.627586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.627664] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.627742] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.627821] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.627900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.627980] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.628058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.628135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.628240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.628316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.628392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.628473] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.628552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.628632] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.628710] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.628788] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.628865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.628940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.629023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.629106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.629195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.629278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.629359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.629441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.629522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.629603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.629687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.629769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.629849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.629930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.630009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.630095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.630188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.630303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.630386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.630468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.630548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.630627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.630703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.630783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.630863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.630942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.631019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.631101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.631185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.631268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.631350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.631432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.631511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.631589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.631669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.631748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.631826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.631906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.631989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.632068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.632146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.632236] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.632954] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.632959] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1910, lrc_seqno=1910, guc_id=0, flags=0x73 in no process [-1]
<7> [172.632961] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.633024] ------------[ cut here ]------------
<4> [172.633026] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.633027] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:14/4359
<4> [172.633099] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.633166] autofs4 [last unloaded: xe]
<4> [172.633170] CPU: 5 UID: 0 PID: 4359 Comm: kworker/u64:14 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.633173] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.633174] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.633181] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.633187] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.633261] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.633263] RSP: 0018:ffffc90001753ca0 EFLAGS: 00010246
<4> [172.633265] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.633267] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.633268] RBP: ffffc90001753db0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.633269] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.633270] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.633272] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000
<4> [172.633273] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.633275] CR2: 00007a111d244000 CR3: 0000000103a73002 CR4: 0000000000f72ef0
<4> [172.633276] PKRU: 55555554
<4> [172.633277] Call Trace:
<4> [172.633278] <TASK>
<4> [172.633283] ? lock_sync+0x100/0x100
<4> [172.633287] ? lock_release+0xd0/0x2b0
<4> [172.633293] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.633298] process_one_work+0x239/0x760
<4> [172.633304] worker_thread+0x200/0x3f0
<4> [172.633307] ? __pfx_worker_thread+0x10/0x10
<4> [172.633309] kthread+0x10d/0x150
<4> [172.633312] ? __pfx_kthread+0x10/0x10
<4> [172.633316] ret_from_fork+0x3d4/0x480
<4> [172.633319] ? __pfx_kthread+0x10/0x10
<4> [172.633323] ret_from_fork_asm+0x1a/0x30
<4> [172.633330] </TASK>
<4> [172.633331] irq event stamp: 15947
<4> [172.633332] hardirqs last enabled at (15953): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.633335] hardirqs last disabled at (15958): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.633337] softirqs last enabled at (14064): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.633340] softirqs last disabled at (14057): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.633342] ---[ end trace 0000000000000000 ]---
<6> [172.634304] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.634383] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.634390] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.634405] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [172.634510] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [172.634619] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.635152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.635310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.635448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.635575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.635700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.635826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.635950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.636077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.636206] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.636341] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.636498] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.637633] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.648243] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.648523] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.649534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.649618] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.649695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.649772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.649849] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.649925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.650000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.650075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.650150] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.650242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.650318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.650395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.650472] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.650548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.650624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.650699] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.650772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.650847] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.650921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.651003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.651084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.651164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.651264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.651343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.651420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.651498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.651575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.651655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.651735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.651812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.651891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.651971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.652059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.652147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.652243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.652325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.652407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.652485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.652564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.652644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.652727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.652806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.652885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.652963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.653044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.653122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.653228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.653305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.653382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.653458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.653534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.653614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.653690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.653769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.653845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.653926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.654006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.654084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.654166] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.654813] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.654818] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1910, lrc_seqno=1910, guc_id=0, flags=0x73 in no process [-1]
<7> [172.654821] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.654885] ------------[ cut here ]------------
<4> [172.654886] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.654887] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#1: kworker/u64:10/1982
<4> [172.654961] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.655032] autofs4 [last unloaded: xe]
<4> [172.655036] CPU: 1 UID: 0 PID: 1982 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.655039] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.655040] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.655042] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.655048] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.655119] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.655121] RSP: 0018:ffffc90003d43ca0 EFLAGS: 00010246
<4> [172.655123] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.655125] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.655126] RBP: ffffc90003d43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.655127] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.655129] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.655130] FS: 0000000000000000(0000) GS:ffff8888dad17000(0000) knlGS:0000000000000000
<4> [172.655132] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.655133] CR2: 00007a111d234000 CR3: 00000001fb2e3001 CR4: 0000000000f72ef0
<4> [172.655135] PKRU: 55555554
<4> [172.655136] Call Trace:
<4> [172.655137] <TASK>
<4> [172.655141] ? lock_sync+0x100/0x100
<4> [172.655147] ? lock_release+0xd0/0x2b0
<4> [172.655152] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.655158] process_one_work+0x239/0x760
<4> [172.655165] worker_thread+0x200/0x3f0
<4> [172.655168] ? __pfx_worker_thread+0x10/0x10
<4> [172.655170] kthread+0x10d/0x150
<4> [172.655173] ? __pfx_kthread+0x10/0x10
<4> [172.655184] ret_from_fork+0x3d4/0x480
<4> [172.655187] ? __pfx_kthread+0x10/0x10
<4> [172.655192] ret_from_fork_asm+0x1a/0x30
<4> [172.655203] </TASK>
<4> [172.655204] irq event stamp: 514705
<4> [172.655205] hardirqs last enabled at (514711): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.655208] hardirqs last disabled at (514716): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.655211] softirqs last enabled at (512916): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.655214] softirqs last disabled at (512883): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.655216] ---[ end trace 0000000000000000 ]---
<5> [172.657235] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1965, lrc_seqno=1965, guc_id=0, flags=0x73 in no process [-1]
<7> [172.657245] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.657380] ------------[ cut here ]------------
<4> [172.657382] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.657383] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:10/1982
<4> [172.657467] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap
<7> [172.657450] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<4> [172.657521] platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe]
<4> [172.657588] CPU: 0 UID: 0 PID: 1982 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.657596] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.657598] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.657601] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.657609] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<7> [172.657596] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<4> [172.657728] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.657731] RSP: 0018:ffffc90003d43ca0 EFLAGS: 00010246
<4> [172.657734] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.657736] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.657738] RBP: ffffc90003d43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.657740] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.657742] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.657747] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [172.657750] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.657751] CR2: 00007a1124d14000 CR3: 000000000344c003 CR4: 0000000000f72ef0
<4> [172.657753] PKRU: 55555554
<4> [172.657754] Call Trace:
<4> [172.657755] <TASK>
<4> [172.657759] ? lock_sync+0x100/0x100
<4> [172.657764] ? lock_release+0xd0/0x2b0
<4> [172.657770] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.657776] process_one_work+0x239/0x760
<4> [172.657783] worker_thread+0x200/0x3f0
<4> [172.657785] ? __pfx_worker_thread+0x10/0x10
<4> [172.657788] kthread+0x10d/0x150
<4> [172.657791] ? __pfx_kthread+0x10/0x10
<4> [172.657795] ret_from_fork+0x3d4/0x480
<4> [172.657797] ? __pfx_kthread+0x10/0x10
<4> [172.657800] ret_from_fork_asm+0x1a/0x30
<4> [172.657808] </TASK>
<4> [172.657809] irq event stamp: 516969
<4> [172.657810] hardirqs last enabled at (516975): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.657813] hardirqs last disabled at (516980): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.657815] softirqs last enabled at (512916): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.657818] softirqs last disabled at (512883): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.657821] ---[ end trace 0000000000000000 ]---
<6> [172.657823] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.657898] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.657905] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.658316] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.658675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.658766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.658860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.658949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.659037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.659123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.659226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.659321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.659407] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.659504] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.659621] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.660631] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.671187] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.671438] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.672471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.672550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.672627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.672707] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.672787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.672862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.672937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.673013] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.673086] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.673161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.673251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.673325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.673399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.673472] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.673550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.673626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.673701] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.673776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.673850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.673931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.674012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.674092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.674172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.674269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.674350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.674429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.674508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.674588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.674669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.674749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.674828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.674908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.674991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.675075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.675159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.675251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.675331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.675408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.675485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.675560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.675640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.675721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.675803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.675882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.675964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.676041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.676118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.676200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.676279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.676355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.676430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.676509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.676591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.676671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.676750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.676828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.676904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.676981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.677060] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.677642] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.677647] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1965, lrc_seqno=1965, guc_id=0, flags=0x73 in no process [-1]
<7> [172.677649] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.677709] ------------[ cut here ]------------
<4> [172.677710] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.677712] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:10/1982
<4> [172.677784] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.677854] autofs4 [last unloaded: xe]
<4> [172.677859] CPU: 0 UID: 0 PID: 1982 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.677862] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.677863] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.677865] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.677870] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.677941] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.677943] RSP: 0018:ffffc90003d43ca0 EFLAGS: 00010246
<4> [172.677945] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.677947] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.677948] RBP: ffffc90003d43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.677950] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.677951] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.677953] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [172.677955] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.677956] CR2: 00007a1124d14000 CR3: 000000000344c003 CR4: 0000000000f72ef0
<4> [172.677958] PKRU: 55555554
<4> [172.677959] Call Trace:
<4> [172.677960] <TASK>
<4> [172.677965] ? lock_sync+0x100/0x100
<4> [172.677969] ? lock_release+0xd0/0x2b0
<4> [172.677975] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.677981] process_one_work+0x239/0x760
<4> [172.677987] worker_thread+0x200/0x3f0
<4> [172.677990] ? __pfx_worker_thread+0x10/0x10
<4> [172.677993] kthread+0x10d/0x150
<4> [172.677996] ? __pfx_kthread+0x10/0x10
<4> [172.678000] ret_from_fork+0x3d4/0x480
<4> [172.678002] ? __pfx_kthread+0x10/0x10
<4> [172.678006] ret_from_fork_asm+0x1a/0x30
<4> [172.678013] </TASK>
<4> [172.678014] irq event stamp: 523163
<4> [172.678016] hardirqs last enabled at (523169): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.678019] hardirqs last disabled at (523174): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.678021] softirqs last enabled at (521296): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.678024] softirqs last disabled at (521291): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.678026] ---[ end trace 0000000000000000 ]---
<6> [172.678028] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.678098] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.678105] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.678515] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.678868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.678958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.679052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.679141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.679246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.679334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.679423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.679516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.679601] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.679698] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.679815] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.680824] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.691185] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.691454] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.692565] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.692645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.692722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.692799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.692875] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.692951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.693028] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.693106] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.693187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.693269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.693344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.693419] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.693494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.693568] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.693642] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.693715] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.693789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.693863] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.693936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.694016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.694097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.694184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.694271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.694352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.694431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.694508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.694586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.694666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.694746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.694825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.694904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.694982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.695066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.695150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.695248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.695333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.695419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.695500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.695579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.695657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.695737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.695815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.695892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.695968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.696048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.696125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.696215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.696293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.696373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.696451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.696529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.696609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.696686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.696764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.696840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.696920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.697000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.697077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.697159] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.697750] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.697754] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=1965, lrc_seqno=1965, guc_id=0, flags=0x73 in no process [-1]
<7> [172.697757] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.697816] ------------[ cut here ]------------
<4> [172.697817] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.697818] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:10/1982
<4> [172.697890] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.697954] autofs4 [last unloaded: xe]
<4> [172.697958] CPU: 0 UID: 0 PID: 1982 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.697960] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.697962] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.697963] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.697968] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.698038] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.698039] RSP: 0018:ffffc90003d43ca0 EFLAGS: 00010246
<4> [172.698042] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.698043] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.698044] RBP: ffffc90003d43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.698045] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.698047] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.698048] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [172.698050] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.698051] CR2: 00007a1124d14000 CR3: 000000000344c003 CR4: 0000000000f72ef0
<4> [172.698052] PKRU: 55555554
<4> [172.698053] Call Trace:
<4> [172.698055] <TASK>
<4> [172.698058] ? lock_sync+0x100/0x100
<4> [172.698063] ? lock_release+0xd0/0x2b0
<4> [172.698068] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.698074] process_one_work+0x239/0x760
<4> [172.698080] worker_thread+0x200/0x3f0
<4> [172.698082] ? __pfx_worker_thread+0x10/0x10
<4> [172.698085] kthread+0x10d/0x150
<4> [172.698088] ? __pfx_kthread+0x10/0x10
<4> [172.698091] ret_from_fork+0x3d4/0x480
<4> [172.698093] ? __pfx_kthread+0x10/0x10
<4> [172.698096] ret_from_fork_asm+0x1a/0x30
<4> [172.698104] </TASK>
<4> [172.698105] irq event stamp: 529357
<4> [172.698106] hardirqs last enabled at (529363): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.698109] hardirqs last disabled at (529368): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.698111] softirqs last enabled at (527570): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.698113] softirqs last disabled at (527563): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.698116] ---[ end trace 0000000000000000 ]---
<7> [172.699647] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [172.699758] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [172.700438] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2020, lrc_seqno=2020, guc_id=0, flags=0x73 in no process [-1]
<7> [172.700445] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.700557] ------------[ cut here ]------------
<4> [172.700559] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.700561] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#14: kworker/u64:3/191
<4> [172.700679] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.700772] autofs4 [last unloaded: xe]
<4> [172.700777] CPU: 14 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.700781] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.700783] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.700785] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.700793] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.700907] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.700909] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246
<4> [172.700912] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.700915] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.700917] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.700918] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.700920] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.700922] FS: 0000000000000000(0000) GS:ffff8888db397000(0000) knlGS:0000000000000000
<4> [172.700925] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.700926] CR2: 00007a111d234000 CR3: 00000001be638004 CR4: 0000000000f72ef0
<4> [172.700929] PKRU: 55555554
<4> [172.700930] Call Trace:
<4> [172.700932] <TASK>
<4> [172.700939] ? lock_sync+0x100/0x100
<4> [172.700946] ? lock_release+0xd0/0x2b0
<4> [172.700955] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.700964] process_one_work+0x239/0x760
<4> [172.700974] worker_thread+0x200/0x3f0
<4> [172.700978] ? __pfx_worker_thread+0x10/0x10
<4> [172.700982] kthread+0x10d/0x150
<4> [172.700986] ? __pfx_kthread+0x10/0x10
<4> [172.700991] ret_from_fork+0x3d4/0x480
<4> [172.700994] ? __pfx_kthread+0x10/0x10
<4> [172.700999] ret_from_fork_asm+0x1a/0x30
<4> [172.701011] </TASK>
<4> [172.701013] irq event stamp: 593623
<4> [172.701014] hardirqs last enabled at (593629): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.701018] hardirqs last disabled at (593634): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.701021] softirqs last enabled at (592166): [<ffffffff8133ac13>] kernel_fpu_end+0x53/0x70
<4> [172.701025] softirqs last disabled at (592164): [<ffffffff8133b324>] kernel_fpu_begin_mask+0xc4/0x120
<4> [172.701028] ---[ end trace 0000000000000000 ]---
<6> [172.701031] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.701144] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.701155] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.701198] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.701804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.701940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.702078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.702216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.702335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.702449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.702566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.702704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.702824] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.702961] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.703127] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.704406] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.714202] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.714505] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.716124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.716276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.716369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.716483] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.716560] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.716647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.716762] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.716874] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.716964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.717048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.717133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.717407] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.717490] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.717580] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.717670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.717754] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.717874] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.717958] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.718043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.718128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.718222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.718304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.718387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.718466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.718545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.718625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.718704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.718785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.718877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.718958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.719045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.719138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.719259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.719653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.719743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.719828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.719909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.719988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.720068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.720149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.720240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.720320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.720398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.720475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.720556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.720634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.720717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.720798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.720879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.720957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.721034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.721114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.721197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.721275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.721355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.721440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.721520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.721599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.721679] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.722385] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.722391] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2020, lrc_seqno=2020, guc_id=0, flags=0x73 in no process [-1]
<7> [172.722394] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.722503] ------------[ cut here ]------------
<4> [172.722504] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.722506] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:10/1982
<4> [172.722579] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.722647] autofs4 [last unloaded: xe]
<4> [172.722652] CPU: 10 UID: 0 PID: 1982 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.722656] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.722657] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.722659] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.722665] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.722735] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.722736] RSP: 0018:ffffc90003d43ca0 EFLAGS: 00010246
<4> [172.722739] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.722740] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.722742] RBP: ffffc90003d43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.722743] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.722744] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.722745] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [172.722747] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.722748] CR2: 00007a111d234000 CR3: 000000000344c003 CR4: 0000000000f72ef0
<4> [172.722750] PKRU: 55555554
<4> [172.722751] Call Trace:
<4> [172.722752] <TASK>
<4> [172.722757] ? lock_sync+0x100/0x100
<4> [172.722762] ? lock_release+0xd0/0x2b0
<4> [172.722767] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.722773] process_one_work+0x239/0x760
<4> [172.722780] worker_thread+0x200/0x3f0
<4> [172.722782] ? __pfx_worker_thread+0x10/0x10
<4> [172.722785] kthread+0x10d/0x150
<4> [172.722788] ? __pfx_kthread+0x10/0x10
<4> [172.722792] ret_from_fork+0x3d4/0x480
<4> [172.722794] ? __pfx_kthread+0x10/0x10
<4> [172.722798] ret_from_fork_asm+0x1a/0x30
<4> [172.722805] </TASK>
<4> [172.722806] irq event stamp: 536831
<4> [172.722807] hardirqs last enabled at (536837): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.722810] hardirqs last disabled at (536842): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.722813] softirqs last enabled at (534844): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.722816] softirqs last disabled at (534839): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.722818] ---[ end trace 0000000000000000 ]---
<6> [172.722820] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.722891] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.722898] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.722964] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.723701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.723839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.723950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.724042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.724139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.724244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.724340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.724434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.724531] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.724627] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.724772] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.726003] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.736193] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.736472] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.737705] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.737791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.737869] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.737963] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.738078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.738163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.738256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.738347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.738432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.738529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.738607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.738858] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.738942] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.739056] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.739172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.739287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.739374] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.739464] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.739542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.739624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.739706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.739789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.739872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.739951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.740029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.740115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.740197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.740284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.740380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.740463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.740546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.740631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.740767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.740877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.740996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.741081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.741161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.741251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.741334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.741414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.741496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.741575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.741654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.741732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.741814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.741890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.741968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.742045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.742123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.742222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.742304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.742385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.742464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.742542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.742619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.742699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.742779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.742859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.742941] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.743581] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.743586] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2020, lrc_seqno=2020, guc_id=0, flags=0x73 in no process [-1]
<7> [172.743589] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.743648] ------------[ cut here ]------------
<4> [172.743650] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.743651] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:10/1982
<4> [172.743736] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.743803] autofs4 [last unloaded: xe]
<4> [172.743808] CPU: 10 UID: 0 PID: 1982 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.743810] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.743812] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.743813] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.743818] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.743890] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.743892] RSP: 0018:ffffc90003d43ca0 EFLAGS: 00010246
<4> [172.743894] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.743896] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.743897] RBP: ffffc90003d43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.743898] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.743899] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.743901] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [172.743902] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.743904] CR2: 00007a111d234000 CR3: 000000015a2ce003 CR4: 0000000000f72ef0
<4> [172.743905] PKRU: 55555554
<4> [172.743906] Call Trace:
<4> [172.743908] <TASK>
<4> [172.743911] ? lock_sync+0x100/0x100
<4> [172.743916] ? lock_release+0xd0/0x2b0
<4> [172.743922] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.743927] process_one_work+0x239/0x760
<4> [172.743933] worker_thread+0x200/0x3f0
<4> [172.743936] ? __pfx_worker_thread+0x10/0x10
<4> [172.743939] kthread+0x10d/0x150
<4> [172.743941] ? __pfx_kthread+0x10/0x10
<4> [172.743945] ret_from_fork+0x3d4/0x480
<4> [172.743947] ? __pfx_kthread+0x10/0x10
<4> [172.743950] ret_from_fork_asm+0x1a/0x30
<4> [172.743958] </TASK>
<4> [172.743959] irq event stamp: 543111
<4> [172.743960] hardirqs last enabled at (543117): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.743963] hardirqs last disabled at (543122): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.743965] softirqs last enabled at (541256): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.743968] softirqs last disabled at (541177): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.743970] ---[ end trace 0000000000000000 ]---
<5> [172.745532] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2075, lrc_seqno=2075, guc_id=0, flags=0x73 in no process [-1]
<7> [172.745540] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.745640] ------------[ cut here ]------------
<4> [172.745642] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.745645] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:1/118
<4> [172.745746] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.745851] autofs4 [last unloaded: xe]
<4> [172.745857] CPU: 2 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.745862] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.745864] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.745866] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<7> [172.745840] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<4> [172.745875] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.745976] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.745979] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [172.745982] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.745984] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.745986] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.745988] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.745989] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.745991] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [172.745993] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.745995] CR2: 00007a111d234000 CR3: 00000001e07b5004 CR4: 0000000000f72ef0
<4> [172.745997] PKRU: 55555554
<4> [172.745999] Call Trace:
<4> [172.746001] <TASK>
<7> [172.745957] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<4> [172.746009] ? lock_sync+0x100/0x100
<4> [172.746017] ? lock_release+0xd0/0x2b0
<4> [172.746025] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.746033] process_one_work+0x239/0x760
<4> [172.746045] worker_thread+0x200/0x3f0
<4> [172.746050] ? __pfx_worker_thread+0x10/0x10
<4> [172.746054] kthread+0x10d/0x150
<4> [172.746059] ? __pfx_kthread+0x10/0x10
<4> [172.746065] ret_from_fork+0x3d4/0x480
<4> [172.746068] ? __pfx_kthread+0x10/0x10
<4> [172.746074] ret_from_fork_asm+0x1a/0x30
<4> [172.746085] </TASK>
<4> [172.746087] irq event stamp: 520081
<4> [172.746089] hardirqs last enabled at (520087): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.746094] hardirqs last disabled at (520092): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.746097] softirqs last enabled at (518430): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.746101] softirqs last disabled at (518421): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.746106] ---[ end trace 0000000000000000 ]---
<6> [172.746109] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.746232] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.746246] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.746326] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.747886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.748041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.748187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.749180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.749326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.749859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.750044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.750303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.750636] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.750733] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.751184] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.752638] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.763577] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.764108] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.766002] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.766092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.766170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.766309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.766411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.766511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.766615] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.767183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.767593] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.767699] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.767905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.768183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.768478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.768569] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.768753] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.768845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.768952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.769051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.769185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.769271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.769354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.769435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.769517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.769596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.769675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.769753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.769831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.769913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.770052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.770183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.770552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.770948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.771351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.771552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.771766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.771871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.771952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.772030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.772109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.772199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.772288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.772369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.772448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.772525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.772606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.772683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.772766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.772918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.773044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.773123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.773220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.773307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.773387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.773465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.773543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.773622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.773698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.773774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.773855] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.774578] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.774583] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2075, lrc_seqno=2075, guc_id=0, flags=0x73 in no process [-1]
<7> [172.774586] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.774652] ------------[ cut here ]------------
<4> [172.774653] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.774655] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#1: kworker/u64:10/1982
<4> [172.774772] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.774838] autofs4 [last unloaded: xe]
<4> [172.774842] CPU: 1 UID: 0 PID: 1982 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.774846] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.774847] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.774849] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.774855] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.774926] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.774928] RSP: 0018:ffffc90003d43ca0 EFLAGS: 00010246
<4> [172.774930] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.774932] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.774933] RBP: ffffc90003d43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.774934] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.774935] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.774937] FS: 0000000000000000(0000) GS:ffff8888dad17000(0000) knlGS:0000000000000000
<4> [172.774938] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.774940] CR2: 000055e00f415250 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [172.774941] PKRU: 55555554
<4> [172.774943] Call Trace:
<4> [172.774944] <TASK>
<4> [172.774949] ? lock_sync+0x100/0x100
<4> [172.774953] ? lock_release+0xd0/0x2b0
<4> [172.774959] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.774964] process_one_work+0x239/0x760
<4> [172.774970] worker_thread+0x200/0x3f0
<4> [172.774973] ? __pfx_worker_thread+0x10/0x10
<4> [172.774976] kthread+0x10d/0x150
<4> [172.774979] ? __pfx_kthread+0x10/0x10
<4> [172.774982] ret_from_fork+0x3d4/0x480
<4> [172.774984] ? __pfx_kthread+0x10/0x10
<4> [172.774988] ret_from_fork_asm+0x1a/0x30
<4> [172.774995] </TASK>
<4> [172.774996] irq event stamp: 549693
<4> [172.774997] hardirqs last enabled at (549699): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.775001] hardirqs last disabled at (549704): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.775003] softirqs last enabled at (548330): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.775006] softirqs last disabled at (548323): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.775008] ---[ end trace 0000000000000000 ]---
<6> [172.775010] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.775085] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.775095] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.775174] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.778121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.778273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.778377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.778525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.778721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.778829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.778969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.779122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.779229] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.779327] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.779569] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.781099] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.791212] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.791606] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.795033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.795188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.795312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.796184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.796950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.797099] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.798008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.798185] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.798485] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.799188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.799894] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.800181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.800676] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.801186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.801424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.801570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.801882] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.802153] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.802357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.802485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.802612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.802736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.802863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.802988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.803118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.803248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.803372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.803500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.804022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.804185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.804783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.805002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.805169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.805352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.805536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.805774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.805903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.806028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.806153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.806282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.806413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.806540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.806668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.806792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.806922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.807048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.807174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.807303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.807430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.807553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.807676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.807804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.807929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.808054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.808182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.808311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.808435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.808559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.808687] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.810097] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.810105] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2075, lrc_seqno=2075, guc_id=0, flags=0x73 in no process [-1]
<7> [172.810108] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.810254] ------------[ cut here ]------------
<4> [172.810256] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.810257] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:10/1982
<4> [172.810339] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.810411] autofs4 [last unloaded: xe]
<4> [172.810416] CPU: 6 UID: 0 PID: 1982 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.810419] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.810420] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.810422] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.810427] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.810499] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.810500] RSP: 0000:ffffc90003d43ca0 EFLAGS: 00010246
<4> [172.810503] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.810504] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.810506] RBP: ffffc90003d43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.810507] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.810508] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.810509] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [172.810511] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.810512] CR2: 00007a111d224000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [172.810514] PKRU: 55555554
<4> [172.810515] Call Trace:
<4> [172.810516] <TASK>
<4> [172.810520] ? lock_sync+0x100/0x100
<4> [172.810526] ? lock_release+0xd0/0x2b0
<4> [172.810531] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.810537] process_one_work+0x239/0x760
<4> [172.810544] worker_thread+0x200/0x3f0
<4> [172.810547] ? __pfx_worker_thread+0x10/0x10
<4> [172.810549] kthread+0x10d/0x150
<4> [172.810552] ? __pfx_kthread+0x10/0x10
<4> [172.810556] ret_from_fork+0x3d4/0x480
<4> [172.810558] ? __pfx_kthread+0x10/0x10
<4> [172.810561] ret_from_fork_asm+0x1a/0x30
<4> [172.810569] </TASK>
<4> [172.810571] irq event stamp: 555965
<4> [172.810572] hardirqs last enabled at (555971): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.810575] hardirqs last disabled at (555976): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.810577] softirqs last enabled at (555202): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.810580] softirqs last disabled at (555195): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.810582] ---[ end trace 0000000000000000 ]---
<5> [172.811130] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2100, lrc_seqno=2100, guc_id=0, flags=0x73 in no process [-1]
<7> [172.811140] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.811315] ------------[ cut here ]------------
<4> [172.811319] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.811323] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#13: kworker/u64:13/4148
<4> [172.811460] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.811565] autofs4 [last unloaded: xe]
<4> [172.811572] CPU: 13 UID: 0 PID: 4148 Comm: kworker/u64:13 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.811576] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.811577] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.811580] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.811590] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.811707] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.811709] RSP: 0000:ffffc90002a0bca0 EFLAGS: 00010246
<4> [172.811713] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.811715] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.811717] RBP: ffffc90002a0bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.811718] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.811720] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.811722] FS: 0000000000000000(0000) GS:ffff8888db317000(0000) knlGS:0000000000000000
<4> [172.811724] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.811726] CR2: 00007a1119cb4000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [172.811729] PKRU: 55555554
<4> [172.811730] Call Trace:
<4> [172.811732] <TASK>
<4> [172.811739] ? lock_sync+0x100/0x100
<4> [172.811747] ? lock_release+0xd0/0x2b0
<4> [172.811756] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.811765] process_one_work+0x239/0x760
<4> [172.811776] worker_thread+0x200/0x3f0
<4> [172.811781] ? __pfx_worker_thread+0x10/0x10
<4> [172.811784] kthread+0x10d/0x150
<4> [172.811788] ? __pfx_kthread+0x10/0x10
<4> [172.811793] ret_from_fork+0x3d4/0x480
<4> [172.811797] ? __pfx_kthread+0x10/0x10
<4> [172.811802] ret_from_fork_asm+0x1a/0x30
<4> [172.811814] </TASK>
<4> [172.811816] irq event stamp: 274483
<4> [172.811818] hardirqs last enabled at (274489): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.811822] hardirqs last disabled at (274494): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.811825] softirqs last enabled at (272986): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.811829] softirqs last disabled at (272979): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.811832] ---[ end trace 0000000000000000 ]---
<6> [172.811835] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.811954] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.811974] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.812072] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<6> [172.812238] xe 0000:03:00.0: [drm] exec queue reset detected
<6> [172.812254] xe 0000:03:00.0: [drm] exec queue reset detected
<6> [172.812262] xe 0000:03:00.0: [drm] exec queue reset detected
<6> [172.812282] xe 0000:03:00.0: [drm] exec queue reset detected
<7> [172.812253] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [172.812394] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.813470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.813617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.813720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.813809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.813910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.814057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.814160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.814288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<6> [172.814422] xe 0000:03:00.0: [drm] exec queue reset detected
<7> [172.814388] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<6> [172.814447] xe 0000:03:00.0: [drm] exec queue reset detected
<7> [172.814486] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.814836] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.816314] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.826232] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.826620] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.829182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.829322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.829471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.829643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.829898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.830162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.830454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.830586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.830709] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.830929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.831185] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.831315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.831437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.831626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.831838] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.832189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.832404] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.832580] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.832709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.832838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.832966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.833092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.833232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.833361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.833488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.833613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.833741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.833872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.834032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.834186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.834963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.835186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.835401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.836082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.836296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.836550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.836681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.836810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.836940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.837066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.837210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.837342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.837471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.837598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.837730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.837860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.837991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.838122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.838262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.838392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.838522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.838659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.838788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.838916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.839046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.839186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.839321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.839449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.839582] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<7> [172.840182] xe 0000:03:00.0: [drm:xe_sync_entry_parse [xe]] Ioctl argument check failed at drivers/gpu/drm/xe/xe_sync.c:206: IS_ERR(sync->ufence)
<7> [172.840185] xe 0000:03:00.0: [drm:xe_sync_entry_parse [xe]] Ioctl argument check failed at drivers/gpu/drm/xe/xe_sync.c:206: IS_ERR(sync->ufence)
<6> [172.840668] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.840677] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2100, lrc_seqno=2100, guc_id=0, flags=0x73 in no process [-1]
<7> [172.840681] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.840794] ------------[ cut here ]------------
<4> [172.840796] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.840798] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:13/4148
<4> [172.840912] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.841013] autofs4 [last unloaded: xe]
<4> [172.841020] CPU: 12 UID: 0 PID: 4148 Comm: kworker/u64:13 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.841024] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.841026] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.841029] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.841037] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.841151] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.841154] RSP: 0018:ffffc90002a0bca0 EFLAGS: 00010246
<4> [172.841157] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.841159] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.841161] RBP: ffffc90002a0bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.841163] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.841165] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.841167] FS: 0000000000000000(0000) GS:ffff8888db297000(0000) knlGS:0000000000000000
<4> [172.841169] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.841171] CR2: 00007a1116605e28 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [172.841173] PKRU: 55555554
<4> [172.841182] Call Trace:
<4> [172.841184] <TASK>
<4> [172.841191] ? lock_sync+0x100/0x100
<4> [172.841200] ? lock_release+0xd0/0x2b0
<4> [172.841209] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.841220] process_one_work+0x239/0x760
<4> [172.841231] worker_thread+0x200/0x3f0
<4> [172.841235] ? __pfx_worker_thread+0x10/0x10
<4> [172.841239] kthread+0x10d/0x150
<4> [172.841243] ? __pfx_kthread+0x10/0x10
<4> [172.841249] ret_from_fork+0x3d4/0x480
<4> [172.841253] ? __pfx_kthread+0x10/0x10
<4> [172.841258] ret_from_fork_asm+0x1a/0x30
<4> [172.841271] </TASK>
<4> [172.841273] irq event stamp: 280747
<4> [172.841275] hardirqs last enabled at (280753): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.841279] hardirqs last disabled at (280758): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.841282] softirqs last enabled at (278824): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.841286] softirqs last disabled at (278813): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.841290] ---[ end trace 0000000000000000 ]---
<6> [172.841293] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [172.841411] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [172.841420] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [172.841469] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [172.842095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [172.842146] xe 0000:03:00.0: [drm:xe_sync_entry_parse [xe]] Ioctl argument check failed at drivers/gpu/drm/xe/xe_sync.c:206: IS_ERR(sync->ufence)
<7> [172.842268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [172.842422] xe 0000:03:00.0: [drm:xe_sync_entry_parse [xe]] Ioctl argument check failed at drivers/gpu/drm/xe/xe_sync.c:206: IS_ERR(sync->ufence)
<7> [172.842428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [172.842466] xe 0000:03:00.0: [drm:xe_sync_entry_parse [xe]] Ioctl argument check failed at drivers/gpu/drm/xe/xe_sync.c:206: IS_ERR(sync->ufence)
<7> [172.842574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [172.842716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [172.842854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [172.842998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [172.843137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [172.843280] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [172.843428] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [172.843607] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [172.845556] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [172.846391] xe 0000:03:00.0: [drm:xe_sync_entry_parse [xe]] Ioctl argument check failed at drivers/gpu/drm/xe/xe_sync.c:206: IS_ERR(sync->ufence)
<7> [172.851217] xe 0000:03:00.0: [drm:xe_sync_entry_parse [xe]] Ioctl argument check failed at drivers/gpu/drm/xe/xe_sync.c:206: IS_ERR(sync->ufence)
<6> [172.855875] [IGT] xe_compute_preempt: finished subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE, FAIL
<6> [172.856652] [IGT] xe_compute_preempt: finished subtest compute-preempt-many-vram, FAIL
<7> [172.857500] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 11ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [172.857842] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [172.859129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [172.859261] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [172.859383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [172.859507] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [172.859630] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [172.859753] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [172.859875] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [172.859998] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [172.860120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [172.860248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [172.860370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [172.860491] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [172.860613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [172.860734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [172.860855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [172.860989] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [172.861080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [172.861163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [172.861447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [172.861533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [172.861616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [172.861698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [172.861781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [172.861860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [172.861938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [172.862016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [172.862094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [172.862174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [172.862555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [172.862651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [172.862745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [172.862837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [172.862961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [172.863084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [172.864250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [172.864399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [172.864536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [172.864666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [172.864796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [172.864922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [172.865053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [172.865209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [172.865313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [172.865405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [172.865501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [172.865594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [172.865686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [172.865778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [172.865872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [172.865963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [172.866058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [172.866160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [172.866268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [172.866350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [172.866433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [172.866515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [172.866595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [172.866673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [172.866754] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [172.867292] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [172.867346] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2100, lrc_seqno=2100, guc_id=0, flags=0x73 in no process [-1]
<7> [172.867349] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [172.867435] ------------[ cut here ]------------
<4> [172.867437] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [172.867438] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:13/4148
<4> [172.867532] Modules linked in: xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor eeepc_wmi asus_wmi mei_hdcp mtd mei_pxp sparse_keymap platform_profile wmi_bmof binfmt_misc kvm_intel kvm usbhid irqbypass hid ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep realtek snd_pcm i2c_i801 snd_timer i2c_mux spi_intel_pci snd mei_me soundcore spi_intel i2c_smbus idma64 mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry acpi_pad wmi pinctrl_alderlake intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [172.867609] autofs4 [last unloaded: xe]
<4> [172.867613] CPU: 4 UID: 0 PID: 4148 Comm: kworker/u64:13 Tainted: G S U W 7.0.0-lgci-xe-xe-4898-bf1886f46aceb23fd-debug+ #1 PREEMPT(lazy)
<4> [172.867617] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [172.867618] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [172.867620] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [172.867626] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [172.867708] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 e6 d8 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [172.867711] RSP: 0018:ffffc90002a0bca0 EFLAGS: 00010246
<4> [172.867714] RAX: ffffffffa120433b RBX: 0000000000000000 RCX: 0000000000000000
<4> [172.867716] RDX: ffff8881116e8590 RSI: ffffffffa120433b RDI: ffffffffa1003ee0
<4> [172.867718] RBP: ffffc90002a0bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [172.867719] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [172.867721] R13: ffff8881116e8590 R14: ffff8881ac798818 R15: 00000000ffffffc2
<4> [172.867722] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [172.867724] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [172.867726] CR2: 00007a1116ff4000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [172.867728] PKRU: 55555554
<4> [172.867730] Call Trace:
<4> [172.867732] <TASK>
<4> [172.867739] ? lock_sync+0x100/0x100
<4> [172.867746] ? lock_release+0xd0/0x2b0
<4> [172.867753] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [172.867760] process_one_work+0x239/0x760
<4> [172.867769] worker_thread+0x200/0x3f0
<4> [172.867772] ? __pfx_worker_thread+0x10/0x10
<4> [172.867776] kthread+0x10d/0x150
<4> [172.867779] ? __pfx_kthread+0x10/0x10
<4> [172.867784] ret_from_fork+0x3d4/0x480
<4> [172.867787] ? __pfx_kthread+0x10/0x10
<4> [172.867791] ret_from_fork_asm+0x1a/0x30
<4> [172.867800] </TASK>
<4> [172.867802] irq event stamp: 287661
<4> [172.867804] hardirqs last enabled at (287667): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [172.867807] hardirqs last disabled at (287672): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [172.867810] softirqs last enabled at (286596): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.867813] softirqs last disabled at (286591): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [172.867816] ---[ end trace 0000000000000000 ]---
<7> [172.872897] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [172.873021] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [172.954584] xe 0000:03:00.0: [drm:drm_client_dev_restore] fbdev: ret=0
<6> [172.956012] [IGT] xe_compute_preempt: exiting, ret=98
<6> [172.971925] Console: switching to colour frame buffer device 240x67
|