Result: 381 Warning(s)
i915_display_info3 igt_runner3 results3.json results3-xe-load.json guc_logs3.tar i915_display_info_post_exec3 boot3 dmesg3
| Detail | Value |
|---|---|
| Duration | unknown |
| Hostname |
shard-bmg-2 |
| Igt-Version |
IGT-Version: 2.4-g5b279a8b7 (x86_64) (Linux: 7.0.0-lgci-xe-xe-pw-165069v1-debug+ x86_64) |
| Out |
Using IGT_SRANDOM=1776713051 for randomisation Opened device: /dev/dri/card0 Starting subtest: primary-x-tiled-reflect-x-0 runner: This test was killed due to a kernel taint (0x4244). runner: This test was killed due to exceeding disk usage limit. (Used 10579960 bytes, limit 10485760) This test caused an abort condition: Kernel badly tainted (0x4244, 0x200) (check dmesg for details): TAINT_WARN: WARN_ON has happened. |
| Err |
Starting subtest: primary-x-tiled-reflect-x-0 Received signal SIGQUIT. Stack trace: #0 [fatal_sig_handler+0x17b] #1 [__sigaction+0x50] #2 [ioctl+0x3d] #3 [drmIoctl+0x30] #4 [xe_vm_destroy+0x4f] #5 [cleanup_blt_resources+0xa0] #6 [blitcopy+0x270] #7 [setup_linear_mapping+0x21b] #8 [create_cairo_surface__gpu+0x36] #9 [igt_get_cairo_surface+0x88] #10 [igt_get_cairo_ctx+0xf] #11 [paint_squares.constprop.0+0x3a] #12 [test_single_case.constprop.0+0x4ca] #13 [test_plane_rotation.constprop.0+0x691] #14 [__igt_unique____real_main1200+0x467] #15 [main+0x45] #16 [__libc_init_first+0x8a] #17 [__libc_start_main+0x8b] #18 [_start+0x25] |
| Dmesg |
<6> [488.142087] Console: switching to colour dummy device 80x25
<6> [488.142400] [IGT] kms_rotation_crc: executing
<7> [488.155635] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:508:DP-1]
<7> [488.155644] xe 0000:03:00.0: [drm:intel_dp_detect [xe]] [CONNECTOR:508:DP-1]
<7> [488.159899] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:508:DP-1] disconnected
<7> [488.160226] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:521:HDMI-A-1]
<7> [488.160230] xe 0000:03:00.0: [drm:intel_hdmi_detect [xe]] [CONNECTOR:521:HDMI-A-1]
<7> [488.164366] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:521:HDMI-A-1] disconnected
<7> [488.164820] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:535:HDMI-A-2]
<7> [488.164823] xe 0000:03:00.0: [drm:intel_hdmi_detect [xe]] [CONNECTOR:535:HDMI-A-2]
<7> [488.165286] xe 0000:03:00.0: [drm:do_gmbus_xfer [xe]] GMBUS [i915 gmbus tc2] NAK for addr: 0050 w(1)
<7> [488.165388] xe 0000:03:00.0: [drm:do_gmbus_xfer [xe]] GMBUS [i915 gmbus tc2] NAK on first message, retry
<7> [488.165845] xe 0000:03:00.0: [drm:do_gmbus_xfer [xe]] GMBUS [i915 gmbus tc2] NAK for addr: 0050 w(1)
<7> [488.165948] [drm:drm_do_probe_ddc_edid] drm: skipping non-existent adapter i915 gmbus tc2
<7> [488.165952] xe 0000:03:00.0: [drm:intel_hdmi_set_edid [xe]] HDMI GMBUS EDID read failed, retry using GPIO bit-banging
<7> [488.166052] xe 0000:03:00.0: [drm:intel_gmbus_force_bit [xe]] enabling bit-banging on i915 gmbus tc2. force bit now 1
<7> [488.167410] [drm:drm_do_probe_ddc_edid] drm: skipping non-existent adapter i915 gmbus tc2
<7> [488.167413] xe 0000:03:00.0: [drm:intel_gmbus_force_bit [xe]] disabling bit-banging on i915 gmbus tc2. force bit now 0
<7> [488.167519] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:535:HDMI-A-2] disconnected
<7> [488.167960] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:543:DP-3]
<7> [488.167964] xe 0000:03:00.0: [drm:intel_dp_detect [xe]] [CONNECTOR:543:DP-3]
<7> [488.172257] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:543:DP-3] disconnected
<7> [488.172604] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:551:HDMI-A-4]
<7> [488.172608] xe 0000:03:00.0: [drm:intel_hdmi_detect [xe]] [CONNECTOR:551:HDMI-A-4]
<7> [488.176732] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:551:HDMI-A-4] disconnected
<7> [488.177215] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:508:DP-1]
<7> [488.177219] xe 0000:03:00.0: [drm:intel_dp_detect [xe]] [CONNECTOR:508:DP-1]
<7> [488.181778] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:508:DP-1] disconnected
<7> [488.181790] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:521:HDMI-A-1]
<7> [488.181794] xe 0000:03:00.0: [drm:intel_hdmi_detect [xe]] [CONNECTOR:521:HDMI-A-1]
<7> [488.185935] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:521:HDMI-A-1] disconnected
<7> [488.185947] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:527:DP-2]
<7> [488.185952] xe 0000:03:00.0: [drm:intel_dp_detect [xe]] [CONNECTOR:527:DP-2]
<7> [488.186287] xe 0000:03:00.0: [drm:intel_power_well_enable [xe]] enabling AUX_TC2
<7> [488.189043] xe 0000:03:00.0: [drm:drm_dp_read_dpcd_caps [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: DPCD: 12 14 c4 01 01 15 01 81 02 01 04 01 0f 00 01
<7> [488.194547] xe 0000:03:00.0: [drm:intel_dp_init_lttpr_and_dprx_caps [xe]] [CONNECTOR:527:DP-2][ENCODER:526:DDI TC2/PHY G][DPRX] LTTPR common capabilities: 00 00 00 00 00 00 00 00
<7> [488.195752] xe 0000:03:00.0: [drm:drm_dp_read_dpcd_caps [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: DPCD: 12 14 c4 01 01 15 01 81 02 01 04 01 0f 00 01
<7> [488.196702] xe 0000:03:00.0: [drm:drm_dp_dump_desc [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: DP branch: OUI 00-1c-f8 dev-ID 176GB0 HW-rev 1.0 SW-rev 7.38 quirks 0x0000
<7> [488.198823] xe 0000:03:00.0: [drm:drm_dp_read_downstream_info [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: DPCD DFP: 0b f0 02 11
<7> [488.199674] xe 0000:03:00.0: [drm:intel_dp_detect [xe]] [ENCODER:526:DDI TC2/PHY G] MST support: port: yes, sink: SST, modparam: yes -> enable: SST
<7> [488.204610] xe 0000:03:00.0: [drm:intel_dp_print_rates [xe]] source rates: 162000, 216000, 243000, 270000, 324000, 432000, 540000, 675000, 810000, 1000000
<7> [488.204812] xe 0000:03:00.0: [drm:intel_dp_print_rates [xe]] sink rates: 162000, 270000, 540000
<7> [488.205002] xe 0000:03:00.0: [drm:intel_dp_print_rates [xe]] common rates: 162000, 270000, 540000
<7> [488.209105] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] HDMI: DVI dual 0, max TMDS clock 300000 kHz
<7> [488.209112] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] HDMI sink does deep color 30.
<7> [488.209116] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] HDMI sink does deep color 36.
<7> [488.209119] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] HDMI sink does deep color 48.
<7> [488.209122] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] Assigning HDMI sink color depth as 16 bpc.
<7> [488.209126] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] HDMI sink does YCRCB444 in deep color.
<7> [488.209130] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] DisplayID extension version 0x10, primary use 0x03
<7> [488.209135] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] ELD monitor DPF90435
<7> [488.209139] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] HDMI: latency present 0 0, video latency 0 0, audio latency 0 0
<7> [488.209144] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] ELD size 40, SAD count 3
<7> [488.209148] xe 0000:03:00.0: [drm:drm_edid_connector_update] [CONNECTOR:527:DP-2] tile cap 0x9, size 1920x1080, num tiles 2x1, location 0x0, vend IGT
<7> [488.209182] xe 0000:03:00.0: [drm:intel_dp_set_edid [xe]] [CONNECTOR:527:DP-2] VRR capable: no
<7> [488.209365] xe 0000:03:00.0: [drm:intel_dp_set_edid [xe]] [CONNECTOR:527:DP-2] DFP max bpc 12, max dotclock 0, TMDS clock 25000-600000, PCON Max FRL BW 0Gbps
<7> [488.210392] xe 0000:03:00.0: [drm:intel_dp_set_edid [xe]] PCON ENCODER DSC DPCD: 00 00 00 00 00 00 00 00 00 00 00 00 00
<7> [488.210570] xe 0000:03:00.0: [drm:intel_dp_set_edid [xe]] [CONNECTOR:527:DP-2] RGB->YcbCr conversion? no, YCbCr 4:2:0 allowed? no, YCbCr 4:4:4->4:2:0 conversion? no
<7> [488.212248] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "2880x1800": 60 390000 2880 3056 3400 3440 1800 1808 1818 1890 0x40 0x5 (CLOCK_HIGH)
<7> [488.212256] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080i": 60 74250 1920 2008 2052 2200 1080 1084 1094 1125 0x40 0x15 (NO_INTERLACE)
<7> [488.212261] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080i": 50 74250 1920 2448 2492 2640 1080 1084 1094 1125 0x40 0x15 (NO_INTERLACE)
<7> [488.212266] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "720x576i": 50 13500 720 732 795 864 576 580 586 625 0x40 0x101a (NO_INTERLACE)
<7> [488.212271] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1280x720": 60 74250 1280 1390 1430 1650 720 725 730 750 0x40 0x1c005 (NO_STEREO)
<7> [488.212277] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1280x720": 60 74250 1280 1390 1430 1650 720 725 730 750 0x40 0x4005 (NO_STEREO)
<7> [488.212282] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080i": 60 74250 1920 2008 2052 2200 1080 1084 1094 1125 0x40 0x20015 (NO_INTERLACE)
<7> [488.212287] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1280x720": 50 74250 1280 1720 1760 1980 720 725 730 750 0x40 0x1c005 (NO_STEREO)
<7> [488.212291] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1280x720": 50 74250 1280 1720 1760 1980 720 725 730 750 0x40 0x4005 (NO_STEREO)
<7> [488.212296] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080i": 50 74250 1920 2448 2492 2640 1080 1084 1094 1125 0x40 0x20015 (NO_INTERLACE)
<7> [488.212301] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080": 24 74250 1920 2558 2602 2750 1080 1084 1089 1125 0x40 0x1c005 (NO_STEREO)
<7> [488.212306] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080": 24 74250 1920 2558 2602 2750 1080 1084 1089 1125 0x40 0x4005 (NO_STEREO)
<7> [488.212311] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "3840x2160": 50 594000 3840 4896 4984 5280 2160 2168 2178 2250 0x40 0x5 (NO_420)
<7> [488.212318] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "3840x2160": 60 594000 3840 4016 4104 4400 2160 2168 2178 2250 0x40 0x5 (NO_420)
<7> [488.212323] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "4096x2160": 50 594000 4096 5064 5152 5280 2160 2168 2178 2250 0x40 0x5 (NO_420)
<7> [488.212328] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "4096x2160": 60 594000 4096 4184 4272 4400 2160 2168 2178 2250 0x40 0x5 (NO_420)
<7> [488.212333] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080i": 60 74176 1920 2008 2052 2200 1080 1084 1094 1125 0x40 0x15 (NO_INTERLACE)
<7> [488.212338] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1280x720": 60 74176 1280 1390 1430 1650 720 725 730 750 0x40 0x1c005 (NO_STEREO)
<7> [488.212343] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1280x720": 60 74176 1280 1390 1430 1650 720 725 730 750 0x40 0x4005 (NO_STEREO)
<7> [488.212348] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080i": 60 74176 1920 2008 2052 2200 1080 1084 1094 1125 0x40 0x20015 (NO_INTERLACE)
<7> [488.212353] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080": 24 74176 1920 2558 2602 2750 1080 1084 1089 1125 0x40 0x1c005 (NO_STEREO)
<7> [488.212358] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080": 24 74176 1920 2558 2602 2750 1080 1084 1089 1125 0x40 0x4005 (NO_STEREO)
<7> [488.212363] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "3840x2160": 60 593407 3840 4016 4104 4400 2160 2168 2178 2250 0x40 0x5 (NO_420)
<7> [488.212368] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "4096x2160": 60 593407 4096 4184 4272 4400 2160 2168 2178 2250 0x40 0x5 (NO_420)
<7> [488.212375] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:527:DP-2] probed modes:
<7> [488.212378] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 60 148500 1920 2008 2052 2200 1080 1084 1089 1125 0x48 0x5
<7> [488.212382] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "4096x2160": 30 297000 4096 4184 4272 4400 2160 2168 2178 2250 0x40 0x5
<7> [488.212385] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "4096x2160": 30 296703 4096 4184 4272 4400 2160 2168 2178 2250 0x40 0x5
<7> [488.212388] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "4096x2160": 24 297000 4096 5116 5204 5500 2160 2168 2178 2250 0x40 0x5
<7> [488.212391] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "4096x2160": 24 296703 4096 5116 5204 5500 2160 2168 2178 2250 0x40 0x5
<7> [488.212394] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 30 297000 3840 4016 4104 4400 2160 2168 2178 2250 0x40 0x5
<7> [488.212397] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 30 296703 3840 4016 4104 4400 2160 2168 2178 2250 0x40 0x5
<7> [488.212400] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 25 297000 3840 4896 4984 5280 2160 2168 2178 2250 0x40 0x5
<7> [488.212403] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 24 297000 3840 5116 5204 5500 2160 2168 2178 2250 0x40 0x5
<7> [488.212407] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 24 296703 3840 5116 5204 5500 2160 2168 2178 2250 0x40 0x5
<7> [488.212410] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "2560x1600": 60 268500 2560 2608 2640 2720 1600 1603 1609 1646 0x40 0x5
<7> [488.212413] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "2224x1668": 60 245000 2224 2270 2302 2382 1668 1671 1677 1714 0x40 0x5
<7> [488.212416] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "2560x1440": 60 241500 2560 2608 2640 2720 1440 1443 1449 1481 0x40 0x5
<7> [488.212419] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1200": 60 154000 1920 1968 2000 2080 1200 1203 1209 1235 0x40 0x9
<7> [488.212422] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 120 297000 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5
<7> [488.212426] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 120 296703 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5
<7> [488.212429] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 60 148500 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5
<7> [488.212432] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 60 148352 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5
<7> [488.212435] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 50 148500 1920 2448 2492 2640 1080 1084 1089 1125 0x40 0x5
<7> [488.212438] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 30 74250 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5
<7> [488.212441] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 30 74176 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5
<7> [488.212444] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 25 74250 1920 2448 2492 2640 1080 1084 1089 1125 0x40 0x5
<7> [488.212448] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 24 74250 1920 2558 2602 2750 1080 1084 1089 1125 0x40 0x5
<7> [488.212451] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 24 74176 1920 2558 2602 2750 1080 1084 1089 1125 0x40 0x5
<7> [488.212454] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1600x1200": 60 162000 1600 1664 1856 2160 1200 1201 1204 1250 0x40 0x5
<7> [488.212457] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1680x1050": 60 119000 1680 1728 1760 1840 1050 1053 1059 1080 0x40 0x9
<7> [488.212460] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1600x900": 60 108000 1600 1624 1704 1800 900 901 904 1000 0x40 0x5
<7> [488.212463] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x1024": 60 108000 1280 1328 1440 1688 1024 1025 1028 1066 0x40 0x5
<7> [488.212471] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1440x900": 60 88750 1440 1488 1520 1600 900 903 909 926 0x40 0x9
<7> [488.212474] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1366x768": 60 85500 1366 1436 1579 1792 768 771 774 798 0x40 0x5
<7> [488.212478] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x800": 60 71000 1280 1328 1360 1440 800 803 809 823 0x40 0x9
<7> [488.212481] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x720": 60 74250 1280 1390 1430 1650 720 725 730 750 0x40 0x5
<7> [488.212484] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x720": 60 74176 1280 1390 1430 1650 720 725 730 750 0x40 0x5
<7> [488.212487] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x720": 50 74250 1280 1720 1760 1980 720 725 730 750 0x40 0x5
<7> [488.212490] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1024x768": 60 65000 1024 1048 1184 1344 768 771 777 806 0x40 0xa
<7> [488.212493] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "800x600": 60 40000 800 840 968 1056 600 601 605 628 0x40 0x5
<7> [488.212497] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "720x576": 50 27000 720 732 796 864 576 581 586 625 0x40 0xa
<7> [488.212500] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "720x480": 60 27027 720 736 798 858 480 489 495 525 0x40 0xa
<7> [488.212503] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "720x480": 60 27000 720 736 798 858 480 489 495 525 0x40 0xa
<7> [488.212506] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "640x480": 60 25200 640 656 752 800 480 490 492 525 0x40 0xa
<7> [488.212509] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "640x480": 60 25175 640 656 752 800 480 490 492 525 0x40 0xa
<7> [488.212537] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:535:HDMI-A-2]
<7> [488.212542] xe 0000:03:00.0: [drm:intel_hdmi_detect [xe]] [CONNECTOR:535:HDMI-A-2]
<7> [488.213025] xe 0000:03:00.0: [drm:do_gmbus_xfer [xe]] GMBUS [i915 gmbus tc2] NAK for addr: 0050 w(1)
<7> [488.213122] xe 0000:03:00.0: [drm:do_gmbus_xfer [xe]] GMBUS [i915 gmbus tc2] NAK on first message, retry
<7> [488.213562] xe 0000:03:00.0: [drm:do_gmbus_xfer [xe]] GMBUS [i915 gmbus tc2] NAK for addr: 0050 w(1)
<7> [488.213652] [drm:drm_do_probe_ddc_edid] drm: skipping non-existent adapter i915 gmbus tc2
<7> [488.213656] xe 0000:03:00.0: [drm:intel_hdmi_set_edid [xe]] HDMI GMBUS EDID read failed, retry using GPIO bit-banging
<7> [488.213750] xe 0000:03:00.0: [drm:intel_gmbus_force_bit [xe]] enabling bit-banging on i915 gmbus tc2. force bit now 1
<7> [488.215099] [drm:drm_do_probe_ddc_edid] drm: skipping non-existent adapter i915 gmbus tc2
<7> [488.215103] xe 0000:03:00.0: [drm:intel_gmbus_force_bit [xe]] disabling bit-banging on i915 gmbus tc2. force bit now 0
<7> [488.215197] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:535:HDMI-A-2] disconnected
<7> [488.215210] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:539:HDMI-A-3]
<7> [488.215216] xe 0000:03:00.0: [drm:intel_hdmi_detect [xe]] [CONNECTOR:539:HDMI-A-3]
<7> [488.216053] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:539:HDMI-A-3] HDMI: DVI dual 0, max TMDS clock 590000 kHz
<7> [488.216056] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:539:HDMI-A-3] HDMI sink does deep color 30.
<7> [488.216058] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:539:HDMI-A-3] HDMI sink does deep color 36.
<7> [488.216060] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:539:HDMI-A-3] HDMI sink does deep color 48.
<7> [488.216062] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:539:HDMI-A-3] Assigning HDMI sink color depth as 16 bpc.
<7> [488.216064] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:539:HDMI-A-3] HDMI sink does YCRCB444 in deep color.
<7> [488.216066] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:539:HDMI-A-3] DisplayID extension version 0x10, primary use 0x03
<7> [488.216069] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:539:HDMI-A-3] ELD monitor Mi TV
<7> [488.216071] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:539:HDMI-A-3] HDMI: latency present 0 0, video latency 0 0, audio latency 0 0
<7> [488.216074] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:539:HDMI-A-3] ELD size 36, SAD count 3
<7> [488.216076] xe 0000:03:00.0: [drm:drm_edid_connector_update] [CONNECTOR:539:HDMI-A-3] tile cap 0x9, size 1920x1080, num tiles 2x1, location 1x0, vend IGT
<7> [488.216452] xe 0000:03:00.0: [drm:do_gmbus_xfer [xe]] GMBUS [i915 gmbus tc3] NAK for addr: 0040 w(1)
<7> [488.216555] xe 0000:03:00.0: [drm:do_gmbus_xfer [xe]] GMBUS [i915 gmbus tc3] NAK on first message, retry
<7> [488.216996] xe 0000:03:00.0: [drm:do_gmbus_xfer [xe]] GMBUS [i915 gmbus tc3] NAK for addr: 0040 w(1)
<7> [488.217084] xe 0000:03:00.0: [drm:drm_dp_dual_mode_detect [drm_display_helper]] DP dual mode HDMI ID: (err -6)
<7> [488.217556] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080i": 60 74250 1920 2008 2052 2200 1080 1084 1094 1125 0x40 0x15 (NO_INTERLACE)
<7> [488.217564] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080i": 50 74250 1920 2448 2492 2640 1080 1084 1094 1125 0x40 0x15 (NO_INTERLACE)
<7> [488.217569] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "720x576i": 50 13500 720 732 795 864 576 580 586 625 0x40 0x101a (NO_INTERLACE)
<7> [488.217574] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080i": 60 74250 1920 2008 2052 2200 1080 1084 1094 1125 0x40 0x20015 (NO_INTERLACE)
<7> [488.217580] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080i": 50 74250 1920 2448 2492 2640 1080 1084 1094 1125 0x40 0x20015 (NO_INTERLACE)
<7> [488.217585] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080i": 60 74176 1920 2008 2052 2200 1080 1084 1094 1125 0x40 0x15 (NO_INTERLACE)
<7> [488.217590] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080i": 60 74176 1920 2008 2052 2200 1080 1084 1094 1125 0x40 0x20015 (NO_INTERLACE)
<7> [488.217598] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:539:HDMI-A-3] probed modes:
<7> [488.217601] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 60 148500 1920 2008 2052 2200 1080 1084 1089 1125 0x48 0x5
<7> [488.217605] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "4096x2160": 60 594000 4096 4184 4272 4400 2160 2168 2178 2250 0x40 0x5
<7> [488.217608] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "4096x2160": 60 593407 4096 4184 4272 4400 2160 2168 2178 2250 0x40 0x5
<7> [488.217611] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "4096x2160": 50 594000 4096 5064 5152 5280 2160 2168 2178 2250 0x40 0x5
<7> [488.217614] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "4096x2160": 30 297000 4096 4184 4272 4400 2160 2168 2178 2250 0x40 0x5
<7> [488.217617] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "4096x2160": 30 296703 4096 4184 4272 4400 2160 2168 2178 2250 0x40 0x5
<7> [488.217620] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "4096x2160": 24 297000 4096 5116 5204 5500 2160 2168 2178 2250 0x40 0x5
<7> [488.217623] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "4096x2160": 24 296703 4096 5116 5204 5500 2160 2168 2178 2250 0x40 0x5
<7> [488.217627] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 60 594000 3840 4016 4104 4400 2160 2168 2178 2250 0x40 0x5
<7> [488.217630] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 60 593407 3840 4016 4104 4400 2160 2168 2178 2250 0x40 0x5
<7> [488.217633] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 50 594000 3840 4896 4984 5280 2160 2168 2178 2250 0x40 0x5
<7> [488.217636] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 30 297000 3840 4016 4104 4400 2160 2168 2178 2250 0x40 0x5
<7> [488.217639] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 30 296703 3840 4016 4104 4400 2160 2168 2178 2250 0x40 0x5
<7> [488.217642] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 25 297000 3840 4896 4984 5280 2160 2168 2178 2250 0x40 0x5
<7> [488.217645] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 24 297000 3840 5116 5204 5500 2160 2168 2178 2250 0x40 0x5
<7> [488.217648] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 24 296703 3840 5116 5204 5500 2160 2168 2178 2250 0x40 0x5
<7> [488.217651] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "2880x1800": 30 167000 2880 2910 2920 3030 1800 1820 1828 1836 0x40 0x5
<7> [488.217654] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "2560x1600": 60 268500 2560 2608 2640 2720 1600 1603 1609 1646 0x40 0x5
<7> [488.217658] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "2560x1440": 60 241500 2560 2608 2640 2720 1440 1443 1449 1481 0x40 0x5
<7> [488.217661] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1200": 60 154000 1920 1968 2000 2080 1200 1203 1209 1235 0x40 0x9
<7> [488.217664] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 120 297000 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5
<7> [488.217667] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 120 296703 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5
<7> [488.217670] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 60 148500 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5
<7> [488.217673] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 60 148352 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5
<7> [488.217676] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 50 148500 1920 2448 2492 2640 1080 1084 1089 1125 0x40 0x5
<7> [488.217680] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 30 74250 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5
<7> [488.217683] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 30 74176 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5
<7> [488.217686] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 25 74250 1920 2448 2492 2640 1080 1084 1089 1125 0x40 0x5
<7> [488.217689] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 24 74250 1920 2558 2602 2750 1080 1084 1089 1125 0x40 0x5
<7> [488.217692] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 24 74250 1920 2558 2602 2750 1080 1084 1089 1125 0x40 0x1c005
<7> [488.217695] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 24 74250 1920 2558 2602 2750 1080 1084 1089 1125 0x40 0x4005
<7> [488.217698] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 24 74176 1920 2558 2602 2750 1080 1084 1089 1125 0x40 0x5
<7> [488.217702] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 24 74176 1920 2558 2602 2750 1080 1084 1089 1125 0x40 0x1c005
<7> [488.217705] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 24 74176 1920 2558 2602 2750 1080 1084 1089 1125 0x40 0x4005
<7> [488.217708] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1600x1200": 60 162000 1600 1664 1856 2160 1200 1201 1204 1250 0x40 0x5
<7> [488.217711] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1680x1050": 60 119000 1680 1728 1760 1840 1050 1053 1059 1080 0x40 0x9
<7> [488.217714] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1600x900": 60 108000 1600 1624 1704 1800 900 901 904 1000 0x40 0x5
<7> [488.217717] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x1024": 60 108000 1280 1328 1440 1688 1024 1025 1028 1066 0x40 0x5
<7> [488.217720] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1440x900": 60 88750 1440 1488 1520 1600 900 903 909 926 0x40 0x9
<7> [488.217723] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1366x768": 60 85500 1366 1436 1579 1792 768 771 774 798 0x40 0x5
<7> [488.217726] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x800": 60 71000 1280 1328 1360 1440 800 803 809 823 0x40 0x9
<7> [488.217729] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x720": 60 74250 1280 1390 1430 1650 720 725 730 750 0x40 0x5
<7> [488.217732] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x720": 60 74250 1280 1390 1430 1650 720 725 730 750 0x40 0x1c005
<7> [488.217735] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x720": 60 74250 1280 1390 1430 1650 720 725 730 750 0x40 0x4005
<7> [488.217738] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x720": 60 74176 1280 1390 1430 1650 720 725 730 750 0x40 0x5
<7> [488.217741] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x720": 60 74176 1280 1390 1430 1650 720 725 730 750 0x40 0x1c005
<7> [488.217744] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x720": 60 74176 1280 1390 1430 1650 720 725 730 750 0x40 0x4005
<7> [488.217747] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x720": 50 74250 1280 1720 1760 1980 720 725 730 750 0x40 0x5
<7> [488.217750] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x720": 50 74250 1280 1720 1760 1980 720 725 730 750 0x40 0x1c005
<7> [488.217753] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x720": 50 74250 1280 1720 1760 1980 720 725 730 750 0x40 0x4005
<7> [488.217755] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1024x768": 60 65000 1024 1048 1184 1344 768 771 777 806 0x40 0xa
<7> [488.217758] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "800x600": 60 40000 800 840 968 1056 600 601 605 628 0x40 0x5
<7> [488.217761] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "720x576": 50 27000 720 732 796 864 576 581 586 625 0x40 0xa
<7> [488.217764] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "720x480": 60 27027 720 736 798 858 480 489 495 525 0x40 0xa
<7> [488.217767] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "720x480": 60 27000 720 736 798 858 480 489 495 525 0x40 0xa
<7> [488.217770] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "640x480": 60 25200 640 656 752 800 480 490 492 525 0x40 0xa
<7> [488.217773] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "640x480": 60 25175 640 656 752 800 480 490 492 525 0x40 0xa
<7> [488.217801] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:543:DP-3]
<7> [488.217806] xe 0000:03:00.0: [drm:intel_dp_detect [xe]] [CONNECTOR:543:DP-3]
<7> [488.222189] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:543:DP-3] disconnected
<7> [488.222202] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:551:HDMI-A-4]
<7> [488.222206] xe 0000:03:00.0: [drm:intel_hdmi_detect [xe]] [CONNECTOR:551:HDMI-A-4]
<7> [488.226475] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:551:HDMI-A-4] disconnected
<6> [488.226781] [IGT] kms_rotation_crc: starting subtest primary-x-tiled-reflect-x-0
<7> [488.228998] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.enable (expected yes, found no)
<7> [488.229116] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.active (expected yes, found no)
<7> [488.229222] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in cpu_transcoder (expected 2, found -1)
<7> [488.229330] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in lane_count (expected 4, found 0)
<7> [488.229433] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in output_types (expected 0x00000040, found 0x00000000)
<7> [488.229575] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in framestart_delay (expected 1, found 0)
<7> [488.229673] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.pipe_mode.crtc_hdisplay (expected 1920, found 0)
<7> [488.229769] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.pipe_mode.crtc_htotal (expected 2200, found 0)
<7> [488.229865] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.pipe_mode.crtc_hblank_start (expected 1920, found 0)
<7> [488.229963] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.pipe_mode.crtc_hblank_end (expected 2200, found 0)
<7> [488.230064] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.pipe_mode.crtc_hsync_start (expected 2008, found 0)
<7> [488.230166] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.pipe_mode.crtc_hsync_end (expected 2052, found 0)
<7> [488.230266] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.pipe_mode.crtc_vdisplay (expected 1080, found 0)
<7> [488.230369] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.pipe_mode.crtc_vblank_start (expected 1080, found 0)
<7> [488.230475] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.pipe_mode.crtc_vsync_start (expected 1084, found 0)
<7> [488.230577] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.pipe_mode.crtc_vsync_end (expected 1089, found 0)
<7> [488.230678] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.pipe_mode.crtc_vtotal (expected 1125, found 0)
<7> [488.230779] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.pipe_mode.crtc_vblank_end (expected 1125, found 0)
<7> [488.230875] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_hdisplay (expected 1920, found 0)
<7> [488.230973] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_htotal (expected 2200, found 0)
<7> [488.231070] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_hblank_start (expected 1920, found 0)
<7> [488.231167] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_hblank_end (expected 2200, found 0)
<7> [488.231263] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_hsync_start (expected 2008, found 0)
<7> [488.231366] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_hsync_end (expected 2052, found 0)
<7> [488.231469] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_vdisplay (expected 1080, found 0)
<7> [488.231568] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_vblank_start (expected 1080, found 0)
<7> [488.231665] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_vsync_start (expected 1084, found 0)
<7> [488.231759] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_vsync_end (expected 1089, found 0)
<7> [488.231860] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_vtotal (expected 1125, found 0)
<7> [488.231958] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_vblank_end (expected 1125, found 0)
<7> [488.232054] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in pixel_multiplier (expected 1, found 0)
<7> [488.232153] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.adjusted_mode.flags (1) (expected 1, found 0)
<7> [488.232248] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.adjusted_mode.flags (4) (expected 4, found 0)
<7> [488.232344] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in has_hdmi_sink (expected yes, found no)
<7> [488.232440] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in has_infoframe (expected yes, found no)
<7> [488.232544] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in pipe_bpp (expected 36, found 0)
<7> [488.232639] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.pipe_mode.crtc_clock (expected 148500, found 0)
<7> [488.232736] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_clock (expected 148500, found 0)
<7> [488.232838] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in port_clock (expected 222750, found 0)
<7> [488.232937] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in infoframes.enable (expected 0x00000071, found 0x00000000)
<7> [488.233036] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in infoframes.gcp (expected 0x00000006, found 0x00000000)
<7> [488.233133] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in avi infoframe
<7> [488.233237] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] expected:
<7> [488.233337] xe 0000:03:00.0: HDMI infoframe: Auxiliary Video Information (AVI), version 2, length 13
<7> [488.233339] xe 0000:03:00.0: colorspace: RGB
<7> [488.233340] xe 0000:03:00.0: scan mode: Underscan
<7> [488.233342] xe 0000:03:00.0: colorimetry: No Data
<7> [488.233343] xe 0000:03:00.0: picture aspect: 16:9
<7> [488.233345] xe 0000:03:00.0: active aspect: Same as Picture
<7> [488.233346] xe 0000:03:00.0: itc: No Data
<7> [488.233348] xe 0000:03:00.0: extended colorimetry: xvYCC 601
<7> [488.233349] xe 0000:03:00.0: quantization range: Default
<7> [488.233351] xe 0000:03:00.0: nups: Unknown Non-uniform Scaling
<7> [488.233352] xe 0000:03:00.0: video code: 16
<7> [488.233354] xe 0000:03:00.0: ycc quantization range: Full
<7> [488.233355] xe 0000:03:00.0: hdmi content type: Graphics
<7> [488.233357] xe 0000:03:00.0: pixel repeat: 0
<7> [488.233358] xe 0000:03:00.0: bar top 0, bottom 0, left 0, right 0
<7> [488.233360] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] found:
<7> [488.233460] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in spd infoframe
<7> [488.233571] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] expected:
<7> [488.233671] xe 0000:03:00.0: HDMI infoframe: Source Product Description (SPD), version 1, length 25
<7> [488.233672] xe 0000:03:00.0: vendor: Intel
<7> [488.233673] xe 0000:03:00.0: product: Discrete gfx
<7> [488.233675] xe 0000:03:00.0: source device information: PC General (0x9)
<7> [488.233676] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] found:
<7> [488.233779] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe C] fastset requirement not met in hdmi infoframe
<7> [488.233875] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] expected:
<7> [488.233971] xe 0000:03:00.0: HDMI infoframe: Vendor, version 1, length 4
<7> [488.233972] xe 0000:03:00.0: empty frame
<7> [488.233973] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] found:
<7> [488.234070] xe 0000:03:00.0: [drm:intel_atomic_check [xe]] [CRTC:269:pipe C] fastset requirement not met, forcing full modeset
<7> [488.234168] xe 0000:03:00.0: [drm:intel_dpll_crtc_put [xe]] [CRTC:269:pipe C] releasing TC PLL 3
<7> [488.234308] xe 0000:03:00.0: [drm:skl_compute_wm [xe]] Enabled dbuf slices 0xf -> 0xf (total dbuf slices 0xf), mbus joined? no->yes
<7> [488.234392] xe 0000:03:00.0: [drm:skl_compute_wm [xe]] [CRTC:151:pipe A] dbuf slices 0x3 -> 0xf, ddb (0 - 2048) -> (0 - 4096), active pipes 0x5 -> 0x1
<7> [488.234505] xe 0000:03:00.0: [drm:skl_compute_wm [xe]] [CRTC:269:pipe C] dbuf slices 0xc -> 0x0, ddb (0 - 2048) -> (0 - 0), active pipes 0x5 -> 0x1
<7> [488.234592] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:35:plane 1A] ddb ( 0 - 1989) -> ( 0 - 0), size 1989 -> 0
<7> [488.234673] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:145:cursor A] ddb (1989 - 2048) -> (4037 - 4096), size 59 -> 59
<7> [488.234751] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm
<7> [488.234828] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 1, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [488.234904] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 16, 49, 145, 145, 273, 273, 273, 273, 30, 241, 255 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [488.234979] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 19, 55, 161, 161, 302, 302, 0, 0, 31, 267, 267 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [488.235054] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1989) -> ( 0 - 0), size 1989 -> 0
<7> [488.235128] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:263:cursor C] ddb (1989 - 2048) -> ( 0 - 0), size 59 -> 0
<7> [488.235205] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:153:plane 1C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm
<7> [488.235284] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:153:plane 1C] lines 1, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [488.235363] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:153:plane 1C] blocks 16, 49, 145, 145, 273, 273, 273, 273, 30, 241, 255 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [488.235442] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:153:plane 1C] min_ddb 19, 55, 161, 161, 302, 302, 0, 0, 31, 267, 267 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [488.235544] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:151:pipe A] data rate 0 num active planes 0
<7> [488.235647] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 0 num active planes 0
<7> [488.235750] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 0 qgv_peak_bw: 48000
<7> [488.235851] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 0 qgv_peak_bw: 48000
<7> [488.235948] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 0
<7> [488.236045] xe 0000:03:00.0: [drm:intel_cdclk_atomic_check [xe]] [CRTC:269:pipe C] min cdclk: 192000 kHz -> 0 kHz
<7> [488.236155] xe 0000:03:00.0: [drm:intel_cdclk_update_dbuf_bw_min_cdclk [xe]] dbuf bandwidth min cdclk: 18563 kHz -> 0 kHz
<7> [488.236268] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [CRTC:269:pipe C] enable: no [modeset]
<7> [488.236369] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:153:plane 1C] fb: [NOFB], visible: no
<7> [488.236473] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:183:plane 2C] fb: [NOFB], visible: no
<7> [488.236571] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:213:plane 3C] fb: [NOFB], visible: no
<7> [488.236667] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:243:plane 4C] fb: [NOFB], visible: no
<7> [488.236762] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:253:plane 5C] fb: [NOFB], visible: no
<7> [488.236858] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:263:cursor C] fb: [NOFB], visible: no
<7> [488.237776] xe 0000:03:00.0: [drm:intel_audio_codec_disable [xe]] [CONNECTOR:539:HDMI-A-3][ENCODER:538:DDI TC3/PHY H] Disable audio codec on [CRTC:269:pipe C]
<7> [488.257806] xe 0000:03:00.0: [drm:intel_disable_transcoder [xe]] disabling pipe C
<7> [488.275707] xe 0000:03:00.0: [drm:intel_dpll_disable [xe]] disable TC PLL 3 (active 0x4, on? 1) for [CRTC:269:pipe C]
<7> [488.277323] xe 0000:03:00.0: [drm:intel_dpll_disable [xe]] disabling TC PLL 3
<7> [488.277700] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:507:DDI TC1/PHY F]
<7> [488.277802] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:509:DP-MST A]
<7> [488.277898] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:510:DP-MST B]
<7> [488.277986] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:511:DP-MST C]
<7> [488.278076] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:512:DP-MST D]
<7> [488.278162] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:526:DDI TC2/PHY G]
<7> [488.278247] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:528:DP-MST A]
<7> [488.278335] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:529:DP-MST B]
<7> [488.278427] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:530:DP-MST C]
<7> [488.278529] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:531:DP-MST D]
<7> [488.278628] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:538:DDI TC3/PHY H]
<7> [488.278929] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:542:DDI TC4/PHY I]
<7> [488.279026] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:544:DP-MST A]
<7> [488.279120] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:545:DP-MST B]
<7> [488.279214] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:546:DP-MST C]
<7> [488.279304] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:547:DP-MST D]
<7> [488.279395] xe 0000:03:00.0: [drm:verify_connector_state [xe]] [CONNECTOR:508:DP-1]
<7> [488.279697] xe 0000:03:00.0: [drm:verify_connector_state [xe]] [CONNECTOR:521:HDMI-A-1]
<7> [488.279797] xe 0000:03:00.0: [drm:verify_connector_state [xe]] [CONNECTOR:535:HDMI-A-2]
<7> [488.279903] xe 0000:03:00.0: [drm:verify_connector_state [xe]] [CONNECTOR:539:HDMI-A-3]
<7> [488.280199] xe 0000:03:00.0: [drm:verify_connector_state [xe]] [CONNECTOR:543:DP-3]
<7> [488.280295] xe 0000:03:00.0: [drm:verify_connector_state [xe]] [CONNECTOR:551:HDMI-A-4]
<7> [488.281895] xe 0000:03:00.0: [drm:intel_dbuf_mbus_join_update [xe]] Changing mbus joined: no -> yes (pipe: A)
<7> [488.282176] xe 0000:03:00.0: [drm:intel_dbuf_mdclk_cdclk_ratio_update [xe]] Updating dbuf ratio to 4 (mbus joined: yes)
<7> [488.287684] xe 0000:03:00.0: [drm:intel_power_well_disable [xe]] disabling PW_C
<7> [488.287798] xe 0000:03:00.0: [drm:dss_pipe_gating_enable_disable [xe]] DSS clock gating disabled for pipe_mask=0x4 (CLKGATE_DIS_DSSDSC=0xa8000000)
<7> [488.287943] xe 0000:03:00.0: [drm:intel_modeset_verify_crtc [xe]] [CRTC:269:pipe C]
<7> [488.288178] xe 0000:03:00.0: [drm:intel_pmdemand_program_params [xe]] initiate pmdemand request values: (0x1e03071 0x28d10e72)
<7> [488.288683] xe 0000:03:00.0: [drm:i915_fifo_underrun_reset_write [xe]] Re-arming FIFO underruns on pipe A
<7> [488.288898] xe 0000:03:00.0: [drm:i915_fifo_underrun_reset_write [xe]] Re-arming FIFO underruns on pipe A
<7> [488.314516] xe 0000:03:00.0: [drm:intel_power_well_disable [xe]] disabling AUX_TC2
<7> [488.355722] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [488.378268] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:35:plane 1A] ddb ( 0 - 0) -> ( 0 - 4037), size 0 -> 4037
<7> [488.378528] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm
<7> [488.378728] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 3, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0
<7> [488.378914] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 19, 55, 55, 103, 103, 103, 103, 28, 91, 105
<7> [488.379099] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 22, 62, 62, 115, 115, 0, 0, 29, 102, 106
<7> [488.379317] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:151:pipe A] data rate 594000 num active planes 1
<7> [488.379579] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000
<7> [488.379797] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000
<7> [488.380005] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624
<7> [488.380242] xe 0000:03:00.0: [drm:intel_cdclk_update_dbuf_bw_min_cdclk [xe]] dbuf bandwidth min cdclk: 0 kHz -> 9282 kHz
<7> [488.404253] xe 0000:03:00.0: [drm:drm_mode_rmfb_work_fn] Removing [FB:555] from all active usage due to RMFB ioctl
<7> [488.404405] xe 0000:03:00.0: [drm:atomic_remove_fb] Disabling [PLANE:35:plane 1A] because [FB:555] is removed
<7> [488.404585] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:35:plane 1A] ddb ( 0 - 4037) -> ( 0 - 0), size 4037 -> 0
<7> [488.405034] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm
<7> [488.405524] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 3, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [488.405963] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 14, 19, 55, 55, 103, 103, 103, 103, 28, 91, 105 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [488.406384] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 17, 22, 62, 62, 115, 115, 0, 0, 29, 102, 106 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [488.406907] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:151:pipe A] data rate 0 num active planes 0
<7> [488.407445] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 0 qgv_peak_bw: 48000
<7> [488.408018] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 0 qgv_peak_bw: 48000
<7> [488.408569] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 0
<7> [488.422124] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [488.441793] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:35:plane 1A] ddb ( 0 - 0) -> ( 0 - 4037), size 0 -> 4037
<7> [488.442120] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm
<7> [488.442386] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 3, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0
<7> [488.442682] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 19, 55, 55, 103, 103, 103, 103, 28, 91, 105
<7> [488.442966] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 22, 62, 62, 115, 115, 0, 0, 29, 102, 106
<7> [488.443232] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:151:pipe A] data rate 594000 num active planes 1
<7> [488.443549] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000
<7> [488.443841] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000
<7> [488.444094] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624
<7> [488.471887] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:558]
<7> [488.490965] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:563]
<7> [488.555459] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [488.576034] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:563]
<7> [488.604713] xe 0000:03:00.0: [drm:drm_mode_rmfb_work_fn] Removing [FB:558] from all active usage due to RMFB ioctl
<7> [488.655381] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:558]
<7> [488.675867] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:563]
<7> [488.704951] xe 0000:03:00.0: [drm:drm_mode_rmfb_work_fn] Removing [FB:555] from all active usage due to RMFB ioctl
<7> [488.738562] xe 0000:03:00.0: [drm:intel_power_well_enable [xe]] enabling AUX_TC2
<7> [488.755355] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [488.756855] xe 0000:03:00.0: [drm:intel_power_well_disable [xe]] disabling AUX_TC2
<7> [488.776210] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:563]
<7> [488.838749] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:558]
<7> [488.863256] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:563]
<7> [488.938775] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [488.959334] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:563]
<7> [489.022071] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:558]
<7> [489.041906] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:563]
<7> [489.105437] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [489.124774] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:563]
<7> [489.188685] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:558]
<7> [489.207742] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:563]
<7> [489.272056] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [489.291545] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:563]
<7> [489.355394] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:558]
<7> [489.375199] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:563]
<7> [489.438822] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [489.459402] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm
<7> [489.459680] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 3, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 3, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0
<7> [489.459886] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 14, 19, 55, 55, 103, 103, 103, 103, 28, 91, 105 -> 14, 16, 46, 46, 86, 86, 86, 86, 28, 76, 90
<7> [489.460084] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 17, 22, 62, 62, 115, 115, 0, 0, 29, 102, 106 -> 17, 19, 52, 52, 96, 96, 0, 0, 29, 85, 91
<7> [489.487641] xe 0000:03:00.0: [drm:drm_mode_rmfb_work_fn] Removing [FB:555] from all active usage due to RMFB ioctl
<7> [489.487800] xe 0000:03:00.0: [drm:atomic_remove_fb] Disabling [PLANE:35:plane 1A] because [FB:555] is removed
<7> [489.487927] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:35:plane 1A] ddb ( 0 - 4037) -> ( 0 - 0), size 4037 -> 0
<7> [489.488378] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm
<7> [489.488880] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 3, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [489.489296] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 14, 16, 46, 46, 86, 86, 86, 86, 28, 76, 90 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [489.489764] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 17, 19, 52, 52, 96, 96, 0, 0, 29, 85, 91 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [489.490216] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:151:pipe A] data rate 0 num active planes 0
<7> [489.490805] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 0 qgv_peak_bw: 48000
<7> [489.491332] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 0 qgv_peak_bw: 48000
<7> [489.491924] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 0
<7> [489.505655] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [489.524971] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:35:plane 1A] ddb ( 0 - 0) -> ( 0 - 4037), size 0 -> 4037
<7> [489.525331] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm
<7> [489.525790] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 3, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0
<7> [489.526067] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 16, 46, 46, 86, 86, 86, 86, 28, 76, 90
<7> [489.526323] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 19, 52, 52, 96, 96, 0, 0, 29, 85, 91
<7> [489.526645] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:151:pipe A] data rate 594000 num active planes 1
<7> [489.526959] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000
<7> [489.527248] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000
<7> [489.527531] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624
<7> [489.555298] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:563]
<7> [489.573883] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:564]
<7> [489.638995] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [489.658632] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:564]
<7> [489.722254] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:563]
<7> [489.741777] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:564]
<7> [489.805554] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [489.824692] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:564]
<7> [489.888901] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:563]
<7> [489.908421] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:564]
<7> [489.972202] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [489.992723] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:564]
<7> [490.055613] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:563]
<7> [490.075764] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:564]
<7> [490.139403] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [490.159000] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:564]
<7> [490.222287] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:563]
<7> [490.242706] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:564]
<7> [490.305587] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [490.325250] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:564]
<7> [490.388935] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:563]
<7> [490.408985] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:564]
<7> [490.472267] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [490.490986] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm
<7> [490.491321] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 3, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0
<7> [490.491693] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 14, 16, 46, 46, 86, 86, 86, 86, 28, 76, 90 -> 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 60
<7> [490.491968] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 17, 19, 52, 52, 96, 96, 0, 0, 29, 85, 91 -> 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 61
<7> [490.521076] xe 0000:03:00.0: [drm:drm_mode_rmfb_work_fn] Removing [FB:555] from all active usage due to RMFB ioctl
<7> [490.521294] xe 0000:03:00.0: [drm:atomic_remove_fb] Disabling [PLANE:35:plane 1A] because [FB:555] is removed
<7> [490.521570] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:35:plane 1A] ddb ( 0 - 4037) -> ( 0 - 0), size 4037 -> 0
<7> [490.522272] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm
<7> [490.522782] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [490.523202] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 60 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [490.523675] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 61 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [490.524165] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:151:pipe A] data rate 0 num active planes 0
<7> [490.524755] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 0 qgv_peak_bw: 48000
<7> [490.525285] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 0 qgv_peak_bw: 48000
<7> [490.525849] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 0
<7> [490.539116] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [490.557761] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:35:plane 1A] ddb ( 0 - 0) -> ( 0 - 4037), size 0 -> 4037
<7> [490.558068] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm
<7> [490.558333] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0
<7> [490.558633] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 60
<7> [490.558903] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 61
<7> [490.559150] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:151:pipe A] data rate 594000 num active planes 1
<7> [490.559426] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000
<7> [490.559733] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000
<7> [490.560001] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624
<7> [490.588667] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:564]
<7> [490.605992] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:565]
<7> [490.672346] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [490.691698] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:565]
<7> [490.754997] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:564]
<7> [490.771030] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:565]
<7> [490.807404] xe 0000:03:00.0: [drm:xe_hwmon_read [xe]] thermal data for group 0 val 0x2c2c2a2b
<7> [490.807568] xe 0000:03:00.0: [drm:xe_hwmon_read [xe]] thermal data for group 1 val 0x2c2c2b2c
<7> [490.838484] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [490.856327] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:565]
<7> [490.922263] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:564]
<7> [490.940561] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:565]
<7> [491.005620] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [491.024604] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:565]
<7> [491.037528] xe 0000:03:00.0: [drm:drm_mode_rmfb_work_fn] Removing [FB:564] from all active usage due to RMFB ioctl
<7> [491.088898] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:564]
<7> [491.108747] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:565]
<7> [491.188908] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [491.209238] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:565]
<7> [491.288911] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:564]
<7> [491.308865] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:565]
<7> [491.388906] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [491.419125] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:565]
<7> [491.488907] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:564]
<7> [491.507613] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:565]
<7> [491.572011] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [491.590474] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm
<7> [491.590805] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 3, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0
<7> [491.591089] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 60 -> 14, 19, 55, 55, 103, 103, 103, 103, 28, 91, 105
<7> [491.591334] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 61 -> 17, 22, 62, 62, 115, 115, 0, 0, 29, 102, 106
<7> [491.621076] xe 0000:03:00.0: [drm:drm_mode_rmfb_work_fn] Removing [FB:555] from all active usage due to RMFB ioctl
<7> [491.621230] xe 0000:03:00.0: [drm:atomic_remove_fb] Disabling [PLANE:35:plane 1A] because [FB:555] is removed
<7> [491.621354] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:35:plane 1A] ddb ( 0 - 4037) -> ( 0 - 0), size 4037 -> 0
<7> [491.621855] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm
<7> [491.622266] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 3, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [491.622756] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 14, 19, 55, 55, 103, 103, 103, 103, 28, 91, 105 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [491.623168] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 17, 22, 62, 62, 115, 115, 0, 0, 29, 102, 106 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [491.623702] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:151:pipe A] data rate 0 num active planes 0
<7> [491.624236] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 0 qgv_peak_bw: 48000
<7> [491.624795] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 0 qgv_peak_bw: 48000
<7> [491.625309] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 0
<7> [491.638920] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [491.658569] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:35:plane 1A] ddb ( 0 - 0) -> ( 0 - 4037), size 0 -> 4037
<7> [491.658916] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm
<7> [491.659186] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 3, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0
<7> [491.659442] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 19, 55, 55, 103, 103, 103, 103, 28, 91, 105
<7> [491.659802] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 22, 62, 62, 115, 115, 0, 0, 29, 102, 106
<7> [491.660054] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:151:pipe A] data rate 594000 num active planes 1
<7> [491.660335] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000
<7> [491.660627] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000
<7> [491.660878] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624
<7> [491.688921] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:565]
<7> [491.706243] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:566]
<7> [491.772101] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [491.792724] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:566]
<7> [491.855370] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:565]
<7> [491.874213] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:566]
<7> [491.938747] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [491.959699] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:566]
<7> [491.988312] xe 0000:03:00.0: [drm:drm_mode_rmfb_work_fn] Removing [FB:565] from all active usage due to RMFB ioctl
<7> [492.038640] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:565]
<7> [492.058322] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:566]
<7> [492.121966] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [492.141109] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:566]
<7> [492.205288] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:565]
<7> [492.225305] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:566]
<7> [492.288677] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [492.307358] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:566]
<7> [492.372022] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:565]
<7> [492.391258] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:566]
<7> [492.455331] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:555]
<7> [492.474284] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:566]
<7> [492.538630] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:565]
<7> [492.557366] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:566]
<7> [492.647943] xe 0000:03:00.0: [drm:intel_hdmi_compute_output_format [xe]] picking 12 bpc for HDMI output (pipe bpp: 36)
<7> [492.648060] xe 0000:03:00.0: [drm:intel_atomic_check [xe]] [CRTC:151:pipe A] hw max bpp: 36, pipe bpp: 36, dithering: 0
<7> [492.648159] xe 0000:03:00.0: [drm:intel_ddi_compute_config_late [xe]] [ENCODER:538:DDI TC3/PHY H] [CRTC:151:pipe A]
<7> [492.648253] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:151:pipe A] fastset requirement not met in dp_m_n (expected tu 64 data 5190451/8388608 link 288358/524288, found tu 0, data 0/0 link 0/0)
<7> [492.648343] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:151:pipe A] fastset requirement not met in output_types (expected 0x00000080, found 0x00000040)
<7> [492.648433] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:151:pipe A] fastset requirement not met in has_hdmi_sink (expected no, found yes)
<7> [492.648535] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:151:pipe A] fastset requirement not met in has_infoframe (expected no, found yes)
<7> [492.648663] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:151:pipe A] fastset requirement not met in enhanced_framing (expected yes, found no)
<7> [492.649063] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:151:pipe A] fastset requirement not met in dpll_hw_state
<7> [492.649442] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] expected:
<7> [492.649840] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] cx0pll_hw_state: lane_count: 4, ssc_enabled: no, use_c10: no, tbt_mode: no
<7> [492.650166] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] c20pll_hw_state:
<7> [492.650479] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] tx[0] = 0xbe88, tx[1] = 0x4800, tx[2] = 0x0000
<7> [492.650788] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] cmn[0] = 0x0500, cmn[1] = 0x0005, cmn[2] = 0x0000, cmn[3] = 0x0000
<7> [492.651081] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[0] = 0x308c
<7> [492.651365] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[1] = 0x2110
<7> [492.651698] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[2] = 0xcc9c
<7> [492.651968] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[3] = 0xbfc1
<7> [492.652226] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[4] = 0x4b9a
<7> [492.652486] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[5] = 0x3f81
<7> [492.652738] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[6] = 0x2000
<7> [492.653099] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[7] = 0x0001
<7> [492.653608] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[8] = 0x5000
<7> [492.654103] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[9] = 0x0000
<7> [492.654362] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[10] = 0x0000
<7> [492.654601] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] vdr: custom width: 0x00, serdes rate: 0x42, hdmi rate: 0x00
<7> [492.654790] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] found:
<7> [492.654878] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] cx0pll_hw_state: lane_count: 4, ssc_enabled: no, use_c10: no, tbt_mode: no
<7> [492.654965] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] c20pll_hw_state:
<7> [492.655052] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] tx[0] = 0xbe88, tx[1] = 0x5800, tx[2] = 0x0000
<7> [492.655139] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] cmn[0] = 0x0500, cmn[1] = 0x0005, cmn[2] = 0x0000, cmn[3] = 0x0000
<7> [492.655230] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[0] = 0x40e8
<7> [492.655320] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[1] = 0x7d20
<7> [492.655409] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[2] = 0x0a06
<7> [492.655509] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[3] = 0x8f1c
<7> [492.655605] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[4] = 0x0000
<7> [492.655692] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[5] = 0x0000
<7> [492.655779] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[6] = 0x2200
<7> [492.655868] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[7] = 0xffff
<7> [492.655953] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[8] = 0x0400
<7> [492.656040] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[9] = 0x0000
<7> [492.656125] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[10] = 0x0001
<7> [492.656211] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] vdr: custom width: 0x00, serdes rate: 0x00, hdmi rate: 0x00
<7> [492.656298] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:151:pipe A] fastset requirement not met in port_clock (expected 270000, found 222750)
<7> [492.656387] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:151:pipe A] fastset requirement not met in infoframes.enable (expected 0x00000000, found 0x00000071)
<7> [492.656661] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:151:pipe A] fastset requirement not met in infoframes.gcp (expected 0x00000000, found 0x00000006)
<7> [492.656754] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:151:pipe A] fastset requirement not met in avi infoframe
<7> [492.656844] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] expected:
<7> [492.656933] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] found:
<7> [492.657025] xe 0000:03:00.0: HDMI infoframe: Auxiliary Video Information (AVI), version 2, length 13
<7> [492.657027] xe 0000:03:00.0: colorspace: RGB
<7> [492.657029] xe 0000:03:00.0: scan mode: Underscan
<7> [492.657030] xe 0000:03:00.0: colorimetry: No Data
<7> [492.657031] xe 0000:03:00.0: picture aspect: 16:9
<7> [492.657033] xe 0000:03:00.0: active aspect: Same as Picture
<7> [492.657034] xe 0000:03:00.0: itc: No Data
<7> [492.657035] xe 0000:03:00.0: extended colorimetry: xvYCC 601
<7> [492.657037] xe 0000:03:00.0: quantization range: Default
<7> [492.657038] xe 0000:03:00.0: nups: Unknown Non-uniform Scaling
<7> [492.657040] xe 0000:03:00.0: video code: 16
<7> [492.657041] xe 0000:03:00.0: ycc quantization range: Full
<7> [492.657042] xe 0000:03:00.0: hdmi content type: Graphics
<7> [492.657044] xe 0000:03:00.0: pixel repeat: 0
<7> [492.657045] xe 0000:03:00.0: bar top 0, bottom 0, left 0, right 0
<7> [492.657047] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:151:pipe A] fastset requirement not met in spd infoframe
<7> [492.657137] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] expected:
<7> [492.657226] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] found:
<7> [492.657316] xe 0000:03:00.0: HDMI infoframe: Source Product Description (SPD), version 1, length 25
<7> [492.657318] xe 0000:03:00.0: vendor: Intel
<7> [492.657319] xe 0000:03:00.0: product: Discrete gfx
<7> [492.657320] xe 0000:03:00.0: source device information: PC General (0x9)
<7> [492.657321] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:151:pipe A] fastset requirement not met in hdmi infoframe
<7> [492.657409] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] expected:
<7> [492.657507] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] found:
<7> [492.657603] xe 0000:03:00.0: HDMI infoframe: Vendor, version 1, length 4
<7> [492.657605] xe 0000:03:00.0: empty frame
<7> [492.657608] xe 0000:03:00.0: [drm:intel_atomic_check [xe]] [CRTC:151:pipe A] fastset requirement not met, forcing full modeset
<7> [492.657697] xe 0000:03:00.0: [drm:intel_dpll_crtc_put [xe]] [CRTC:151:pipe A] releasing TC PLL 2
<7> [492.657818] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:35:plane 1A] ddb ( 0 - 4037) -> ( 0 - 0), size 4037 -> 0
<7> [492.657898] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm
<7> [492.657974] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 3, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [492.658050] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 14, 19, 55, 55, 103, 103, 103, 103, 28, 91, 105 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [492.658123] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 17, 22, 62, 62, 115, 115, 0, 0, 29, 102, 106 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [492.658209] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:151:pipe A] data rate 0 num active planes 0
<7> [492.658305] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 0 qgv_peak_bw: 48000
<7> [492.658398] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 0 qgv_peak_bw: 48000
<7> [492.658495] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 0
<7> [492.658621] xe 0000:03:00.0: [drm:intel_cdclk_update_dbuf_bw_min_cdclk [xe]] dbuf bandwidth min cdclk: 9282 kHz -> 0 kHz
<7> [492.658729] xe 0000:03:00.0: [drm:intel_find_dpll [xe]] [CRTC:151:pipe A] allocated TC PLL 3
<7> [492.658823] xe 0000:03:00.0: [drm:intel_dpll_crtc_get [xe]] [CRTC:151:pipe A] reserving TC PLL 3
<7> [492.658915] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [CRTC:151:pipe A] enable: yes [modeset]
<7> [492.659008] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] active: yes, output_types: HDMI (0x40), output format: RGB, sink format: RGB
<7> [492.659100] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] cpu_transcoder: A, pipe bpp: 36, dithering: 0
<7> [492.659192] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] MST master transcoder: <invalid>
<7> [492.659283] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] port sync: master transcoder: <invalid>, slave transcoder bitmask = 0x0
<7> [492.659373] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] joiner: no, pipes: 0x0
<7> [492.659459] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] splitter: disabled, link count 0, overlap 0
<7> [492.659570] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] audio: 1, infoframes: 1, infoframes enabled: 0x71
<7> [492.659664] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] GCP: 0x6
<7> [492.659753] xe 0000:03:00.0: HDMI infoframe: Auxiliary Video Information (AVI), version 2, length 13
<7> [492.659755] xe 0000:03:00.0: colorspace: RGB
<7> [492.659756] xe 0000:03:00.0: scan mode: Underscan
<7> [492.659757] xe 0000:03:00.0: colorimetry: No Data
<7> [492.659758] xe 0000:03:00.0: picture aspect: 16:9
<7> [492.659759] xe 0000:03:00.0: active aspect: Same as Picture
<7> [492.659761] xe 0000:03:00.0: itc: No Data
<7> [492.659762] xe 0000:03:00.0: extended colorimetry: xvYCC 601
<7> [492.659763] xe 0000:03:00.0: quantization range: Default
<7> [492.659764] xe 0000:03:00.0: nups: Unknown Non-uniform Scaling
<7> [492.659765] xe 0000:03:00.0: video code: 16
<7> [492.659766] xe 0000:03:00.0: ycc quantization range: Full
<7> [492.659767] xe 0000:03:00.0: hdmi content type: Graphics
<7> [492.659768] xe 0000:03:00.0: pixel repeat: 0
<7> [492.659769] xe 0000:03:00.0: bar top 0, bottom 0, left 0, right 0
<7> [492.659771] xe 0000:03:00.0: HDMI infoframe: Source Product Description (SPD), version 1, length 25
<7> [492.659772] xe 0000:03:00.0: vendor: Intel
<7> [492.659773] xe 0000:03:00.0: product: Discrete gfx
<7> [492.659774] xe 0000:03:00.0: source device information: PC General (0x9)
<7> [492.659776] xe 0000:03:00.0: HDMI infoframe: Vendor, version 1, length 4
<7> [492.659777] xe 0000:03:00.0: empty frame
<7> [492.659778] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] ELD: 10 00 08 00 65 32 00 01 00 00 00 00 00 00 00 00
<7> [492.659864] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] ELD: 61 a4 9a 00 4d 69 20 54 56 09 07 07 11 17 50 51
<7> [492.659951] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] ELD: 07 00 00 00
<7> [492.660036] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] scanline offset: 1
<7> [492.660121] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] framestart delay: 1, MSA timing delay: 0, set context latency: 0
<7> [492.660207] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] vrr: no, fixed rr: yes, vmin: 1125, vmax: 1125, flipline: 1125, pipeline full: 0, guardband: 45 vsync start: 41, vsync end: 36
<7> [492.660293] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] vrr: vmin vblank: 1080, vmax vblank: 1080, vmin vtotal: 1125, vmax vtotal: 1125
<7> [492.660379] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] vrr: dc balance: no, vmin: 0 vmax: 0 guardband: 0, slope: 0 max increase: 0 max decrease: 0 vblank target: 0
<7> [492.660470] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] requested mode: "1920x1080": 60 148500 1920 2008 2052 2200 1080 1084 1089 1125 0x48 0x5
<7> [492.660563] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] adjusted mode: "1920x1080": 60 148500 1920 2008 2052 2200 1080 1084 1089 1125 0x48 0x5
<7> [492.660657] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] crtc timings: clock=148500, hd=1920 hb=1920-2200 hs=2008-2052 ht=2200, vd=1080 vb=1080-1125 vs=1084-1089 vt=1125, flags=0x5
<7> [492.660751] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pipe mode: "1920x1080": 60 148500 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5
<7> [492.660846] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] crtc timings: clock=148500, hd=1920 hb=1920-2200 hs=2008-2052 ht=2200, vd=1080 vb=1080-1125 vs=1084-1089 vt=1125, flags=0x5
<7> [492.660940] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] port clock: 222750, pixel rate 148500, min cdclk 192000, min voltage level 0
<7> [492.661034] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] linetime: 119, ips linetime: 0
<7> [492.661131] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] num_scalers: 2, scaler_users: 0x0, scaler_id: -1, scaling_filter: 0, sharpness_strength: 0
<7> [492.661224] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pipe src: 1920x1080+0+0
<7> [492.661318] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pch pfit: 0x0+0+0, disabled, force thru: no
<7> [492.661419] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] sharpness strength: 0, sharpness tap size: 0, sharpness enable: 0
<7> [492.661527] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] ips: 0, double wide: 0, drrs: 0
<7> [492.661624] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] cx0pll_hw_state: lane_count: 4, ssc_enabled: no, use_c10: no, tbt_mode: no
<7> [492.661719] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] c20pll_hw_state:
<7> [492.661813] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] tx[0] = 0xbe88, tx[1] = 0x5800, tx[2] = 0x0000
<7> [492.661907] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] cmn[0] = 0x0500, cmn[1] = 0x0005, cmn[2] = 0x0000, cmn[3] = 0x0000
<7> [492.662001] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[0] = 0x40e8
<7> [492.662093] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[1] = 0x7d20
<7> [492.662185] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[2] = 0x0a06
<7> [492.662279] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[3] = 0x8f1c
<7> [492.662371] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[4] = 0x0000
<7> [492.662469] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[5] = 0x0000
<7> [492.662564] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[6] = 0x2200
<7> [492.662662] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[7] = 0xffff
<7> [492.662758] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[8] = 0x0400
<7> [492.662855] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[9] = 0x0000
<7> [492.662956] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[10] = 0x0001
<7> [492.663057] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] vdr: custom width: 0x00, serdes rate: 0x00, hdmi rate: 0x00
<7> [492.663153] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] csc_mode: 0x0 gamma_mode: 0x0 gamma_enable: 0 csc_enable: 0
<7> [492.663249] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pre csc lut: 0 entries, post csc lut: 0 entries
<7> [492.663344] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] output csc: pre offsets: 0x0000 0x0000 0x0000
<7> [492.663439] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] output csc: coefficients: 0x0000 0x0000 0x0000
<7> [492.663543] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] output csc: coefficients: 0x0000 0x0000 0x0000
<7> [492.663637] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] output csc: coefficients: 0x0000 0x0000 0x0000
<7> [492.663730] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] output csc: post offsets: 0x0000 0x0000 0x0000
<7> [492.663823] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pipe csc: pre offsets: 0x0000 0x0000 0x0000
<7> [492.663915] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pipe csc: coefficients: 0x0000 0x0000 0x0000
<7> [492.664008] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pipe csc: coefficients: 0x0000 0x0000 0x0000
<7> [492.664099] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pipe csc: coefficients: 0x0000 0x0000 0x0000
<7> [492.664193] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pipe csc: post offsets: 0x0000 0x0000 0x0000
<7> [492.664286] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:35:plane 1A] fb: [NOFB], visible: no
<7> [492.664379] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:65:plane 2A] fb: [NOFB], visible: no
<7> [492.664478] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:95:plane 3A] fb: [NOFB], visible: no
<7> [492.664571] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:125:plane 4A] fb: [NOFB], visible: no
<7> [492.664664] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:135:plane 5A] fb: [NOFB], visible: no
<7> [492.664756] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:145:cursor A] fb: [NOFB], visible: no
<7> [492.665450] xe 0000:03:00.0: [drm:intel_audio_codec_disable [xe]] [CONNECTOR:527:DP-2][ENCODER:526:DDI TC2/PHY G] Disable audio codec on [CRTC:151:pipe A]
<7> [492.688244] xe 0000:03:00.0: [drm:intel_disable_transcoder [xe]] disabling pipe A
<7> [492.704722] xe 0000:03:00.0: [drm:intel_power_well_enable [xe]] enabling AUX_TC2
<7> [492.707634] xe 0000:03:00.0: [drm:intel_dpll_disable [xe]] disable TC PLL 2 (active 0x1, on? 1) for [CRTC:151:pipe A]
<7> [492.710048] xe 0000:03:00.0: [drm:intel_dpll_disable [xe]] disabling TC PLL 2
<7> [492.710807] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:507:DDI TC1/PHY F]
<7> [492.711253] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:509:DP-MST A]
<7> [492.711702] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:510:DP-MST B]
<7> [492.712074] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:511:DP-MST C]
<7> [492.712451] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:512:DP-MST D]
<7> [492.712858] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:526:DDI TC2/PHY G]
<7> [492.713393] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:528:DP-MST A]
<7> [492.713753] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:529:DP-MST B]
<7> [492.714056] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:530:DP-MST C]
<7> [492.714350] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:531:DP-MST D]
<7> [492.714680] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:538:DDI TC3/PHY H]
<7> [492.714975] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:542:DDI TC4/PHY I]
<7> [492.715261] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:544:DP-MST A]
<7> [492.715563] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:545:DP-MST B]
<7> [492.715838] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:546:DP-MST C]
<7> [492.716097] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:547:DP-MST D]
<7> [492.716358] xe 0000:03:00.0: [drm:verify_connector_state [xe]] [CONNECTOR:508:DP-1]
<7> [492.716852] xe 0000:03:00.0: [drm:verify_connector_state [xe]] [CONNECTOR:521:HDMI-A-1]
<7> [492.717301] xe 0000:03:00.0: [drm:verify_connector_state [xe]] [CONNECTOR:527:DP-2]
<7> [492.717754] xe 0000:03:00.0: [drm:verify_connector_state [xe]] [CONNECTOR:535:HDMI-A-2]
<7> [492.718172] xe 0000:03:00.0: [drm:verify_connector_state [xe]] [CONNECTOR:543:DP-3]
<7> [492.718373] xe 0000:03:00.0: [drm:verify_connector_state [xe]] [CONNECTOR:551:HDMI-A-4]
<7> [492.718829] xe 0000:03:00.0: [drm:intel_dpll_enable [xe]] enable TC PLL 3 (active 0x1, on? 0) for [CRTC:151:pipe A]
<7> [492.719050] xe 0000:03:00.0: [drm:intel_dpll_enable [xe]] enabling TC PLL 3
<7> [492.721549] xe 0000:03:00.0: [drm:intel_enable_transcoder [xe]] enabling pipe A
<7> [492.739735] xe 0000:03:00.0: [drm:intel_audio_codec_enable [xe]] [CONNECTOR:539:HDMI-A-3][ENCODER:538:DDI TC3/PHY H] Enable audio codec on [CRTC:151:pipe A], 36 bytes ELD
<7> [492.756070] xe 0000:03:00.0: [drm:audio_config_hdmi_pixel_clock [xe]] Configuring HDMI audio for pixel clock 148500 (0x00090000)
<7> [492.756768] xe 0000:03:00.0: [drm:hsw_audio_config_update [xe]] using automatic N
<7> [492.757782] xe 0000:03:00.0: [drm:verify_connector_state [xe]] [CONNECTOR:539:HDMI-A-3]
<7> [492.758509] xe 0000:03:00.0: [drm:intel_modeset_verify_crtc [xe]] [CRTC:151:pipe A]
<7> [492.763327] xe 0000:03:00.0: [drm:intel_pmdemand_program_params [xe]] initiate pmdemand request values: (0x1e03071 0x28d0df72)
<7> [492.765131] xe 0000:03:00.0: [drm:i915_fifo_underrun_reset_write [xe]] Re-arming FIFO underruns on pipe A
<7> [492.766012] xe 0000:03:00.0: [drm:i915_fifo_underrun_reset_write [xe]] Re-arming FIFO underruns on pipe A
<7> [492.810770] xe 0000:03:00.0: [drm:intel_power_well_disable [xe]] disabling AUX_TC2
<7> [492.823932] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:567]
<7> [492.847610] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:35:plane 1A] ddb ( 0 - 0) -> ( 0 - 4037), size 0 -> 4037
<7> [492.847902] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm
<7> [492.848134] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 3, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0
<7> [492.848332] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 19, 55, 55, 103, 103, 103, 103, 28, 91, 105
<7> [492.848634] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 22, 62, 62, 115, 115, 0, 0, 29, 102, 106
<7> [492.848825] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:151:pipe A] data rate 594000 num active planes 1
<7> [492.849041] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000
<7> [492.849246] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000
<7> [492.849437] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624
<7> [492.849699] xe 0000:03:00.0: [drm:intel_cdclk_update_dbuf_bw_min_cdclk [xe]] dbuf bandwidth min cdclk: 0 kHz -> 9282 kHz
<7> [492.872718] xe 0000:03:00.0: [drm:drm_mode_rmfb_work_fn] Removing [FB:567] from all active usage due to RMFB ioctl
<7> [492.872863] xe 0000:03:00.0: [drm:atomic_remove_fb] Disabling [PLANE:35:plane 1A] because [FB:567] is removed
<7> [492.872994] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:35:plane 1A] ddb ( 0 - 4037) -> ( 0 - 0), size 4037 -> 0
<7> [492.873548] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm
<7> [492.874012] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 3, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [492.874478] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 14, 19, 55, 55, 103, 103, 103, 103, 28, 91, 105 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [492.874934] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 17, 22, 62, 62, 115, 115, 0, 0, 29, 102, 106 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [492.875435] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:151:pipe A] data rate 0 num active planes 0
<7> [492.876067] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 0 qgv_peak_bw: 48000
<7> [492.876660] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 0 qgv_peak_bw: 48000
<7> [492.877209] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 0
<7> [492.890641] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:567]
<7> [492.910295] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:35:plane 1A] ddb ( 0 - 0) -> ( 0 - 4037), size 0 -> 4037
<7> [492.910630] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm
<7> [492.910898] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 3, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0
<7> [492.911142] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 19, 55, 55, 103, 103, 103, 103, 28, 91, 105
<7> [492.911366] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 22, 62, 62, 115, 115, 0, 0, 29, 102, 106
<7> [492.911683] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:151:pipe A] data rate 594000 num active planes 1
<7> [492.912054] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:35:plane 1A] ddb ( 0 - 0) -> ( 0 - 4037), size 0 -> 4037
<7> [492.912272] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm
<7> [492.912488] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 3, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0
<7> [492.912700] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 19, 55, 55, 103, 103, 103, 103, 28, 91, 105
<7> [492.912883] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 22, 62, 62, 115, 115, 0, 0, 29, 102, 106
<7> [492.913073] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:151:pipe A] data rate 594000 num active planes 1
<7> [492.913298] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000
<7> [492.913522] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000
<7> [492.913730] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624
<7> [492.940348] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:568]
<7> [492.956694] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:569]
<7> [493.023987] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:567]
<7> [493.043655] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:569]
<7> [493.107113] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:568]
<7> [493.126255] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:569]
<7> [493.190583] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:567]
<7> [493.210237] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:569]
<7> [493.274093] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:568]
<7> [493.292628] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:569]
<7> [493.373839] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:567]
<7> [493.394603] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:569]
<7> [493.457181] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:568]
<7> [493.477693] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:569]
<7> [493.540556] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:567]
<7> [493.558273] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:569]
<7> [493.640592] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:568]
<7> [493.665255] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:569]
<7> [493.689990] xe 0000:03:00.0: [drm:drm_mode_rmfb_work_fn] Removing [FB:567] from all active usage due to RMFB ioctl
<7> [493.740543] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:567]
<7> [493.762717] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:569]
<7> [493.789786] xe 0000:03:00.0: [drm:drm_mode_rmfb_work_fn] Removing [FB:568] from all active usage due to RMFB ioctl
<7> [493.840557] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:568]
<7> [493.861963] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:569]
<7> [493.940654] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:567]
<7> [493.963685] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm
<7> [493.964050] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 3, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 3, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0
<7> [493.964330] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 14, 19, 55, 55, 103, 103, 103, 103, 28, 91, 105 -> 14, 16, 46, 46, 86, 86, 86, 86, 28, 76, 90
<7> [493.964618] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 17, 22, 62, 62, 115, 115, 0, 0, 29, 102, 106 -> 17, 19, 52, 52, 96, 96, 0, 0, 29, 85, 91
<7> [493.989435] xe 0000:03:00.0: [drm:drm_mode_rmfb_work_fn] Removing [FB:567] from all active usage due to RMFB ioctl
<7> [493.989596] xe 0000:03:00.0: [drm:atomic_remove_fb] Disabling [PLANE:35:plane 1A] because [FB:567] is removed
<7> [493.989723] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:35:plane 1A] ddb ( 0 - 4037) -> ( 0 - 0), size 4037 -> 0
<7> [493.990228] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm
<7> [493.990756] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 3, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [493.991200] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 14, 16, 46, 46, 86, 86, 86, 86, 28, 76, 90 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [493.991660] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 17, 19, 52, 52, 96, 96, 0, 0, 29, 85, 91 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [493.992135] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:151:pipe A] data rate 0 num active planes 0
<7> [493.992734] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 0 qgv_peak_bw: 48000
<7> [493.993304] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 0 qgv_peak_bw: 48000
<7> [493.993909] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 0
<7> [494.007522] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:567]
<7> [494.027764] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:35:plane 1A] ddb ( 0 - 0) -> ( 0 - 4037), size 0 -> 4037
<7> [494.028130] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm
<7> [494.028428] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 3, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0
<7> [494.028740] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 16, 46, 46, 86, 86, 86, 86, 28, 76, 90
<7> [494.028992] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 19, 52, 52, 96, 96, 0, 0, 29, 85, 91
<7> [494.029273] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:151:pipe A] data rate 594000 num active planes 1
<7> [494.029597] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000
<7> [494.029863] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000
<7> [494.030119] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624
<7> [494.057212] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:569]
<7> [494.075893] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:570]
<7> [494.140748] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:567]
<7> [494.160960] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:570]
<7> [494.224005] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:569]
<7> [494.244238] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:570]
<7> [494.307329] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:567]
<7> [494.327572] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:570]
<7> [494.390720] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:569]
<7> [494.409641] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:570]
<7> [494.473989] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:567]
<7> [494.494390] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:570]
<7> [494.557305] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:569]
<7> [494.576763] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:570]
<7> [494.640738] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:567]
<7> [494.660364] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:570]
<7> [494.724044] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:569]
<7> [494.745239] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:570]
<7> [494.824041] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:567]
<7> [494.844319] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:570]
<7> [494.907362] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:569]
<7> [494.927051] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:570]
<7> [494.990697] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:567]
<7> [495.009663] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm
<7> [495.010026] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 3, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0
<7> [495.010333] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 14, 16, 46, 46, 86, 86, 86, 86, 28, 76, 90 -> 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 60
<7> [495.010670] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 17, 19, 52, 52, 96, 96, 0, 0, 29, 85, 91 -> 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 61
<7> [495.039510] xe 0000:03:00.0: [drm:drm_mode_rmfb_work_fn] Removing [FB:567] from all active usage due to RMFB ioctl
<7> [495.039662] xe 0000:03:00.0: [drm:atomic_remove_fb] Disabling [PLANE:35:plane 1A] because [FB:567] is removed
<7> [495.039789] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:35:plane 1A] ddb ( 0 - 4037) -> ( 0 - 0), size 4037 -> 0
<7> [495.040214] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm
<7> [495.040678] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [495.041070] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 60 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [495.041494] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 61 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [495.041950] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:151:pipe A] data rate 0 num active planes 0
<7> [495.042523] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 0 qgv_peak_bw: 48000
<7> [495.043053] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 0 qgv_peak_bw: 48000
<7> [495.043605] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 0
<7> [495.057510] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:567]
<7> [495.077831] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:35:plane 1A] ddb ( 0 - 0) -> ( 0 - 4037), size 0 -> 4037
<7> [495.078323] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm
<7> [495.078963] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0
<7> [495.079383] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 60
<7> [495.079821] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 61
<7> [495.080229] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:151:pipe A] data rate 594000 num active planes 1
<7> [495.080900] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:35:plane 1A] ddb ( 0 - 0) -> ( 0 - 4037), size 0 -> 4037
<7> [495.081232] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm
<7> [495.081579] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0
<7> [495.081874] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 60
<7> [495.082159] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 61
<7> [495.082437] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:151:pipe A] data rate 594000 num active planes 1
<7> [495.082961] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:35:plane 1A] ddb ( 0 - 0) -> ( 0 - 4037), size 0 -> 4037
<7> [495.083218] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm
<7> [495.083456] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0
<7> [495.083718] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 60
<7> [495.083951] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 61
<7> [495.084183] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:151:pipe A] data rate 594000 num active planes 1
<7> [495.084477] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000
<7> [495.084736] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000
<7> [495.084987] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624
<7> [495.107160] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:570]
<7> [495.125100] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:571]
<7> [495.190820] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:567]
<7> [495.210684] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:571]
<3> [497.322879] [drm:drm_crtc_add_crc_entry] *ERROR* Overflow of CRC buffer, userspace reads too slow.
<4> [500.323612] ------------[ cut here ]------------
<4> [500.323632] xe 0000:03:00.0: [drm] Tile0: GT0: Unexpected engine class:instance 3:8 for context utilization
<4> [500.323645] WARNING: drivers/gpu/drm/xe/xe_lrc.c:2580 at xe_lrc_timestamp+0x196/0x460 [xe], CPU#0: kworker/u64:56/7470
<4> [500.324075] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [500.324434] autofs4 [last unloaded: snd_hda_intel]
<4> [500.324456] CPU: 0 UID: 0 PID: 7470 Comm: kworker/u64:56 Tainted: G S U L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [500.324511] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [L]=SOFTLOCKUP
<4> [500.324521] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [500.324532] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [500.324571] RIP: 0010:xe_lrc_timestamp+0x1a7/0x460 [xe]
<4> [500.325149] Code: b6 79 26 48 89 55 c8 88 45 d0 e8 44 f4 5c e1 48 89 c6 48 8d 3d aa ba 37 00 0f b6 4d d0 41 54 45 89 e9 45 0f b6 c7 48 8b 55 c8 <67> 48 0f b9 3a 58 eb 91 41 0f b6 bd 99 0f 00 00 e8 a4 f5 03 00 41
<4> [500.325166] RSP: 0018:ffffc90002f83c00 EFLAGS: 00010246
<4> [500.325189] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [500.325204] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1004f50
<4> [500.325218] RBP: ffffc90002f83c90 R08: 0000000000000000 R09: 0000000000000003
<4> [500.325231] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000008
<4> [500.325243] R13: 0000000000000003 R14: ffff888104f05d00 R15: 0000000000000000
<4> [500.325256] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [500.325270] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [500.325285] CR2: 000073002d414540 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [500.325299] PKRU: 55555554
<4> [500.325312] Call Trace:
<4> [500.325324] <TASK>
<4> [500.325344] ? enable_work+0x9d/0x100
<4> [500.325386] ? xe_lrc_start_seqno+0x33/0x70 [xe]
<4> [500.326134] guc_exec_queue_timedout_job+0xf80/0x2400 [xe]
<4> [500.326772] ? lock_sync+0x100/0x100
<4> [500.326813] ? lock_release+0xd0/0x2b0
<4> [500.326863] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [500.326917] process_one_work+0x239/0x760
<4> [500.326977] worker_thread+0x200/0x3f0
<4> [500.327003] ? __pfx_worker_thread+0x10/0x10
<4> [500.327025] kthread+0x10d/0x150
<4> [500.327050] ? __pfx_kthread+0x10/0x10
<4> [500.327082] ret_from_fork+0x3d4/0x480
<4> [500.327100] ? __pfx_kthread+0x10/0x10
<4> [500.327130] ret_from_fork_asm+0x1a/0x30
<4> [500.327201] </TASK>
<4> [500.327212] irq event stamp: 409391
<4> [500.327223] hardirqs last enabled at (409397): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [500.327247] hardirqs last disabled at (409402): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [500.327266] softirqs last enabled at (408590): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [500.327288] softirqs last disabled at (408555): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [500.327307] ---[ end trace 0000000000000000 ]---
<7> [500.327440] xe 0000:03:00.0: [drm:guc_exec_queue_timedout_job [xe]] Tile0: GT0: Check job timeout: seqno=19050, lrc_seqno=19050, guc_id=0, running_time_ms=234197, timeout_ms=5000, diff=0xff41529a
<6> [500.968535] xe 0000:03:00.0: [drm] Tile0: GT0: Engine reset: engine_class=bcs, logical_mask: 0x2, guc_id=0, state=0x209
<5> [500.969147] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19050, lrc_seqno=19050, guc_id=0, flags=0x73 in no process [-1]
<7> [500.969178] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [500.969658] ------------[ cut here ]------------
<4> [500.969666] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [500.969674] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:56/7470
<4> [500.970089] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [500.970439] autofs4 [last unloaded: snd_hda_intel]
<4> [500.970499] CPU: 10 UID: 0 PID: 7470 Comm: kworker/u64:56 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [500.970516] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [500.970523] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [500.970532] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [500.970563] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [500.970953] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [500.970963] RSP: 0018:ffffc90002f83ca0 EFLAGS: 00010246
<4> [500.970976] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [500.970985] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [500.970992] RBP: ffffc90002f83db0 R08: 0000000000000000 R09: 0000000000000000
<4> [500.970999] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [500.971006] R13: ffff8881294a5f90 R14: ffff88816e230000 R15: 00000000ffffffc2
<4> [500.971014] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [500.971024] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [500.971032] CR2: 00007b49ac096428 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [500.971041] PKRU: 55555554
<4> [500.971047] Call Trace:
<4> [500.971053] <TASK>
<4> [500.971075] ? lock_sync+0x100/0x100
<4> [500.971103] ? __pfx_autoremove_wake_function+0x10/0x10
<4> [500.971131] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [500.971161] process_one_work+0x239/0x760
<4> [500.971194] worker_thread+0x200/0x3f0
<4> [500.971209] ? __pfx_worker_thread+0x10/0x10
<4> [500.971221] kthread+0x10d/0x150
<4> [500.971237] ? __pfx_kthread+0x10/0x10
<4> [500.971256] ret_from_fork+0x3d4/0x480
<4> [500.971267] ? __pfx_kthread+0x10/0x10
<4> [500.971285] ret_from_fork_asm+0x1a/0x30
<4> [500.971324] </TASK>
<4> [500.971330] irq event stamp: 410241
<4> [500.971336] hardirqs last enabled at (410247): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [500.971352] hardirqs last disabled at (410252): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [500.971363] softirqs last enabled at (409478): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [500.971377] softirqs last disabled at (409469): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [500.971388] ---[ end trace 0000000000000000 ]---
<6> [500.971398] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [500.971853] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [500.972222] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [500.972298] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [500.972934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [500.973407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [500.974032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [500.974203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [500.974293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [500.974376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [500.974472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [500.974563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [500.974644] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [500.974731] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [500.974840] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [500.975856] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [500.986582] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [500.986982] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [500.988758] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [500.988986] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [500.989186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [500.989383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [500.989614] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [500.989821] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [500.990094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [500.990311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [500.990543] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [500.990733] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [500.990922] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [500.991109] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [500.991285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [500.991541] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [500.991724] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [500.991906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [500.992075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [500.992251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [500.992417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [500.992629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [500.992819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [500.993039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [500.993221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [500.993377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [500.993556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [500.993715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [500.993864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [500.994065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [500.994223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [500.994371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [500.994528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [500.994668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [500.994808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [500.994948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [500.995136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [500.995289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [500.995428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [500.995571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [500.995696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [500.995816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [500.995937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [500.996095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [500.996231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [500.996353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [500.996484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [500.996595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [500.996706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [500.996809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [500.996917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [500.997062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [500.997182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [500.997287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [500.997397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [500.997511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [500.997614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [500.997716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [500.997828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [500.997945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [500.998054] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [500.999305] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<7> [500.999383] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [500.999503] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [505.863081] xe 0000:03:00.0: [drm:xe_hwmon_read [xe]] thermal data for group 0 val 0x30302d2e
<7> [505.863692] xe 0000:03:00.0: [drm:xe_hwmon_read [xe]] thermal data for group 1 val 0x302f2f30
<5> [506.466839] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19050, lrc_seqno=19050, guc_id=0, flags=0x73 in no process [-1]
<7> [506.466871] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [506.467320] ------------[ cut here ]------------
<4> [506.467328] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [506.467337] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:57/7471
<4> [506.467886] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [506.468282] autofs4 [last unloaded: snd_hda_intel]
<4> [506.468309] CPU: 12 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [506.468327] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [506.468336] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [506.468346] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [506.468381] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [506.468880] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [506.468892] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [506.468906] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [506.468916] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [506.468926] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [506.468935] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [506.468944] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [506.468954] FS: 0000000000000000(0000) GS:ffff8888db297000(0000) knlGS:0000000000000000
<4> [506.468965] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [506.468975] CR2: 0000737d00007400 CR3: 000000000344c003 CR4: 0000000000f72ef0
<4> [506.468985] PKRU: 55555554
<4> [506.468993] Call Trace:
<4> [506.469003] <TASK>
<4> [506.469032] ? lock_sync+0x100/0x100
<4> [506.469065] ? lock_release+0xd0/0x2b0
<4> [506.469102] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [506.469141] process_one_work+0x239/0x760
<4> [506.469186] worker_thread+0x200/0x3f0
<4> [506.469204] ? __pfx_worker_thread+0x10/0x10
<4> [506.469220] kthread+0x10d/0x150
<4> [506.469238] ? __pfx_kthread+0x10/0x10
<4> [506.469262] ret_from_fork+0x3d4/0x480
<4> [506.469276] ? __pfx_kthread+0x10/0x10
<4> [506.469297] ret_from_fork_asm+0x1a/0x30
<4> [506.469350] </TASK>
<4> [506.469358] irq event stamp: 369619
<4> [506.469366] hardirqs last enabled at (369625): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [506.469384] hardirqs last disabled at (369630): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [506.469399] softirqs last enabled at (369458): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [506.469414] softirqs last disabled at (369453): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [506.469429] ---[ end trace 0000000000000000 ]---
<6> [506.469563] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [506.470059] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [506.470117] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [506.470598] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [506.471202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [506.471735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [506.472222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [506.472898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [506.473225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [506.473306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [506.473399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [506.473515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [506.473597] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [506.473692] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [506.473801] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [506.474821] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [506.485827] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [506.486266] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [506.488144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [506.488363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [506.488617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [506.488834] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [506.489044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [506.489251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [506.489469] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [506.489732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [506.489946] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [506.490161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [506.490350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [506.490561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [506.490744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [506.490937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [506.491155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [506.491340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [506.491550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [506.491718] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [506.491885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [506.492068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [506.492243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [506.492453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [506.492686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [506.492855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [506.493011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [506.493169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [506.493320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [506.493487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [506.493676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [506.493828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [506.493972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [506.494113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [506.494261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [506.494400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [506.494573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [506.494725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [506.494863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [506.494997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [506.495118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [506.495238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [506.495366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [506.495511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [506.495653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [506.495773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [506.495901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [506.496019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [506.496134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [506.496238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [506.496343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [506.496443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [506.496609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [506.496721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [506.496821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [506.496933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [506.497039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [506.497138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [506.497234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [506.497329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [506.497450] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [506.497613] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<7> [506.498623] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [506.498729] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [511.586773] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19050, lrc_seqno=19050, guc_id=0, flags=0x73 in no process [-1]
<7> [511.586801] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [511.587134] ------------[ cut here ]------------
<4> [511.587142] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [511.587150] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:32/7445
<4> [511.587591] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [511.587941] autofs4 [last unloaded: snd_hda_intel]
<4> [511.587965] CPU: 4 UID: 0 PID: 7445 Comm: kworker/u64:32 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [511.587982] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [511.587989] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [511.587997] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [511.588026] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [511.588391] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [511.588402] RSP: 0018:ffffc9000237bca0 EFLAGS: 00010246
<4> [511.588414] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [511.588423] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [511.588431] RBP: ffffc9000237bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [511.588438] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [511.588445] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [511.588453] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [511.588484] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [511.588492] CR2: 0000737de22cb2b0 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [511.588500] PKRU: 55555554
<4> [511.588507] Call Trace:
<4> [511.588515] <TASK>
<4> [511.588537] ? lock_sync+0x100/0x100
<4> [511.588562] ? lock_release+0xd0/0x2b0
<4> [511.588591] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [511.588621] process_one_work+0x239/0x760
<4> [511.588654] worker_thread+0x200/0x3f0
<4> [511.588669] ? __pfx_worker_thread+0x10/0x10
<4> [511.588683] kthread+0x10d/0x150
<4> [511.588699] ? __pfx_kthread+0x10/0x10
<4> [511.588719] ret_from_fork+0x3d4/0x480
<4> [511.588731] ? __pfx_kthread+0x10/0x10
<4> [511.588749] ret_from_fork_asm+0x1a/0x30
<4> [511.588788] </TASK>
<4> [511.588795] irq event stamp: 407863
<4> [511.588802] hardirqs last enabled at (407869): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [511.588818] hardirqs last disabled at (407874): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [511.588832] softirqs last enabled at (405974): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.588846] softirqs last disabled at (405967): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.588858] ---[ end trace 0000000000000000 ]---
<5> [511.600725] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19052, lrc_seqno=19052, guc_id=0, flags=0x73 in no process [-1]
<7> [511.600731] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [511.600795] ------------[ cut here ]------------
<4> [511.600796] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [511.600798] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:51/7465
<4> [511.600873] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [511.600938] autofs4 [last unloaded: snd_hda_intel]
<4> [511.600942] CPU: 10 UID: 0 PID: 7465 Comm: kworker/u64:51 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [511.600945] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [511.600946] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [511.600948] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [511.600953] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [511.601024] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [511.601026] RSP: 0018:ffffc90002f5bca0 EFLAGS: 00010246
<4> [511.601028] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [511.601030] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [511.601031] RBP: ffffc90002f5bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [511.601032] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [511.601034] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [511.601035] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [511.601036] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [511.601038] CR2: 000000c000437000 CR3: 000000012d64b005 CR4: 0000000000f72ef0
<4> [511.601039] PKRU: 55555554
<4> [511.601041] Call Trace:
<4> [511.601042] <TASK>
<4> [511.601046] ? lock_sync+0x100/0x100
<4> [511.601051] ? lock_release+0xd0/0x2b0
<4> [511.601056] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [511.601062] process_one_work+0x239/0x760
<4> [511.601068] worker_thread+0x200/0x3f0
<4> [511.601071] ? __pfx_worker_thread+0x10/0x10
<4> [511.601073] kthread+0x10d/0x150
<4> [511.601076] ? __pfx_kthread+0x10/0x10
<4> [511.601080] ret_from_fork+0x3d4/0x480
<4> [511.601082] ? __pfx_kthread+0x10/0x10
<4> [511.601085] ret_from_fork_asm+0x1a/0x30
<4> [511.601092] </TASK>
<4> [511.601094] irq event stamp: 414799
<4> [511.601095] hardirqs last enabled at (414805): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [511.601098] hardirqs last disabled at (414810): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [511.601100] softirqs last enabled at (413630): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.601102] softirqs last disabled at (413623): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.601104] ---[ end trace 0000000000000000 ]---
<6> [511.601106] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [511.601177] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [511.601184] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [511.601598] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [511.601814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [511.601908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [511.602002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [511.602093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [511.602209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [511.602295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [511.602381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [511.602474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [511.602556] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [511.602651] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [511.602769] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [511.603785] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [511.614807] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [511.615076] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [511.616153] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [511.616254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [511.616351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [511.616448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [511.616564] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [511.616660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [511.616754] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [511.616849] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [511.616945] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [511.617042] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [511.617136] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [511.617232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [511.617322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [511.617412] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [511.617514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [511.617603] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [511.617693] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [511.617796] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [511.617883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [511.617978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [511.618075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [511.618173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [511.618263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [511.618351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [511.618435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [511.618533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [511.618620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [511.618709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [511.618795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [511.618878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [511.618963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [511.619047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [511.619137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [511.619222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [511.619306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [511.619386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [511.619470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [511.619550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [511.619632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [511.619714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [511.619796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [511.619876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [511.619954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [511.620032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [511.620125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [511.620204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [511.620282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [511.620362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [511.620444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [511.620538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [511.620616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [511.620698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [511.620779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [511.620860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [511.620937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [511.621016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [511.621092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [511.621169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [511.621248] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [511.621373] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [511.621377] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19052, lrc_seqno=19052, guc_id=0, flags=0x73 in no process [-1]
<7> [511.621380] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [511.621439] ------------[ cut here ]------------
<4> [511.621441] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [511.621442] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:32/7445
<4> [511.621527] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [511.621594] autofs4 [last unloaded: snd_hda_intel]
<4> [511.621598] CPU: 7 UID: 0 PID: 7445 Comm: kworker/u64:32 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [511.621601] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [511.621602] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [511.621603] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [511.621609] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [511.621679] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [511.621681] RSP: 0018:ffffc9000237bca0 EFLAGS: 00010246
<4> [511.621683] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [511.621685] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [511.621686] RBP: ffffc9000237bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [511.621687] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [511.621688] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [511.621690] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000
<4> [511.621691] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [511.621693] CR2: 00007b3f4f873000 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [511.621694] PKRU: 55555554
<4> [511.621695] Call Trace:
<4> [511.621696] <TASK>
<4> [511.621701] ? lock_sync+0x100/0x100
<4> [511.621705] ? lock_release+0xd0/0x2b0
<4> [511.621711] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [511.621716] process_one_work+0x239/0x760
<4> [511.621723] worker_thread+0x200/0x3f0
<4> [511.621725] ? __pfx_worker_thread+0x10/0x10
<4> [511.621728] kthread+0x10d/0x150
<4> [511.621731] ? __pfx_kthread+0x10/0x10
<4> [511.621734] ret_from_fork+0x3d4/0x480
<4> [511.621736] ? __pfx_kthread+0x10/0x10
<4> [511.621740] ret_from_fork_asm+0x1a/0x30
<4> [511.621747] </TASK>
<4> [511.621748] irq event stamp: 411111
<4> [511.621749] hardirqs last enabled at (411117): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [511.621752] hardirqs last disabled at (411122): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [511.621755] softirqs last enabled at (410018): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.621757] softirqs last disabled at (410009): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.621759] ---[ end trace 0000000000000000 ]---
<6> [511.621761] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [511.621832] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [511.621838] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [511.622245] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [511.622450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [511.622558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [511.622650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [511.622738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [511.622825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [511.622911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [511.622999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [511.623089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [511.623173] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [511.623268] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [511.623382] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [511.624386] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [511.635107] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [511.635348] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [511.636436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [511.636524] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [511.636595] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [511.636667] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [511.636737] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [511.636805] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [511.636873] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [511.636941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [511.637008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [511.637075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [511.637141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [511.637208] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [511.637274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [511.637343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [511.637413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [511.637491] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [511.637560] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [511.637628] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [511.637696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [511.637770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [511.637845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [511.637918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [511.637991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [511.638063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [511.638134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [511.638208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [511.638282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [511.638357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [511.638431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [511.638515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [511.638592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [511.638668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [511.638747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [511.638824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [511.638900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [511.638974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [511.639046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [511.639118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [511.639191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [511.639263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [511.639336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [511.639408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [511.639488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [511.639563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [511.639637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [511.639713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [511.639789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [511.639862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [511.639936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [511.640007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [511.640079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [511.640151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [511.640222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [511.640293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [511.640364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [511.640435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [511.640517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [511.640591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [511.640664] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [511.640775] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [511.640779] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19052, lrc_seqno=19052, guc_id=0, flags=0x73 in no process [-1]
<7> [511.640781] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [511.640834] ------------[ cut here ]------------
<4> [511.640836] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [511.640837] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:32/7445
<4> [511.640902] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [511.640961] autofs4 [last unloaded: snd_hda_intel]
<4> [511.640965] CPU: 7 UID: 0 PID: 7445 Comm: kworker/u64:32 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [511.640968] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [511.640969] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [511.640970] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [511.640975] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [511.641038] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [511.641039] RSP: 0018:ffffc9000237bca0 EFLAGS: 00010246
<4> [511.641042] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [511.641043] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [511.641044] RBP: ffffc9000237bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [511.641045] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [511.641046] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [511.641047] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000
<4> [511.641049] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [511.641050] CR2: 00007b3f4f873000 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [511.641051] PKRU: 55555554
<4> [511.641052] Call Trace:
<4> [511.641053] <TASK>
<4> [511.641057] ? lock_sync+0x100/0x100
<4> [511.641061] ? lock_release+0xd0/0x2b0
<4> [511.641066] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [511.641071] process_one_work+0x239/0x760
<4> [511.641077] worker_thread+0x200/0x3f0
<4> [511.641079] ? __pfx_worker_thread+0x10/0x10
<4> [511.641082] kthread+0x10d/0x150
<4> [511.641084] ? __pfx_kthread+0x10/0x10
<4> [511.641087] ret_from_fork+0x3d4/0x480
<4> [511.641089] ? __pfx_kthread+0x10/0x10
<4> [511.641092] ret_from_fork_asm+0x1a/0x30
<4> [511.641099] </TASK>
<4> [511.641100] irq event stamp: 414225
<4> [511.641101] hardirqs last enabled at (414231): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [511.641103] hardirqs last disabled at (414236): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [511.641105] softirqs last enabled at (413268): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.641108] softirqs last disabled at (413263): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.641110] ---[ end trace 0000000000000000 ]---
<7> [511.642135] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [511.642235] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [511.707943] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19053, lrc_seqno=19053, guc_id=0, flags=0x73 in no process [-1]
<7> [511.707969] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<7> [511.708339] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:570]
<4> [511.708366] ------------[ cut here ]------------
<4> [511.708373] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [511.708381] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:57/7471
<4> [511.708886] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [511.709240] autofs4 [last unloaded: snd_hda_intel]
<4> [511.709263] CPU: 8 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [511.709279] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [511.709286] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [511.709295] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [511.709323] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [511.709762] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [511.709772] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [511.709785] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [511.709794] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [511.709801] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [511.709809] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [511.709816] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [511.709823] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [511.709833] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [511.709841] CR2: 00007b3f4f873000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [511.709849] PKRU: 55555554
<4> [511.709857] Call Trace:
<4> [511.709864] <TASK>
<4> [511.709886] ? lock_sync+0x100/0x100
<4> [511.709911] ? lock_release+0xd0/0x2b0
<4> [511.709942] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [511.709973] process_one_work+0x239/0x760
<4> [511.710006] worker_thread+0x200/0x3f0
<4> [511.710021] ? __pfx_worker_thread+0x10/0x10
<4> [511.710035] kthread+0x10d/0x150
<4> [511.710050] ? __pfx_kthread+0x10/0x10
<4> [511.710070] ret_from_fork+0x3d4/0x480
<4> [511.710082] ? __pfx_kthread+0x10/0x10
<4> [511.710100] ret_from_fork_asm+0x1a/0x30
<4> [511.710139] </TASK>
<4> [511.710145] irq event stamp: 374863
<4> [511.710151] hardirqs last enabled at (374869): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [511.710167] hardirqs last disabled at (374874): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [511.710179] softirqs last enabled at (374118): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.710193] softirqs last disabled at (374111): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.710206] ---[ end trace 0000000000000000 ]---
<6> [511.710216] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [511.710638] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [511.710686] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [511.711113] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [511.712083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [511.712680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [511.712835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [511.712921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [511.713020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [511.713117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [511.713212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [511.713308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [511.713397] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [511.713512] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [511.713639] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [511.714725] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [511.725524] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [511.725858] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [511.727014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [511.727152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [511.727278] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [511.727403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [511.727547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [511.727666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [511.727786] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [511.727900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [511.728015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [511.728134] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [511.728247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [511.728354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [511.728467] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [511.728570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [511.728672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [511.728772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [511.728870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [511.728968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [511.729065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [511.729173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [511.729280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [511.729379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [511.729484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [511.729579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [511.729677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [511.729773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [511.729864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [511.729957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [511.730051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [511.730151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [511.730242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [511.730332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [511.730428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [511.730528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [511.730619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [511.730705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [511.730789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [511.730871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [511.730953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [511.731035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [511.731124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [511.731213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [511.731298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [511.731381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [511.731469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [511.731553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [511.731635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [511.731716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [511.731798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [511.731878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [511.731963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [511.732052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [511.732137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [511.732221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [511.732304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [511.732386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [511.732477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [511.732564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [511.732652] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [511.732770] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [511.732776] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19053, lrc_seqno=19053, guc_id=0, flags=0x73 in no process [-1]
<7> [511.732779] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [511.732841] ------------[ cut here ]------------
<4> [511.732842] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [511.732844] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:57/7471
<4> [511.732922] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [511.732996] autofs4 [last unloaded: snd_hda_intel]
<4> [511.733001] CPU: 8 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [511.733004] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [511.733005] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [511.733007] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [511.733012] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [511.733086] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [511.733088] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [511.733090] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [511.733091] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [511.733093] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [511.733094] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [511.733095] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [511.733096] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [511.733098] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [511.733099] CR2: 00007b3f4f873000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [511.733101] PKRU: 55555554
<4> [511.733102] Call Trace:
<4> [511.733103] <TASK>
<4> [511.733107] ? lock_sync+0x100/0x100
<4> [511.733112] ? lock_release+0xd0/0x2b0
<4> [511.733118] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [511.733124] process_one_work+0x239/0x760
<4> [511.733130] worker_thread+0x200/0x3f0
<4> [511.733133] ? __pfx_worker_thread+0x10/0x10
<4> [511.733135] kthread+0x10d/0x150
<4> [511.733138] ? __pfx_kthread+0x10/0x10
<4> [511.733142] ret_from_fork+0x3d4/0x480
<4> [511.733144] ? __pfx_kthread+0x10/0x10
<4> [511.733148] ret_from_fork_asm+0x1a/0x30
<4> [511.733155] </TASK>
<4> [511.733156] irq event stamp: 378041
<4> [511.733158] hardirqs last enabled at (378047): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [511.733161] hardirqs last disabled at (378052): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [511.733163] softirqs last enabled at (377178): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.733166] softirqs last disabled at (377167): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.733168] ---[ end trace 0000000000000000 ]---
<6> [511.733170] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [511.733244] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [511.733249] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [511.733662] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [511.733870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [511.733964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [511.734063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [511.734156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [511.734254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [511.734350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [511.734442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [511.734552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [511.734646] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [511.734749] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [511.734872] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [511.735884] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [511.746609] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [511.746854] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [511.747821] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [511.747906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [511.747988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [511.748071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [511.748153] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [511.748233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [511.748312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [511.748392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [511.748475] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [511.748554] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [511.748632] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [511.748711] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [511.748794] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [511.748875] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [511.748956] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [511.749036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [511.749115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [511.749194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [511.749273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [511.749359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [511.749444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [511.749539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [511.749625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [511.749708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [511.749792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [511.749877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [511.749963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [511.750050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [511.750135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [511.750218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [511.750302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [511.750386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [511.750479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [511.750568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [511.750660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [511.750750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [511.750836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [511.750921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [511.751004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [511.751085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [511.751170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [511.751254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [511.751335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [511.751416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [511.751508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [511.751591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [511.751673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [511.751755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [511.751836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [511.751916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [511.751996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [511.752081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [511.752163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [511.752244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [511.752327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [511.752413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [511.752503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [511.752586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [511.752671] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [511.752788] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [511.752792] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19053, lrc_seqno=19053, guc_id=0, flags=0x73 in no process [-1]
<7> [511.752795] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [511.752857] ------------[ cut here ]------------
<4> [511.752858] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [511.752859] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:57/7471
<4> [511.752934] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [511.752997] autofs4 [last unloaded: snd_hda_intel]
<4> [511.753001] CPU: 8 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [511.753004] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [511.753005] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [511.753007] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [511.753012] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [511.753085] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [511.753087] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [511.753090] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [511.753092] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [511.753093] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [511.753094] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [511.753096] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [511.753098] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [511.753099] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [511.753101] CR2: 00007b3f4f873000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [511.753103] PKRU: 55555554
<4> [511.753104] Call Trace:
<4> [511.753105] <TASK>
<4> [511.753109] ? lock_sync+0x100/0x100
<4> [511.753114] ? lock_release+0xd0/0x2b0
<4> [511.753120] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [511.753126] process_one_work+0x239/0x760
<4> [511.753132] worker_thread+0x200/0x3f0
<4> [511.753135] ? __pfx_worker_thread+0x10/0x10
<4> [511.753138] kthread+0x10d/0x150
<4> [511.753141] ? __pfx_kthread+0x10/0x10
<4> [511.753145] ret_from_fork+0x3d4/0x480
<4> [511.753147] ? __pfx_kthread+0x10/0x10
<4> [511.753151] ret_from_fork_asm+0x1a/0x30
<4> [511.753158] </TASK>
<4> [511.753160] irq event stamp: 381163
<4> [511.753161] hardirqs last enabled at (381169): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [511.753164] hardirqs last disabled at (381174): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [511.753167] softirqs last enabled at (380122): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.753169] softirqs last disabled at (380113): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.753172] ---[ end trace 0000000000000000 ]---
<7> [511.754230] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [511.754360] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [511.757516] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19062, lrc_seqno=19062, guc_id=0, flags=0x73 in no process [-1]
<7> [511.757521] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [511.757589] ------------[ cut here ]------------
<4> [511.757590] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [511.757592] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:32/7445
<4> [511.757667] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [511.757735] autofs4 [last unloaded: snd_hda_intel]
<4> [511.757739] CPU: 4 UID: 0 PID: 7445 Comm: kworker/u64:32 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [511.757742] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [511.757743] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [511.757745] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [511.757751] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [511.757822] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [511.757824] RSP: 0018:ffffc9000237bca0 EFLAGS: 00010246
<4> [511.757827] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [511.757828] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [511.757829] RBP: ffffc9000237bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [511.757831] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [511.757832] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [511.757833] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [511.757835] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [511.757836] CR2: 0000737de22cb2b0 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [511.757838] PKRU: 55555554
<4> [511.757839] Call Trace:
<4> [511.757840] <TASK>
<4> [511.757844] ? lock_sync+0x100/0x100
<4> [511.757849] ? lock_release+0xd0/0x2b0
<4> [511.757855] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [511.757860] process_one_work+0x239/0x760
<4> [511.757867] worker_thread+0x200/0x3f0
<4> [511.757869] ? __pfx_worker_thread+0x10/0x10
<4> [511.757872] kthread+0x10d/0x150
<4> [511.757875] ? __pfx_kthread+0x10/0x10
<4> [511.757879] ret_from_fork+0x3d4/0x480
<4> [511.757881] ? __pfx_kthread+0x10/0x10
<4> [511.757884] ret_from_fork_asm+0x1a/0x30
<4> [511.757892] </TASK>
<4> [511.757893] irq event stamp: 416755
<4> [511.757894] hardirqs last enabled at (416761): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [511.757897] hardirqs last disabled at (416766): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [511.757899] softirqs last enabled at (415334): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.757902] softirqs last disabled at (415327): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.757904] ---[ end trace 0000000000000000 ]---
<6> [511.757906] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [511.757979] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [511.757986] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [511.758391] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [511.758598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [511.758689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [511.758783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [511.758872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [511.758964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [511.759052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [511.759140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [511.759229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [511.759313] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [511.759412] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [511.759539] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [511.760549] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [511.770508] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [511.770766] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [511.771814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [511.771896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [511.771975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [511.772054] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [511.772132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [511.772208] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [511.772283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [511.772362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [511.772440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [511.772533] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [511.772625] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [511.772701] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [511.772776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [511.772849] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [511.772923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [511.772999] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [511.773073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [511.773147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [511.773221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [511.773304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [511.773387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [511.773472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [511.773573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [511.773657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [511.773737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [511.773816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [511.773894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [511.773978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [511.774062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [511.774142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [511.774222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [511.774302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [511.774387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [511.774497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [511.774608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [511.774689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [511.774771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [511.774855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [511.774936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [511.775015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [511.775096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [511.775176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [511.775256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [511.775336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [511.775421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [511.775513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [511.775611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [511.775693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [511.775776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [511.775855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [511.775931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [511.776012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [511.776090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [511.776169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [511.776245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [511.776323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [511.776398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [511.776479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [511.776582] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [511.776699] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [511.776704] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19062, lrc_seqno=19062, guc_id=0, flags=0x73 in no process [-1]
<7> [511.776706] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [511.776766] ------------[ cut here ]------------
<4> [511.776767] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [511.776768] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:57/7471
<4> [511.776840] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [511.776908] autofs4 [last unloaded: snd_hda_intel]
<4> [511.776912] CPU: 10 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [511.776915] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [511.776916] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [511.776918] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [511.776923] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [511.776992] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [511.776994] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [511.776996] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [511.776998] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [511.776999] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [511.777000] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [511.777001] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [511.777003] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [511.777004] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [511.777006] CR2: 000000c000437000 CR3: 000000012d64b005 CR4: 0000000000f72ef0
<4> [511.777007] PKRU: 55555554
<4> [511.777009] Call Trace:
<4> [511.777010] <TASK>
<4> [511.777014] ? lock_sync+0x100/0x100
<4> [511.777018] ? lock_release+0xd0/0x2b0
<4> [511.777024] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [511.777030] process_one_work+0x239/0x760
<4> [511.777036] worker_thread+0x200/0x3f0
<4> [511.777039] ? __pfx_worker_thread+0x10/0x10
<4> [511.777041] kthread+0x10d/0x150
<4> [511.777044] ? __pfx_kthread+0x10/0x10
<4> [511.777048] ret_from_fork+0x3d4/0x480
<4> [511.777050] ? __pfx_kthread+0x10/0x10
<4> [511.777053] ret_from_fork_asm+0x1a/0x30
<4> [511.777061] </TASK>
<4> [511.777062] irq event stamp: 384749
<4> [511.777063] hardirqs last enabled at (384755): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [511.777066] hardirqs last disabled at (384760): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [511.777068] softirqs last enabled at (383812): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.777071] softirqs last disabled at (383805): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.777073] ---[ end trace 0000000000000000 ]---
<6> [511.777075] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [511.777144] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [511.777151] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [511.778401] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [511.778522] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [511.778866] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [511.779081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [511.779175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [511.779273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [511.779367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [511.779466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [511.779556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [511.779646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [511.779735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [511.779818] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [511.779914] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [511.780033] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [511.781047] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [511.791773] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [511.792025] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [511.793059] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [511.793139] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [511.793216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [511.793295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [511.793372] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [511.793450] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [511.793544] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [511.793621] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [511.793697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [511.793773] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [511.793848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [511.793923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [511.793998] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [511.794072] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [511.794147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [511.794221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [511.794295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [511.794369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [511.794443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [511.794537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [511.794619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [511.794702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [511.794787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [511.794867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [511.794947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [511.795026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [511.795104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [511.795184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [511.795266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [511.795349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [511.795431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [511.795522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [511.795607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [511.795695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [511.795780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [511.795861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [511.795942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [511.796020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [511.796096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [511.796172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [511.796252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [511.796329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [511.796406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [511.796491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [511.796576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [511.796656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [511.796735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [511.796812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [511.796890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [511.796965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [511.797041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [511.797121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [511.797201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [511.797283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [511.797362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [511.797441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [511.797528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [511.797604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [511.797683] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [511.797798] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [511.797803] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19062, lrc_seqno=19062, guc_id=0, flags=0x73 in no process [-1]
<7> [511.797806] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [511.797865] ------------[ cut here ]------------
<4> [511.797866] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [511.797867] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:51/7465
<4> [511.797939] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [511.798019] autofs4 [last unloaded: snd_hda_intel]
<4> [511.798024] CPU: 6 UID: 0 PID: 7465 Comm: kworker/u64:51 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [511.798027] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [511.798029] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [511.798030] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [511.798036] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [511.798106] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [511.798108] RSP: 0018:ffffc90002f5bca0 EFLAGS: 00010246
<4> [511.798111] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [511.798113] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [511.798114] RBP: ffffc90002f5bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [511.798115] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [511.798117] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [511.798118] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [511.798120] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [511.798122] CR2: 00007b3f4f70b000 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [511.798124] PKRU: 55555554
<4> [511.798125] Call Trace:
<4> [511.798127] <TASK>
<4> [511.798131] ? lock_sync+0x100/0x100
<4> [511.798136] ? lock_release+0xd0/0x2b0
<4> [511.798142] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [511.798148] process_one_work+0x239/0x760
<4> [511.798155] worker_thread+0x200/0x3f0
<4> [511.798158] ? __pfx_worker_thread+0x10/0x10
<4> [511.798161] kthread+0x10d/0x150
<4> [511.798164] ? __pfx_kthread+0x10/0x10
<4> [511.798168] ret_from_fork+0x3d4/0x480
<4> [511.798170] ? __pfx_kthread+0x10/0x10
<4> [511.798173] ret_from_fork_asm+0x1a/0x30
<4> [511.798180] </TASK>
<4> [511.798182] irq event stamp: 418389
<4> [511.798183] hardirqs last enabled at (418395): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [511.798186] hardirqs last disabled at (418400): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [511.798188] softirqs last enabled at (417340): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.798191] softirqs last disabled at (417331): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.798193] ---[ end trace 0000000000000000 ]---
<7> [511.799509] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [511.799660] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [511.800621] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19063, lrc_seqno=19063, guc_id=0, flags=0x73 in no process [-1]
<7> [511.800627] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<7> [511.800716] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:571]
<4> [511.800740] ------------[ cut here ]------------
<4> [511.800742] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [511.800744] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:57/7471
<4> [511.800864] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [511.800972] autofs4 [last unloaded: snd_hda_intel]
<4> [511.800979] CPU: 12 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [511.800983] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [511.800985] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [511.800988] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [511.800996] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [511.801111] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [511.801114] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [511.801117] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [511.801119] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [511.801121] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [511.801123] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [511.801125] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [511.801127] FS: 0000000000000000(0000) GS:ffff8888db297000(0000) knlGS:0000000000000000
<4> [511.801129] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [511.801132] CR2: 0000737d00007400 CR3: 000000012db16004 CR4: 0000000000f72ef0
<4> [511.801134] PKRU: 55555554
<4> [511.801135] Call Trace:
<4> [511.801137] <TASK>
<4> [511.801144] ? lock_sync+0x100/0x100
<4> [511.801151] ? lock_release+0xd0/0x2b0
<4> [511.801160] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [511.801169] process_one_work+0x239/0x760
<4> [511.801179] worker_thread+0x200/0x3f0
<4> [511.801183] ? __pfx_worker_thread+0x10/0x10
<4> [511.801187] kthread+0x10d/0x150
<4> [511.801191] ? __pfx_kthread+0x10/0x10
<4> [511.801196] ret_from_fork+0x3d4/0x480
<4> [511.801199] ? __pfx_kthread+0x10/0x10
<4> [511.801204] ret_from_fork_asm+0x1a/0x30
<4> [511.801216] </TASK>
<4> [511.801218] irq event stamp: 386437
<4> [511.801220] hardirqs last enabled at (386443): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [511.801223] hardirqs last disabled at (386448): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [511.801227] softirqs last enabled at (383812): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.801230] softirqs last disabled at (383805): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.801233] ---[ end trace 0000000000000000 ]---
<6> [511.801236] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [511.801353] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [511.801362] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [511.801430] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [511.801713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [511.801850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [511.801988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [511.802122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [511.802255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [511.802388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [511.802544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [511.802647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [511.802738] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [511.802845] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [511.802967] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [511.804095] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [511.814814] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [511.815066] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [511.816111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [511.816189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [511.816267] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [511.816346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [511.816423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [511.816511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [511.816592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [511.816670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [511.816747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [511.816823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [511.816898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [511.816973] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [511.817047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [511.817122] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [511.817195] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [511.817269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [511.817344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [511.817418] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [511.817501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [511.817583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [511.817665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [511.817745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [511.817827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [511.817908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [511.817988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [511.818065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [511.818142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [511.818226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [511.818309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [511.818389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [511.818472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [511.818550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [511.818633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [511.818717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [511.818802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [511.818887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [511.818971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [511.819051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [511.819130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [511.819208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [511.819287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [511.819365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [511.819443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [511.819533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [511.819618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [511.819699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [511.819778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [511.819856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [511.819935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [511.820011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [511.820086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [511.820165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [511.820241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [511.820319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [511.820399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [511.820484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [511.820563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [511.820640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [511.820720] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [511.820835] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [511.820839] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19063, lrc_seqno=19063, guc_id=0, flags=0x73 in no process [-1]
<7> [511.820842] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [511.820901] ------------[ cut here ]------------
<4> [511.820902] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [511.820904] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:57/7471
<4> [511.820975] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [511.821041] autofs4 [last unloaded: snd_hda_intel]
<4> [511.821045] CPU: 2 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [511.821048] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [511.821049] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [511.821051] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [511.821056] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [511.821125] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [511.821127] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [511.821129] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [511.821130] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [511.821132] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [511.821133] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [511.821134] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [511.821135] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [511.821137] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [511.821138] CR2: 0000737dcc4fe000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [511.821140] PKRU: 55555554
<4> [511.821141] Call Trace:
<4> [511.821142] <TASK>
<4> [511.821146] ? lock_sync+0x100/0x100
<4> [511.821151] ? lock_release+0xd0/0x2b0
<4> [511.821156] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [511.821162] process_one_work+0x239/0x760
<4> [511.821168] worker_thread+0x200/0x3f0
<4> [511.821171] ? __pfx_worker_thread+0x10/0x10
<4> [511.821174] kthread+0x10d/0x150
<4> [511.821177] ? __pfx_kthread+0x10/0x10
<4> [511.821181] ret_from_fork+0x3d4/0x480
<4> [511.821183] ? __pfx_kthread+0x10/0x10
<4> [511.821187] ret_from_fork_asm+0x1a/0x30
<4> [511.821195] </TASK>
<4> [511.821196] irq event stamp: 389599
<4> [511.821197] hardirqs last enabled at (389605): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [511.821201] hardirqs last disabled at (389610): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [511.821203] softirqs last enabled at (388730): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.821206] softirqs last disabled at (388723): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.821208] ---[ end trace 0000000000000000 ]---
<6> [511.821211] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [511.821280] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [511.821288] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [511.821702] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [511.821905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [511.821995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [511.822087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [511.822176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [511.822262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [511.822348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [511.822434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [511.822534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [511.822621] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [511.822716] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [511.822832] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [511.823840] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [511.834561] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [511.834806] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [511.835834] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [511.835912] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [511.835988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [511.836066] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [511.836143] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [511.836219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [511.836299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [511.836377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [511.836454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [511.836545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [511.836620] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [511.836696] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [511.836771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [511.836844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [511.836918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [511.836992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [511.837069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [511.837146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [511.837223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [511.837305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [511.837387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [511.837468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [511.837549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [511.837629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [511.837709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [511.837788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [511.837867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [511.837946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [511.838026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [511.838104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [511.838182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [511.838261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [511.838346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [511.838434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [511.838529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [511.838612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [511.838693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [511.838771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [511.838849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [511.838925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [511.839005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [511.839082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [511.839159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [511.839236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [511.839319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [511.839399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [511.839482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [511.839559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [511.839638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [511.839714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [511.839791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [511.839871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [511.839949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [511.840027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [511.840105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [511.840183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [511.840260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [511.840336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [511.840417] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [511.840542] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [511.840547] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19063, lrc_seqno=19063, guc_id=0, flags=0x73 in no process [-1]
<7> [511.840549] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [511.840608] ------------[ cut here ]------------
<4> [511.840609] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [511.840610] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:57/7471
<4> [511.840681] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [511.840745] autofs4 [last unloaded: snd_hda_intel]
<4> [511.840749] CPU: 2 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [511.840752] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [511.840753] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [511.840754] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [511.840759] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [511.840830] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [511.840832] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [511.840835] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [511.840836] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [511.840838] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [511.840839] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [511.840841] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [511.840842] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [511.840844] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [511.840846] CR2: 0000737dcc4fe000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [511.840848] PKRU: 55555554
<4> [511.840849] Call Trace:
<4> [511.840851] <TASK>
<4> [511.840855] ? lock_sync+0x100/0x100
<4> [511.840860] ? lock_release+0xd0/0x2b0
<4> [511.840865] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [511.840871] process_one_work+0x239/0x760
<4> [511.840877] worker_thread+0x200/0x3f0
<4> [511.840880] ? __pfx_worker_thread+0x10/0x10
<4> [511.840883] kthread+0x10d/0x150
<4> [511.840886] ? __pfx_kthread+0x10/0x10
<4> [511.840890] ret_from_fork+0x3d4/0x480
<4> [511.840893] ? __pfx_kthread+0x10/0x10
<4> [511.840896] ret_from_fork_asm+0x1a/0x30
<4> [511.840904] </TASK>
<4> [511.840905] irq event stamp: 392709
<4> [511.840907] hardirqs last enabled at (392715): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [511.840910] hardirqs last disabled at (392720): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [511.840912] softirqs last enabled at (391866): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.840915] softirqs last disabled at (391861): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.840918] ---[ end trace 0000000000000000 ]---
<7> [511.841960] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [511.842069] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [511.844678] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19072, lrc_seqno=19072, guc_id=0, flags=0x73 in no process [-1]
<7> [511.844682] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [511.844746] ------------[ cut here ]------------
<4> [511.844748] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [511.844749] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:32/7445
<4> [511.844825] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [511.844891] autofs4 [last unloaded: snd_hda_intel]
<4> [511.844895] CPU: 7 UID: 0 PID: 7445 Comm: kworker/u64:32 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [511.844898] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [511.844900] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [511.844901] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [511.844906] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [511.844978] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [511.844979] RSP: 0018:ffffc9000237bca0 EFLAGS: 00010246
<4> [511.844982] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [511.844983] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [511.844985] RBP: ffffc9000237bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [511.844986] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [511.844987] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [511.844988] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000
<4> [511.844990] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [511.844991] CR2: 00007b3f4f873000 CR3: 000000012db16006 CR4: 0000000000f72ef0
<4> [511.844993] PKRU: 55555554
<4> [511.844994] Call Trace:
<4> [511.844995] <TASK>
<4> [511.844999] ? lock_sync+0x100/0x100
<4> [511.845004] ? lock_release+0xd0/0x2b0
<4> [511.845009] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [511.845015] process_one_work+0x239/0x760
<4> [511.845021] worker_thread+0x200/0x3f0
<4> [511.845024] ? __pfx_worker_thread+0x10/0x10
<4> [511.845026] kthread+0x10d/0x150
<4> [511.845029] ? __pfx_kthread+0x10/0x10
<4> [511.845033] ret_from_fork+0x3d4/0x480
<4> [511.845035] ? __pfx_kthread+0x10/0x10
<4> [511.845039] ret_from_fork_asm+0x1a/0x30
<4> [511.845046] </TASK>
<4> [511.845047] irq event stamp: 418437
<4> [511.845048] hardirqs last enabled at (418443): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [511.845051] hardirqs last disabled at (418448): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [511.845054] softirqs last enabled at (415334): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.845056] softirqs last disabled at (415327): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.845058] ---[ end trace 0000000000000000 ]---
<6> [511.845060] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [511.845132] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [511.845138] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [511.845437] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [511.845656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [511.845746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [511.845838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [511.845926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [511.846014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [511.846103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [511.846190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [511.846279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [511.846363] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [511.846465] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [511.846582] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [511.847592] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [511.857474] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [511.857726] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [511.858734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [511.858813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [511.858890] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [511.858969] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [511.859045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [511.859122] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [511.859197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [511.859272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [511.859347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [511.859424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [511.859515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [511.859592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [511.859669] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [511.859745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [511.859821] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [511.859896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [511.859970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [511.860045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [511.860121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [511.860205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [511.860288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [511.860368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [511.860448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [511.860540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [511.860617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [511.860699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [511.860781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [511.860863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [511.860944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [511.861023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [511.861106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [511.861190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [511.861278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [511.861364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [511.861447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [511.861543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [511.861623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [511.861701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [511.861780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [511.861855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [511.861935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [511.862013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [511.862090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [511.862166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [511.862246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [511.862322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [511.862399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [511.862482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [511.862564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [511.862643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [511.862721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [511.862801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [511.862879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [511.862957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [511.863033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [511.863111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [511.863191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [511.863271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [511.863352] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [511.863473] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [511.863478] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19072, lrc_seqno=19072, guc_id=0, flags=0x73 in no process [-1]
<7> [511.863480] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [511.863539] ------------[ cut here ]------------
<4> [511.863541] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [511.863542] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:32/7445
<4> [511.863614] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [511.863678] autofs4 [last unloaded: snd_hda_intel]
<4> [511.863682] CPU: 7 UID: 0 PID: 7445 Comm: kworker/u64:32 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [511.863685] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [511.863686] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [511.863688] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [511.863693] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [511.863764] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [511.863766] RSP: 0018:ffffc9000237bca0 EFLAGS: 00010246
<4> [511.863768] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [511.863769] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [511.863770] RBP: ffffc9000237bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [511.863772] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [511.863773] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [511.863774] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000
<4> [511.863776] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [511.863777] CR2: 00007b3f4f873000 CR3: 000000012db16006 CR4: 0000000000f72ef0
<4> [511.863779] PKRU: 55555554
<4> [511.863780] Call Trace:
<4> [511.863781] <TASK>
<4> [511.863785] ? lock_sync+0x100/0x100
<4> [511.863790] ? lock_release+0xd0/0x2b0
<4> [511.863795] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [511.863801] process_one_work+0x239/0x760
<4> [511.863807] worker_thread+0x200/0x3f0
<4> [511.863810] ? __pfx_worker_thread+0x10/0x10
<4> [511.863812] kthread+0x10d/0x150
<4> [511.863815] ? __pfx_kthread+0x10/0x10
<4> [511.863819] ret_from_fork+0x3d4/0x480
<4> [511.863821] ? __pfx_kthread+0x10/0x10
<4> [511.863824] ret_from_fork_asm+0x1a/0x30
<4> [511.863831] </TASK>
<4> [511.863833] irq event stamp: 421525
<4> [511.863834] hardirqs last enabled at (421531): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [511.863837] hardirqs last disabled at (421536): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [511.863839] softirqs last enabled at (420320): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.863842] softirqs last disabled at (420315): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.863844] ---[ end trace 0000000000000000 ]---
<6> [511.863846] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [511.863916] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [511.863922] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [511.864304] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [511.864516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [511.864601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [511.864691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [511.864781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [511.864871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [511.864958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [511.865046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [511.865134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [511.865217] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [511.865313] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [511.865431] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [511.866445] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [511.876468] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [511.876718] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [511.877732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [511.877811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [511.877887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [511.877964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [511.878040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [511.878117] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [511.878195] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [511.878272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [511.878350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [511.878426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [511.878511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [511.878587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [511.878662] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [511.878736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [511.878811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [511.878884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [511.878958] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [511.879032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [511.879108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [511.879192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [511.879274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [511.879354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [511.879434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [511.879521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [511.879599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [511.879675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [511.879751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [511.879831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [511.879916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [511.880001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [511.880082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [511.880164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [511.880249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [511.880333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [511.880418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [511.880507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [511.880586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [511.880664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [511.880741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [511.880816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [511.880896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [511.880973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [511.881054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [511.881133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [511.881215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [511.881293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [511.881370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [511.881447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [511.881537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [511.881612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [511.881688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [511.881766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [511.881843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [511.881920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [511.881996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [511.882074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [511.882150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [511.882226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [511.882305] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [511.882422] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [511.882426] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19072, lrc_seqno=19072, guc_id=0, flags=0x73 in no process [-1]
<7> [511.882429] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [511.884034] ------------[ cut here ]------------
<4> [511.884036] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [511.884038] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:32/7445
<4> [511.884118] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [511.884183] autofs4 [last unloaded: snd_hda_intel]
<4> [511.884187] CPU: 7 UID: 0 PID: 7445 Comm: kworker/u64:32 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [511.884190] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [511.884192] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [511.884193] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [511.884198] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [511.884270] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [511.884272] RSP: 0018:ffffc9000237bca0 EFLAGS: 00010246
<4> [511.884274] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [511.884275] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [511.884276] RBP: ffffc9000237bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [511.884278] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [511.884279] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [511.884280] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000
<4> [511.884282] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [511.884283] CR2: 00007b3f4f873000 CR3: 000000012db16006 CR4: 0000000000f72ef0
<4> [511.884285] PKRU: 55555554
<4> [511.884286] Call Trace:
<4> [511.884287] <TASK>
<4> [511.884291] ? lock_sync+0x100/0x100
<4> [511.884295] ? lock_release+0xd0/0x2b0
<4> [511.884301] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [511.884306] process_one_work+0x239/0x760
<4> [511.884312] worker_thread+0x200/0x3f0
<4> [511.884315] ? __pfx_worker_thread+0x10/0x10
<4> [511.884317] kthread+0x10d/0x150
<4> [511.884320] ? __pfx_kthread+0x10/0x10
<4> [511.884324] ret_from_fork+0x3d4/0x480
<4> [511.884326] ? __pfx_kthread+0x10/0x10
<4> [511.884329] ret_from_fork_asm+0x1a/0x30
<4> [511.884336] </TASK>
<4> [511.884338] irq event stamp: 424653
<4> [511.884339] hardirqs last enabled at (424659): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [511.884342] hardirqs last disabled at (424664): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [511.884344] softirqs last enabled at (423544): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.884346] softirqs last disabled at (423535): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.884348] ---[ end trace 0000000000000000 ]---
<7> [511.884379] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [511.884488] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [511.941272] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19073, lrc_seqno=19073, guc_id=0, flags=0x73 in no process [-1]
<7> [511.941299] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<7> [511.941733] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:567]
<4> [511.941829] ------------[ cut here ]------------
<4> [511.941838] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [511.941848] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:13/2711
<4> [511.942341] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [511.942765] autofs4 [last unloaded: snd_hda_intel]
<4> [511.942791] CPU: 12 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [511.942809] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [511.942818] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [511.942828] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [511.942861] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [511.943328] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [511.943339] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [511.943352] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [511.943361] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [511.943370] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [511.943377] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [511.943385] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [511.943394] FS: 0000000000000000(0000) GS:ffff8888db297000(0000) knlGS:0000000000000000
<4> [511.943403] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [511.943412] CR2: 0000737d00007400 CR3: 000000000344c003 CR4: 0000000000f72ef0
<4> [511.943421] PKRU: 55555554
<4> [511.943427] Call Trace:
<4> [511.943434] <TASK>
<4> [511.943477] ? lock_sync+0x100/0x100
<4> [511.943508] ? lock_release+0xd0/0x2b0
<4> [511.943544] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [511.943582] process_one_work+0x239/0x760
<4> [511.943624] worker_thread+0x200/0x3f0
<4> [511.943641] ? __pfx_worker_thread+0x10/0x10
<4> [511.943656] kthread+0x10d/0x150
<4> [511.943672] ? __pfx_kthread+0x10/0x10
<4> [511.943695] ret_from_fork+0x3d4/0x480
<4> [511.943706] ? __pfx_kthread+0x10/0x10
<4> [511.943726] ret_from_fork_asm+0x1a/0x30
<4> [511.943776] </TASK>
<4> [511.943783] irq event stamp: 1594065
<4> [511.943789] hardirqs last enabled at (1594071): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [511.943805] hardirqs last disabled at (1594076): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [511.943818] softirqs last enabled at (1593300): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.943831] softirqs last disabled at (1593293): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.943844] ---[ end trace 0000000000000000 ]---
<6> [511.943855] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [511.944327] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [511.944395] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [511.944943] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [511.945565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [511.946033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [511.946516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [511.946951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [511.947378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [511.947850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [511.948267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [511.948735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [511.949180] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [511.949702] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [511.950196] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [511.951876] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [511.962870] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [511.963160] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [511.964369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [511.964447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [511.964537] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [511.964616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [511.964695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [511.964771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [511.964846] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [511.964920] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [511.964995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [511.965069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [511.965144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [511.965219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [511.965293] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [511.965367] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [511.965442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [511.965525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [511.965599] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [511.965672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [511.965747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [511.965829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [511.965911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [511.965990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [511.966070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [511.966148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [511.966225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [511.966301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [511.966378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [511.966457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [511.966551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [511.966629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [511.966708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [511.966787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [511.966871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [511.966956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [511.967039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [511.967121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [511.967201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [511.967283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [511.967364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [511.967442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [511.967532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [511.967612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [511.967690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [511.967767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [511.967848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [511.967925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [511.968003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [511.968080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [511.968158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [511.968234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [511.968311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [511.968390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [511.968470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [511.968552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [511.968635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [511.968717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [511.968795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [511.968872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [511.968951] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [511.969066] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [511.969071] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19073, lrc_seqno=19073, guc_id=0, flags=0x73 in no process [-1]
<7> [511.969073] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [511.969132] ------------[ cut here ]------------
<4> [511.969133] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [511.969135] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:13/2711
<4> [511.969206] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [511.969282] autofs4 [last unloaded: snd_hda_intel]
<4> [511.969286] CPU: 2 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [511.969290] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [511.969291] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [511.969293] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [511.969299] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [511.969369] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [511.969370] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [511.969373] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [511.969374] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [511.969375] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [511.969377] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [511.969378] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [511.969379] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [511.969381] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [511.969382] CR2: 0000737dcc4fe000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [511.969384] PKRU: 55555554
<4> [511.969385] Call Trace:
<4> [511.969386] <TASK>
<4> [511.969390] ? lock_sync+0x100/0x100
<4> [511.969394] ? lock_release+0xd0/0x2b0
<4> [511.969400] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [511.969406] process_one_work+0x239/0x760
<4> [511.969412] worker_thread+0x200/0x3f0
<4> [511.969415] ? __pfx_worker_thread+0x10/0x10
<4> [511.969418] kthread+0x10d/0x150
<4> [511.969420] ? __pfx_kthread+0x10/0x10
<4> [511.969424] ret_from_fork+0x3d4/0x480
<4> [511.969426] ? __pfx_kthread+0x10/0x10
<4> [511.969430] ret_from_fork_asm+0x1a/0x30
<4> [511.969437] </TASK>
<4> [511.969438] irq event stamp: 1597173
<4> [511.969439] hardirqs last enabled at (1597179): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [511.969442] hardirqs last disabled at (1597184): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [511.969444] softirqs last enabled at (1595906): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.969447] softirqs last disabled at (1595899): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.969449] ---[ end trace 0000000000000000 ]---
<6> [511.969451] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [511.969536] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [511.969543] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [511.970793] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [511.970902] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [511.971007] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [511.971218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [511.971313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [511.971410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [511.971512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [511.971601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [511.971687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [511.971774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [511.971862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [511.971949] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [511.972047] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [511.972165] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [511.973177] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [511.983817] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [511.984062] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [511.985242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [511.985314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [511.985384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [511.985455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [511.985548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [511.985623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [511.985699] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [511.985774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [511.985852] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [511.985928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [511.986003] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [511.986077] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [511.986150] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [511.986224] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [511.986299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [511.986374] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [511.986449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [511.986538] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [511.986612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [511.986697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [511.986780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [511.986860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [511.986941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [511.987020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [511.987097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [511.987175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [511.987250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [511.987332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [511.987415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [511.987507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [511.987588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [511.987668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [511.987753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [511.987838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [511.987923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [511.988008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [511.988090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [511.988170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [511.988251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [511.988330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [511.988412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [511.988502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [511.988580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [511.988658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [511.988740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [511.988817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [511.988895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [511.988975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [511.989057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [511.989137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [511.989216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [511.989297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [511.989376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [511.989455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [511.989547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [511.989625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [511.989701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [511.989778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [511.989857] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [511.989972] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [511.989977] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19073, lrc_seqno=19073, guc_id=0, flags=0x73 in no process [-1]
<7> [511.989979] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [511.990038] ------------[ cut here ]------------
<4> [511.990040] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [511.990041] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:51/7465
<4> [511.990114] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [511.990192] autofs4 [last unloaded: snd_hda_intel]
<4> [511.990196] CPU: 6 UID: 0 PID: 7465 Comm: kworker/u64:51 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [511.990199] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [511.990201] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [511.990203] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [511.990208] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [511.990279] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [511.990281] RSP: 0018:ffffc90002f5bca0 EFLAGS: 00010246
<4> [511.990283] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [511.990284] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [511.990286] RBP: ffffc90002f5bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [511.990287] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [511.990288] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [511.990290] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [511.990291] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [511.990293] CR2: 00007b3f4f70b000 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [511.990294] PKRU: 55555554
<4> [511.990295] Call Trace:
<4> [511.990297] <TASK>
<4> [511.990301] ? lock_sync+0x100/0x100
<4> [511.990305] ? lock_release+0xd0/0x2b0
<4> [511.990311] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [511.990316] process_one_work+0x239/0x760
<4> [511.990323] worker_thread+0x200/0x3f0
<4> [511.990325] ? __pfx_worker_thread+0x10/0x10
<4> [511.990328] kthread+0x10d/0x150
<4> [511.990331] ? __pfx_kthread+0x10/0x10
<4> [511.990334] ret_from_fork+0x3d4/0x480
<4> [511.990336] ? __pfx_kthread+0x10/0x10
<4> [511.990340] ret_from_fork_asm+0x1a/0x30
<4> [511.990347] </TASK>
<4> [511.990348] irq event stamp: 422161
<4> [511.990350] hardirqs last enabled at (422167): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [511.990352] hardirqs last disabled at (422172): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [511.990355] softirqs last enabled at (421286): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.990357] softirqs last disabled at (421279): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.990360] ---[ end trace 0000000000000000 ]---
<7> [511.991675] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [511.991785] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [511.994532] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19082, lrc_seqno=19082, guc_id=0, flags=0x73 in no process [-1]
<7> [511.994536] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [511.994601] ------------[ cut here ]------------
<4> [511.994602] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [511.994603] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:51/7465
<4> [511.994674] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [511.994739] autofs4 [last unloaded: snd_hda_intel]
<4> [511.994743] CPU: 6 UID: 0 PID: 7465 Comm: kworker/u64:51 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [511.994746] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [511.994747] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [511.994749] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [511.994754] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [511.994825] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [511.994827] RSP: 0018:ffffc90002f5bca0 EFLAGS: 00010246
<4> [511.994829] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [511.994830] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [511.994831] RBP: ffffc90002f5bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [511.994833] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [511.994834] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [511.994835] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [511.994837] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [511.994838] CR2: 00007b3f4f70b000 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [511.994840] PKRU: 55555554
<4> [511.994841] Call Trace:
<4> [511.994842] <TASK>
<4> [511.994846] ? lock_sync+0x100/0x100
<4> [511.994850] ? lock_release+0xd0/0x2b0
<4> [511.994856] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [511.994861] process_one_work+0x239/0x760
<4> [511.994868] worker_thread+0x200/0x3f0
<4> [511.994871] ? __pfx_worker_thread+0x10/0x10
<4> [511.994873] kthread+0x10d/0x150
<4> [511.994876] ? __pfx_kthread+0x10/0x10
<4> [511.994880] ret_from_fork+0x3d4/0x480
<4> [511.994882] ? __pfx_kthread+0x10/0x10
<4> [511.994885] ret_from_fork_asm+0x1a/0x30
<4> [511.994892] </TASK>
<4> [511.994893] irq event stamp: 423191
<4> [511.994895] hardirqs last enabled at (423197): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [511.994897] hardirqs last disabled at (423202): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [511.994900] softirqs last enabled at (421286): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.994902] softirqs last disabled at (421279): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [511.994904] ---[ end trace 0000000000000000 ]---
<6> [511.994906] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [511.994978] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [511.994985] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [511.995172] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [511.995388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [511.995489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [511.995588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [511.995678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [511.995766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [511.995852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [511.995938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [511.996025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [511.996110] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [511.996205] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [511.996322] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [511.997345] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.007466] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.007718] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.008750] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.008829] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.008906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.008984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.009064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.009144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.009222] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.009299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.009375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.009450] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.009540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.009614] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.009689] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.009763] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.009840] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.009917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.009993] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.010068] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.010143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.010226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.010307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.010385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.010468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.010547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.010625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.010702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.010780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.010860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.010941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.011020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.011100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.011179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.011269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.011358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.011445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.011538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.011619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.011699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.011776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.011852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.011931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.012008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.012086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.012164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.012244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.012321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.012397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.012477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.012559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.012638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.012716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.012796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.012876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.012957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.013036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.013115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.013191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.013266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.013345] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.013465] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.013470] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19082, lrc_seqno=19082, guc_id=0, flags=0x73 in no process [-1]
<7> [512.013472] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.013531] ------------[ cut here ]------------
<4> [512.013532] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.013534] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:57/7471
<4> [512.013604] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.013670] autofs4 [last unloaded: snd_hda_intel]
<4> [512.013675] CPU: 8 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.013678] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.013679] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.013681] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.013687] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.013757] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.013759] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [512.013761] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.013763] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.013764] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.013765] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.013766] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.013768] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [512.013769] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.013771] CR2: 00007b3f4f873000 CR3: 000000018d103003 CR4: 0000000000f72ef0
<4> [512.013772] PKRU: 55555554
<4> [512.013774] Call Trace:
<4> [512.013775] <TASK>
<4> [512.013779] ? lock_sync+0x100/0x100
<4> [512.013784] ? lock_release+0xd0/0x2b0
<4> [512.013790] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.013795] process_one_work+0x239/0x760
<4> [512.013802] worker_thread+0x200/0x3f0
<4> [512.013804] ? __pfx_worker_thread+0x10/0x10
<4> [512.013807] kthread+0x10d/0x150
<4> [512.013810] ? __pfx_kthread+0x10/0x10
<4> [512.013814] ret_from_fork+0x3d4/0x480
<4> [512.013816] ? __pfx_kthread+0x10/0x10
<4> [512.013819] ret_from_fork_asm+0x1a/0x30
<4> [512.013826] </TASK>
<4> [512.013828] irq event stamp: 397641
<4> [512.013829] hardirqs last enabled at (397647): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.013832] hardirqs last disabled at (397652): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.013834] softirqs last enabled at (396846): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.013837] softirqs last disabled at (396841): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.013839] ---[ end trace 0000000000000000 ]---
<6> [512.013841] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.013912] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.013918] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.014322] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.014531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.014622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.014713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.014799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.014885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.014970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.015057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.015146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.015231] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.015328] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.015444] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.016463] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.026468] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.026720] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.027736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.027815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.027893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.027970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.028046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.028120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.028196] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.028272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.028350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.028427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.028511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.028587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.028662] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.028736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.028810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.028885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.028959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.029034] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.029112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.029194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.029276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.029355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.029436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.029523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.029600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.029677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.029754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.029833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.029914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.029997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.030078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.030159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.030245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.030329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.030413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.030502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.030582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.030659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.030736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.030813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.030891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.030968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.031045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.031121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.031202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.031279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.031356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.031437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.031526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.031605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.031682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.031762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.031839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.031918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.031997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.032078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.032155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.032231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.032311] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.032426] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.032430] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19082, lrc_seqno=19082, guc_id=0, flags=0x73 in no process [-1]
<7> [512.032432] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.033347] ------------[ cut here ]------------
<4> [512.033349] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.033350] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:57/7471
<4> [512.033430] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.033499] autofs4 [last unloaded: snd_hda_intel]
<4> [512.033502] CPU: 8 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.033505] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.033506] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.033508] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.033513] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.033582] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.033584] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [512.033587] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.033588] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.033590] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.033591] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.033593] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.033594] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [512.033596] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.033598] CR2: 00007b3f4f873000 CR3: 000000018d103003 CR4: 0000000000f72ef0
<4> [512.033599] PKRU: 55555554
<4> [512.033601] Call Trace:
<4> [512.033602] <TASK>
<4> [512.033606] ? lock_sync+0x100/0x100
<4> [512.033610] ? lock_release+0xd0/0x2b0
<4> [512.033616] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.033622] process_one_work+0x239/0x760
<4> [512.033628] worker_thread+0x200/0x3f0
<4> [512.033631] ? __pfx_worker_thread+0x10/0x10
<4> [512.033634] kthread+0x10d/0x150
<4> [512.033637] ? __pfx_kthread+0x10/0x10
<4> [512.033641] ret_from_fork+0x3d4/0x480
<4> [512.033643] ? __pfx_kthread+0x10/0x10
<4> [512.033647] ret_from_fork_asm+0x1a/0x30
<4> [512.033654] </TASK>
<4> [512.033655] irq event stamp: 400767
<4> [512.033657] hardirqs last enabled at (400773): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.033660] hardirqs last disabled at (400778): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.033662] softirqs last enabled at (400250): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.033665] softirqs last disabled at (400243): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.033667] ---[ end trace 0000000000000000 ]---
<7> [512.033681] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [512.033783] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [512.035128] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19083, lrc_seqno=19083, guc_id=0, flags=0x73 in no process [-1]
<7> [512.035131] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.035200] ------------[ cut here ]------------
<4> [512.035201] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.035202] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:51/7465
<7> [512.035238] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:571]
<4> [512.035286] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.035350] autofs4 [last unloaded: snd_hda_intel]
<4> [512.035354] CPU: 8 UID: 0 PID: 7465 Comm: kworker/u64:51 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.035356] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.035357] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.035359] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.035363] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.035433] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.035435] RSP: 0018:ffffc90002f5bca0 EFLAGS: 00010246
<4> [512.035437] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.035438] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.035439] RBP: ffffc90002f5bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.035441] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.035442] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.035443] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [512.035445] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.035446] CR2: 00007b3f4f873000 CR3: 000000018d103003 CR4: 0000000000f72ef0
<4> [512.035447] PKRU: 55555554
<4> [512.035449] Call Trace:
<4> [512.035450] <TASK>
<4> [512.035453] ? lock_sync+0x100/0x100
<4> [512.035462] ? lock_release+0xd0/0x2b0
<4> [512.035467] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.035473] process_one_work+0x239/0x760
<4> [512.035479] worker_thread+0x200/0x3f0
<4> [512.035482] ? __pfx_worker_thread+0x10/0x10
<4> [512.035484] kthread+0x10d/0x150
<4> [512.035488] ? __pfx_kthread+0x10/0x10
<4> [512.035492] ret_from_fork+0x3d4/0x480
<4> [512.035501] ? __pfx_kthread+0x10/0x10
<4> [512.035505] ret_from_fork_asm+0x1a/0x30
<4> [512.035512] </TASK>
<4> [512.035514] irq event stamp: 424883
<4> [512.035515] hardirqs last enabled at (424889): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.035518] hardirqs last disabled at (424894): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.035520] softirqs last enabled at (421286): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.035523] softirqs last disabled at (421279): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.035526] ---[ end trace 0000000000000000 ]---
<6> [512.035527] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.035611] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.035618] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.035684] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.035946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.036086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.036227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.036364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.036534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.036637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.036732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.036823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.036908] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.037005] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.037125] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.038142] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.048469] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.048720] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.049724] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.049805] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.049881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.049958] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.050036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.050115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.050194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.050272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.050348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.050424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.050512] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.050612] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.050687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.050763] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.050838] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.050913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.050988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.051065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.051142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.051225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.051307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.051387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.051473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.051569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.051648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.051727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.051808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.051889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.051970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.052049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.052128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.052207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.052292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.052376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.052466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.052569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.052649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.052727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.052808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.052888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.052970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.053050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.053128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.053204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.053286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.053363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.053441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.053619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.053698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.053774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.053850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.053929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.054009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.054090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.054168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.054246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.054322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.054399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.054499] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.054632] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.054636] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19083, lrc_seqno=19083, guc_id=0, flags=0x73 in no process [-1]
<7> [512.054639] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.054697] ------------[ cut here ]------------
<4> [512.054699] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.054700] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:57/7471
<4> [512.054771] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.054837] autofs4 [last unloaded: snd_hda_intel]
<4> [512.054841] CPU: 10 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.054844] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.054845] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.054846] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.054852] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.054922] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.054923] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [512.054926] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.054927] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.054928] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.054930] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.054931] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.054932] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [512.054934] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.054935] CR2: 00007b3f4f873000 CR3: 000000018d103002 CR4: 0000000000f72ef0
<4> [512.054937] PKRU: 55555554
<4> [512.054938] Call Trace:
<4> [512.054939] <TASK>
<4> [512.054943] ? lock_sync+0x100/0x100
<4> [512.054948] ? lock_release+0xd0/0x2b0
<4> [512.054953] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.054959] process_one_work+0x239/0x760
<4> [512.054965] worker_thread+0x200/0x3f0
<4> [512.054968] ? __pfx_worker_thread+0x10/0x10
<4> [512.054971] kthread+0x10d/0x150
<4> [512.054974] ? __pfx_kthread+0x10/0x10
<4> [512.054977] ret_from_fork+0x3d4/0x480
<4> [512.054979] ? __pfx_kthread+0x10/0x10
<4> [512.054983] ret_from_fork_asm+0x1a/0x30
<4> [512.054990] </TASK>
<4> [512.054992] irq event stamp: 404273
<4> [512.054993] hardirqs last enabled at (404279): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.054996] hardirqs last disabled at (404284): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.054999] softirqs last enabled at (403418): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.055001] softirqs last disabled at (403385): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.055004] ---[ end trace 0000000000000000 ]---
<6> [512.055006] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.055077] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.055083] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.056328] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [512.056438] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [512.056559] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.056770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.056862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.056957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.057046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.057134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.057221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.057310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.057399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.057491] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.057588] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.057707] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.058717] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.068466] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.068716] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.069735] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.069815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.069892] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.069970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.070048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.070124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.070200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.070279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.070355] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.070431] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.070515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.070590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.070664] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.070741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.070819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.070896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.070970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.071045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.071120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.071203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.071285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.071366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.071450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.071542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.071622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.071701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.071783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.071865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.071947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.072026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.072106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.072184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.072269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.072358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.072446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.072542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.072622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.072701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.072779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.072855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.072935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.073013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.073094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.073176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.073259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.073337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.073416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.073501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.073581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.073659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.073736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.073815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.073895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.073975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.074053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.074131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.074207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.074284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.074363] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.074480] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.074485] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19083, lrc_seqno=19083, guc_id=0, flags=0x73 in no process [-1]
<7> [512.074488] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.074547] ------------[ cut here ]------------
<4> [512.074548] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.074550] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:13/2711
<4> [512.074620] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.074686] autofs4 [last unloaded: snd_hda_intel]
<4> [512.074690] CPU: 2 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.074693] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.074694] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.074696] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.074701] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.074771] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.074772] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [512.074775] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.074776] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.074778] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.074779] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.074780] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.074781] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [512.074783] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.074784] CR2: 0000737dcc4fe000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [512.074786] PKRU: 55555554
<4> [512.074787] Call Trace:
<4> [512.074788] <TASK>
<4> [512.074792] ? lock_sync+0x100/0x100
<4> [512.074797] ? lock_release+0xd0/0x2b0
<4> [512.074802] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.074808] process_one_work+0x239/0x760
<4> [512.074814] worker_thread+0x200/0x3f0
<4> [512.074817] ? __pfx_worker_thread+0x10/0x10
<4> [512.074819] kthread+0x10d/0x150
<4> [512.074823] ? __pfx_kthread+0x10/0x10
<4> [512.074826] ret_from_fork+0x3d4/0x480
<4> [512.074828] ? __pfx_kthread+0x10/0x10
<4> [512.074832] ret_from_fork_asm+0x1a/0x30
<4> [512.074839] </TASK>
<4> [512.074840] irq event stamp: 1601391
<4> [512.074842] hardirqs last enabled at (1601397): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.074845] hardirqs last disabled at (1601402): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.074847] softirqs last enabled at (1600468): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.074849] softirqs last disabled at (1600463): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.074852] ---[ end trace 0000000000000000 ]---
<7> [512.075907] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [512.076015] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [512.079795] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19092, lrc_seqno=19092, guc_id=0, flags=0x73 in no process [-1]
<7> [512.079798] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.079863] ------------[ cut here ]------------
<4> [512.079864] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.079865] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:13/2711
<4> [512.079939] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.080005] autofs4 [last unloaded: snd_hda_intel]
<4> [512.080009] CPU: 2 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.080012] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.080013] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.080014] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.080020] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.080090] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.080091] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [512.080093] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.080095] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.080096] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.080097] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.080098] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.080100] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [512.080101] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.080103] CR2: 0000737dcc4fe000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [512.080104] PKRU: 55555554
<4> [512.080105] Call Trace:
<4> [512.080106] <TASK>
<4> [512.080110] ? lock_sync+0x100/0x100
<4> [512.080114] ? lock_release+0xd0/0x2b0
<4> [512.080120] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.080126] process_one_work+0x239/0x760
<4> [512.080132] worker_thread+0x200/0x3f0
<4> [512.080134] ? __pfx_worker_thread+0x10/0x10
<4> [512.080137] kthread+0x10d/0x150
<4> [512.080140] ? __pfx_kthread+0x10/0x10
<4> [512.080143] ret_from_fork+0x3d4/0x480
<4> [512.080145] ? __pfx_kthread+0x10/0x10
<4> [512.080149] ret_from_fork_asm+0x1a/0x30
<4> [512.080156] </TASK>
<4> [512.080157] irq event stamp: 1602463
<4> [512.080158] hardirqs last enabled at (1602469): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.080161] hardirqs last disabled at (1602474): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.080163] softirqs last enabled at (1600468): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.080166] softirqs last disabled at (1600463): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.080168] ---[ end trace 0000000000000000 ]---
<6> [512.080170] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.080240] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.080246] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.080658] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.080863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.080952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.081045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.081134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.081224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.081313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.081401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.081493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.081577] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.081672] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.081790] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.082810] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.093474] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.093727] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.094752] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.094836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.094914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.094992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.095068] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.095144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.095220] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.095296] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.095372] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.095452] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.095544] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.095621] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.095697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.095772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.095847] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.095922] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.095997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.096072] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.096147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.096230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.096313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.096394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.096480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.096561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.096641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.096719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.096797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.096879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.096960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.097039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.097119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.097203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.097291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.097378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.097468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.097550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.097632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.097710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.097792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.097872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.097954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.098034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.098112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.098190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.098270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.098346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.098422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.098514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.098597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.098677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.098754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.098835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.098912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.098990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.099066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.099144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.099219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.099297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.099379] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.099978] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.099982] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19092, lrc_seqno=19092, guc_id=0, flags=0x73 in no process [-1]
<7> [512.099985] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.100055] ------------[ cut here ]------------
<4> [512.100056] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.100058] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:13/2711
<4> [512.100133] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.100212] autofs4 [last unloaded: snd_hda_intel]
<4> [512.100217] CPU: 2 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.100220] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.100222] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.100223] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.100229] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.100301] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.100302] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [512.100305] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.100306] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.100307] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.100309] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.100310] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.100311] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [512.100313] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.100314] CR2: 0000737dcc4fe000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [512.100316] PKRU: 55555554
<4> [512.100317] Call Trace:
<4> [512.100318] <TASK>
<4> [512.100322] ? lock_sync+0x100/0x100
<4> [512.100326] ? lock_release+0xd0/0x2b0
<4> [512.100332] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.100337] process_one_work+0x239/0x760
<4> [512.100343] worker_thread+0x200/0x3f0
<4> [512.100346] ? __pfx_worker_thread+0x10/0x10
<4> [512.100349] kthread+0x10d/0x150
<4> [512.100352] ? __pfx_kthread+0x10/0x10
<4> [512.100355] ret_from_fork+0x3d4/0x480
<4> [512.100357] ? __pfx_kthread+0x10/0x10
<4> [512.100361] ret_from_fork_asm+0x1a/0x30
<4> [512.100368] </TASK>
<4> [512.100369] irq event stamp: 1605587
<4> [512.100371] hardirqs last enabled at (1605593): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.100373] hardirqs last disabled at (1605598): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.100376] softirqs last enabled at (1604658): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.100378] softirqs last disabled at (1604639): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.100380] ---[ end trace 0000000000000000 ]---
<6> [512.100382] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.100452] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.100463] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.100871] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.101075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.101166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.101259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.101349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.101441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.101543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.101631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.101720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.101803] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.101900] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.102019] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.103026] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.113748] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.113991] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.114944] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.115020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.115092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.115163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.115233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.115307] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.115382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.115457] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.115547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.115622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.115696] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.115772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.115849] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.115926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.116000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.116074] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.116149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.116224] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.116298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.116379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.116463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.116545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.116628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.116708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.116786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.116864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.116941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.117020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.117104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.117185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.117266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.117346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.117431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.117525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.117611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.117696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.117779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.117859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.117939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.118016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.118097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.118179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.118259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.118337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.118418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.118505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.118583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.118659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.118737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.118813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.118890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.118972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.119054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.119134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.119212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.119290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.119365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.119441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.119531] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.119648] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.119652] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19092, lrc_seqno=19092, guc_id=0, flags=0x73 in no process [-1]
<7> [512.119654] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.119712] ------------[ cut here ]------------
<4> [512.119713] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.119714] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:13/2711
<4> [512.119787] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.119851] autofs4 [last unloaded: snd_hda_intel]
<4> [512.119855] CPU: 2 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.119858] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.119859] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.119860] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.119865] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.119937] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.119939] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [512.119941] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.119942] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.119943] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.119945] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.119946] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.119947] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [512.119949] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.119950] CR2: 0000737dcc4fe000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [512.119952] PKRU: 55555554
<4> [512.119953] Call Trace:
<4> [512.119954] <TASK>
<4> [512.119958] ? lock_sync+0x100/0x100
<4> [512.119962] ? lock_release+0xd0/0x2b0
<4> [512.119968] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.119973] process_one_work+0x239/0x760
<4> [512.119979] worker_thread+0x200/0x3f0
<4> [512.119982] ? __pfx_worker_thread+0x10/0x10
<4> [512.119985] kthread+0x10d/0x150
<4> [512.119988] ? __pfx_kthread+0x10/0x10
<4> [512.119992] ret_from_fork+0x3d4/0x480
<4> [512.119994] ? __pfx_kthread+0x10/0x10
<4> [512.119998] ret_from_fork_asm+0x1a/0x30
<4> [512.120006] </TASK>
<4> [512.120007] irq event stamp: 1608707
<4> [512.120008] hardirqs last enabled at (1608713): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.120011] hardirqs last disabled at (1608718): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.120014] softirqs last enabled at (1607856): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.120017] softirqs last disabled at (1607849): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.120019] ---[ end trace 0000000000000000 ]---
<7> [512.121044] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [512.121155] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [512.174673] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19093, lrc_seqno=19093, guc_id=0, flags=0x73 in no process [-1]
<7> [512.174698] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.175067] ------------[ cut here ]------------
<4> [512.175075] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<7> [512.175082] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:570]
<4> [512.175083] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:32/7445
<4> [512.175541] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.175889] autofs4 [last unloaded: snd_hda_intel]
<4> [512.175913] CPU: 8 UID: 0 PID: 7445 Comm: kworker/u64:32 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.175929] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.175936] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.175944] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.175974] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.176369] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.176379] RSP: 0018:ffffc9000237bca0 EFLAGS: 00010246
<4> [512.176391] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.176400] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.176408] RBP: ffffc9000237bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.176415] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.176422] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.176430] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [512.176439] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.176447] CR2: 00007b3f4f873000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [512.176456] PKRU: 55555554
<4> [512.176487] Call Trace:
<4> [512.176494] <TASK>
<4> [512.176516] ? lock_sync+0x100/0x100
<4> [512.176541] ? lock_release+0xd0/0x2b0
<4> [512.176572] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.176602] process_one_work+0x239/0x760
<4> [512.176634] worker_thread+0x200/0x3f0
<4> [512.176650] ? __pfx_worker_thread+0x10/0x10
<4> [512.176663] kthread+0x10d/0x150
<4> [512.176680] ? __pfx_kthread+0x10/0x10
<4> [512.176699] ret_from_fork+0x3d4/0x480
<4> [512.176711] ? __pfx_kthread+0x10/0x10
<4> [512.176730] ret_from_fork_asm+0x1a/0x30
<4> [512.176769] </TASK>
<4> [512.176775] irq event stamp: 427687
<4> [512.176783] hardirqs last enabled at (427693): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.176799] hardirqs last disabled at (427698): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.176810] softirqs last enabled at (426942): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.176824] softirqs last disabled at (426935): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.176836] ---[ end trace 0000000000000000 ]---
<6> [512.176847] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.177233] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.177271] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.177731] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.178317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.178822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.179276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.179820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.180253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.180725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.181164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.181615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.182034] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.182523] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.183020] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.184693] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.195729] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.196009] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.197061] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.197141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.197219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.197298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.197375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.197451] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.197541] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.197617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.197692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.197767] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.197841] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.197915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.197990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.198068] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.198145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.198221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.198297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.198372] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.198447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.198542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.198624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.198707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.198790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.198870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.198948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.199029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.199110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.199191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.199272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.199352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.199431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.199518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.199603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.199687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.199772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.199857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.199938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.200017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.200096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.200173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.200253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.200331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.200409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.200496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.200581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.200662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.200742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.200818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.200896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.200973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.201049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.201128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.201205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.201283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.201360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.201438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.201523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.201604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.201687] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.201818] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.201822] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19093, lrc_seqno=19093, guc_id=0, flags=0x73 in no process [-1]
<7> [512.201825] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.201883] ------------[ cut here ]------------
<4> [512.201884] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.201886] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:13/2711
<4> [512.201958] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.202036] autofs4 [last unloaded: snd_hda_intel]
<4> [512.202042] CPU: 2 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.202045] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.202046] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.202048] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.202053] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.202123] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.202125] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [512.202128] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.202130] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.202132] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.202133] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.202135] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.202136] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [512.202138] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.202140] CR2: 0000737dcc4fe000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [512.202142] PKRU: 55555554
<4> [512.202143] Call Trace:
<4> [512.202145] <TASK>
<4> [512.202149] ? lock_sync+0x100/0x100
<4> [512.202154] ? lock_release+0xd0/0x2b0
<4> [512.202160] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.202166] process_one_work+0x239/0x760
<4> [512.202172] worker_thread+0x200/0x3f0
<4> [512.202176] ? __pfx_worker_thread+0x10/0x10
<4> [512.202178] kthread+0x10d/0x150
<4> [512.202182] ? __pfx_kthread+0x10/0x10
<4> [512.202186] ret_from_fork+0x3d4/0x480
<4> [512.202188] ? __pfx_kthread+0x10/0x10
<4> [512.202192] ret_from_fork_asm+0x1a/0x30
<4> [512.202199] </TASK>
<4> [512.202200] irq event stamp: 1611913
<4> [512.202202] hardirqs last enabled at (1611919): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.202204] hardirqs last disabled at (1611924): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.202207] softirqs last enabled at (1610676): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.202209] softirqs last disabled at (1610669): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.202212] ---[ end trace 0000000000000000 ]---
<6> [512.202214] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.202284] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.202290] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.202701] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.202903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.202988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.203079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.203169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.203258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.203345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.203432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.203529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.203612] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.203709] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.203827] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.204838] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.215466] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.215740] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.216859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.216939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.217016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.217093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.217170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.217248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.217327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.217404] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.217488] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.217565] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.217641] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.217716] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.217790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.217866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.217941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.218015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.218090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.218164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.218238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.218318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.218400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.218483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.218564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.218646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.218727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.218807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.218886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.218966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.219046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.219124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.219203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.219283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.219368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.219452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.219549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.219630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.219710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.219787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.219863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.219939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.220018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.220098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.220180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.220259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.220342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.220420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.220505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.220583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.220661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.220738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.220815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.220894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.220971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.221048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.221123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.221200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.221275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.221352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.221434] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.221561] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.221566] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19093, lrc_seqno=19093, guc_id=0, flags=0x73 in no process [-1]
<7> [512.221568] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.221627] ------------[ cut here ]------------
<4> [512.221628] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.221629] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:13/2711
<4> [512.221701] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.221766] autofs4 [last unloaded: snd_hda_intel]
<4> [512.221770] CPU: 2 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.221772] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.221773] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.221775] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.221780] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.221849] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.221851] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [512.221853] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.221854] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.221856] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.221857] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.221858] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.221860] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [512.221861] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.221863] CR2: 0000737dcc4fe000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [512.221864] PKRU: 55555554
<4> [512.221865] Call Trace:
<4> [512.221866] <TASK>
<4> [512.221870] ? lock_sync+0x100/0x100
<4> [512.221874] ? lock_release+0xd0/0x2b0
<4> [512.221880] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.221886] process_one_work+0x239/0x760
<4> [512.221892] worker_thread+0x200/0x3f0
<4> [512.221894] ? __pfx_worker_thread+0x10/0x10
<4> [512.221897] kthread+0x10d/0x150
<4> [512.221900] ? __pfx_kthread+0x10/0x10
<4> [512.221903] ret_from_fork+0x3d4/0x480
<4> [512.221905] ? __pfx_kthread+0x10/0x10
<4> [512.221909] ret_from_fork_asm+0x1a/0x30
<4> [512.221916] </TASK>
<4> [512.221917] irq event stamp: 1615031
<4> [512.221918] hardirqs last enabled at (1615037): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.221921] hardirqs last disabled at (1615042): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.221923] softirqs last enabled at (1614188): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.221925] softirqs last disabled at (1614183): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.221928] ---[ end trace 0000000000000000 ]---
<7> [512.223214] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [512.223321] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [512.226979] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19102, lrc_seqno=19102, guc_id=0, flags=0x73 in no process [-1]
<7> [512.226982] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.227041] ------------[ cut here ]------------
<4> [512.227042] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.227043] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:13/2711
<4> [512.227115] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.227179] autofs4 [last unloaded: snd_hda_intel]
<4> [512.227183] CPU: 2 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.227185] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.227186] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.227188] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.227193] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.227263] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.227265] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [512.227267] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.227268] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.227270] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.227271] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.227272] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.227273] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [512.227275] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.227276] CR2: 0000737dcc4fe000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [512.227278] PKRU: 55555554
<4> [512.227279] Call Trace:
<4> [512.227280] <TASK>
<4> [512.227284] ? lock_sync+0x100/0x100
<4> [512.227288] ? lock_release+0xd0/0x2b0
<4> [512.227293] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.227299] process_one_work+0x239/0x760
<4> [512.227305] worker_thread+0x200/0x3f0
<4> [512.227307] ? __pfx_worker_thread+0x10/0x10
<4> [512.227310] kthread+0x10d/0x150
<4> [512.227313] ? __pfx_kthread+0x10/0x10
<4> [512.227316] ret_from_fork+0x3d4/0x480
<4> [512.227318] ? __pfx_kthread+0x10/0x10
<4> [512.227322] ret_from_fork_asm+0x1a/0x30
<4> [512.227329] </TASK>
<4> [512.227330] irq event stamp: 1616109
<4> [512.227331] hardirqs last enabled at (1616115): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.227334] hardirqs last disabled at (1616120): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.227336] softirqs last enabled at (1614188): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.227339] softirqs last disabled at (1614183): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.227341] ---[ end trace 0000000000000000 ]---
<6> [512.227342] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.227413] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.227419] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.227826] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.228029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.228119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.228212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.228300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.228387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.228477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.228564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.228652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.228737] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.228833] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.228949] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.229974] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.240466] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.240715] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.241740] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.241820] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.241896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.241973] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.242049] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.242124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.242199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.242274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.242347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.242422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.242504] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.242580] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.242654] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.242729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.242802] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.242876] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.242950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.243024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.243099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.243182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.243264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.243343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.243422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.243508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.243585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.243662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.243737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.243815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.243895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.243973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.244053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.244131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.244216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.244300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.244384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.244467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.244552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.244634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.244714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.244792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.244873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.244952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.245029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.245105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.245186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.245267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.245346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.245422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.245511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.245587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.245664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.245746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.245825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.245903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.245979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.246060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.246140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.246219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.246300] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.246417] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.246422] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19102, lrc_seqno=19102, guc_id=0, flags=0x73 in no process [-1]
<7> [512.246424] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.246495] ------------[ cut here ]------------
<4> [512.246497] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.246498] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:13/2711
<4> [512.246569] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.246634] autofs4 [last unloaded: snd_hda_intel]
<4> [512.246638] CPU: 2 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.246640] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.246641] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.246643] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.246648] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.246718] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.246720] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [512.246722] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.246724] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.246725] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.246726] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.246727] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.246729] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [512.246730] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.246731] CR2: 0000737dcc4fe000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [512.246733] PKRU: 55555554
<4> [512.246734] Call Trace:
<4> [512.246735] <TASK>
<4> [512.246739] ? lock_sync+0x100/0x100
<4> [512.246743] ? lock_release+0xd0/0x2b0
<4> [512.246749] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.246755] process_one_work+0x239/0x760
<4> [512.246761] worker_thread+0x200/0x3f0
<4> [512.246763] ? __pfx_worker_thread+0x10/0x10
<4> [512.246766] kthread+0x10d/0x150
<4> [512.246769] ? __pfx_kthread+0x10/0x10
<4> [512.246772] ret_from_fork+0x3d4/0x480
<4> [512.246774] ? __pfx_kthread+0x10/0x10
<4> [512.246778] ret_from_fork_asm+0x1a/0x30
<4> [512.246785] </TASK>
<4> [512.246786] irq event stamp: 1619215
<4> [512.246787] hardirqs last enabled at (1619221): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.246790] hardirqs last disabled at (1619226): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.246792] softirqs last enabled at (1618454): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.246795] softirqs last disabled at (1618447): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.246797] ---[ end trace 0000000000000000 ]---
<6> [512.246799] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.246868] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.246874] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.247282] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.247488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.247579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.247672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.247760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.247847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.247936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.248024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.248111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.248194] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.248289] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.248405] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.249413] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.260143] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.260393] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.261405] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.261491] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.261568] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.261645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.261721] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.261799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.261878] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.261955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.262032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.262108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.262184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.262258] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.262332] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.262407] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.262487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.262562] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.262636] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.262710] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.262785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.262867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.262949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.263031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.263111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.263190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.263269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.263348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.263426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.263515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.263596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.263675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.263755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.263836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.263926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.264015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.264102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.264185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.264266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.264344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.264422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.264506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.264586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.264665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.264744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.264826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.264911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.264989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.265069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.265147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.265227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.265302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.265379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.265462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.265543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.265624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.265704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.265783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.265861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.265937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.266017] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.266133] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.266137] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19102, lrc_seqno=19102, guc_id=0, flags=0x73 in no process [-1]
<7> [512.266140] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.266199] ------------[ cut here ]------------
<4> [512.266200] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.266202] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:13/2711
<4> [512.266272] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.266336] autofs4 [last unloaded: snd_hda_intel]
<4> [512.266340] CPU: 2 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.266343] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.266344] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.266345] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.266350] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.266419] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.266421] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [512.266423] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.266424] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.266426] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.266427] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.266428] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.266429] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [512.266431] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.266432] CR2: 0000737dcc4fe000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [512.266434] PKRU: 55555554
<4> [512.266435] Call Trace:
<4> [512.266436] <TASK>
<4> [512.266440] ? lock_sync+0x100/0x100
<4> [512.266444] ? lock_release+0xd0/0x2b0
<4> [512.266449] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.266455] process_one_work+0x239/0x760
<4> [512.266464] worker_thread+0x200/0x3f0
<4> [512.266467] ? __pfx_worker_thread+0x10/0x10
<4> [512.266470] kthread+0x10d/0x150
<4> [512.266473] ? __pfx_kthread+0x10/0x10
<4> [512.266477] ret_from_fork+0x3d4/0x480
<4> [512.266479] ? __pfx_kthread+0x10/0x10
<4> [512.266482] ret_from_fork_asm+0x1a/0x30
<4> [512.266490] </TASK>
<4> [512.266491] irq event stamp: 1622341
<4> [512.266492] hardirqs last enabled at (1622347): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.266495] hardirqs last disabled at (1622352): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.266497] softirqs last enabled at (1621168): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.266499] softirqs last disabled at (1621161): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.266502] ---[ end trace 0000000000000000 ]---
<7> [512.267519] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [512.267626] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [512.268887] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19103, lrc_seqno=19103, guc_id=0, flags=0x73 in no process [-1]
<7> [512.268889] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.268949] ------------[ cut here ]------------
<4> [512.268950] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.268951] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:13/2711
<7> [512.268995] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:571]
<4> [512.269021] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.269088] autofs4 [last unloaded: snd_hda_intel]
<4> [512.269092] CPU: 2 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.269094] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.269095] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.269097] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.269101] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.269171] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.269172] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [512.269174] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.269176] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.269177] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.269178] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.269179] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.269181] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [512.269182] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.269183] CR2: 0000737dcc4fe000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [512.269185] PKRU: 55555554
<4> [512.269186] Call Trace:
<4> [512.269187] <TASK>
<4> [512.269191] ? lock_sync+0x100/0x100
<4> [512.269195] ? lock_release+0xd0/0x2b0
<4> [512.269201] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.269206] process_one_work+0x239/0x760
<4> [512.269212] worker_thread+0x200/0x3f0
<4> [512.269215] ? __pfx_worker_thread+0x10/0x10
<4> [512.269217] kthread+0x10d/0x150
<4> [512.269220] ? __pfx_kthread+0x10/0x10
<4> [512.269224] ret_from_fork+0x3d4/0x480
<4> [512.269226] ? __pfx_kthread+0x10/0x10
<4> [512.269229] ret_from_fork_asm+0x1a/0x30
<4> [512.269237] </TASK>
<4> [512.269238] irq event stamp: 1623201
<4> [512.269239] hardirqs last enabled at (1623207): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.269242] hardirqs last disabled at (1623212): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.269244] softirqs last enabled at (1621168): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.269246] softirqs last disabled at (1621161): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.269248] ---[ end trace 0000000000000000 ]---
<6> [512.269250] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.269320] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.269327] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.269580] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.269815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.269908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.270002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.270094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.270189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.270287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.270400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.270497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.270592] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.270688] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.270806] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.272009] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.282470] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.282729] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.283794] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.283877] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.283956] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.284035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.284112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.284187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.284264] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.284340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.284416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.284584] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.284664] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.284741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.284817] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.284893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.284968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.285043] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.285118] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.285192] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.285267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.285349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.285431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.285543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.285640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.285719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.285800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.285881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.285959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.286040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.286119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.286200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.286282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.286364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.286449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.286549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.286663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.286749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.286832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.286912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.286992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.287074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.287157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.287238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.287317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.287394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.287480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.287572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.287651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.287727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.287805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.287881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.287957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.288039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.288120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.288202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.288280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.288359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.288435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.288521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.288624] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.288740] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.288745] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19103, lrc_seqno=19103, guc_id=0, flags=0x73 in no process [-1]
<7> [512.288748] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.288808] ------------[ cut here ]------------
<4> [512.288809] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.288810] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:57/7471
<4> [512.288885] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.288951] autofs4 [last unloaded: snd_hda_intel]
<4> [512.288956] CPU: 10 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.288959] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.288960] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.288962] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.288967] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.289037] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.289039] RSP: 0000:ffffc90002f8bca0 EFLAGS: 00010246
<4> [512.289041] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.289043] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.289044] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.289046] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.289047] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.289049] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [512.289051] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.289052] CR2: 00007b3f4f873000 CR3: 000000018d103002 CR4: 0000000000f72ef0
<4> [512.289054] PKRU: 55555554
<4> [512.289055] Call Trace:
<4> [512.289057] <TASK>
<4> [512.289061] ? lock_sync+0x100/0x100
<4> [512.289066] ? lock_release+0xd0/0x2b0
<4> [512.289072] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.289077] process_one_work+0x239/0x760
<4> [512.289084] worker_thread+0x200/0x3f0
<4> [512.289087] ? __pfx_worker_thread+0x10/0x10
<4> [512.289089] kthread+0x10d/0x150
<4> [512.289093] ? __pfx_kthread+0x10/0x10
<4> [512.289097] ret_from_fork+0x3d4/0x480
<4> [512.289099] ? __pfx_kthread+0x10/0x10
<4> [512.289103] ret_from_fork_asm+0x1a/0x30
<4> [512.289110] </TASK>
<4> [512.289112] irq event stamp: 409731
<4> [512.289113] hardirqs last enabled at (409737): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.289117] hardirqs last disabled at (409742): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.289119] softirqs last enabled at (408610): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.289122] softirqs last disabled at (408577): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.289124] ---[ end trace 0000000000000000 ]---
<6> [512.289127] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.289197] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.289203] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.289624] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.289865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.289955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.290048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.290136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.290223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.290310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.290397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.290496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.290594] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.290693] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.290809] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.291825] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.302805] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.303056] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.304094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.304176] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.304254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.304331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.304406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.304493] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.304584] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.304660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.304738] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.304814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.304889] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.304963] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.305037] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.305111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.305185] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.305258] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.305332] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.305405] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.305486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.305582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.305664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.305743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.305825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.305906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.305985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.306063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.306140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.306220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.306301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.306378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.306464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.306571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.306662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.306750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.306836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.306919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.307001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.307080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.307158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.307234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.307315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.307397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.307485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.307580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.307663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.307740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.307819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.307895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.307974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.308049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.308127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.308209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.308290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.308370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.308448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.308544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.308642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.308720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.308800] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.308915] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.308919] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19103, lrc_seqno=19103, guc_id=0, flags=0x73 in no process [-1]
<7> [512.308921] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.308981] ------------[ cut here ]------------
<4> [512.308982] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.308983] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:57/7471
<4> [512.309056] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.309120] autofs4 [last unloaded: snd_hda_intel]
<4> [512.309124] CPU: 10 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.309127] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.309128] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.309129] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.309135] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.309204] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.309206] RSP: 0000:ffffc90002f8bca0 EFLAGS: 00010246
<4> [512.309208] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.309210] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.309211] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.309212] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.309213] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.309215] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [512.309216] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.309218] CR2: 00007b3f4f873000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [512.309219] PKRU: 55555554
<4> [512.309220] Call Trace:
<4> [512.309221] <TASK>
<4> [512.309225] ? lock_sync+0x100/0x100
<4> [512.309230] ? lock_release+0xd0/0x2b0
<4> [512.309235] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.309241] process_one_work+0x239/0x760
<4> [512.309247] worker_thread+0x200/0x3f0
<4> [512.309250] ? __pfx_worker_thread+0x10/0x10
<4> [512.309252] kthread+0x10d/0x150
<4> [512.309255] ? __pfx_kthread+0x10/0x10
<4> [512.309258] ret_from_fork+0x3d4/0x480
<4> [512.309261] ? __pfx_kthread+0x10/0x10
<4> [512.309264] ret_from_fork_asm+0x1a/0x30
<4> [512.309271] </TASK>
<4> [512.309272] irq event stamp: 412931
<4> [512.309273] hardirqs last enabled at (412937): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.309276] hardirqs last disabled at (412942): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.309279] softirqs last enabled at (411974): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.309281] softirqs last disabled at (411967): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.309283] ---[ end trace 0000000000000000 ]---
<7> [512.310337] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [512.310445] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [512.313723] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19112, lrc_seqno=19112, guc_id=0, flags=0x73 in no process [-1]
<7> [512.313727] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.313791] ------------[ cut here ]------------
<4> [512.313793] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.313794] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:51/7465
<4> [512.313869] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.313935] autofs4 [last unloaded: snd_hda_intel]
<4> [512.313940] CPU: 8 UID: 0 PID: 7465 Comm: kworker/u64:51 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.313943] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.313944] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.313945] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.313951] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.314021] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.314023] RSP: 0018:ffffc90002f5bca0 EFLAGS: 00010246
<4> [512.314025] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.314027] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.314028] RBP: ffffc90002f5bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.314029] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.314030] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.314032] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [512.314033] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.314035] CR2: 00007b3f4f873000 CR3: 000000012db16005 CR4: 0000000000f72ef0
<4> [512.314036] PKRU: 55555554
<4> [512.314037] Call Trace:
<4> [512.314039] <TASK>
<4> [512.314043] ? lock_sync+0x100/0x100
<4> [512.314047] ? lock_release+0xd0/0x2b0
<4> [512.314053] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.314058] process_one_work+0x239/0x760
<4> [512.314065] worker_thread+0x200/0x3f0
<4> [512.314067] ? __pfx_worker_thread+0x10/0x10
<4> [512.314070] kthread+0x10d/0x150
<4> [512.314073] ? __pfx_kthread+0x10/0x10
<4> [512.314076] ret_from_fork+0x3d4/0x480
<4> [512.314079] ? __pfx_kthread+0x10/0x10
<4> [512.314082] ret_from_fork_asm+0x1a/0x30
<4> [512.314089] </TASK>
<4> [512.314090] irq event stamp: 426965
<4> [512.314092] hardirqs last enabled at (426971): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.314094] hardirqs last disabled at (426976): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.314097] softirqs last enabled at (421286): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.314099] softirqs last disabled at (421279): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.314102] ---[ end trace 0000000000000000 ]---
<6> [512.314103] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.314174] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.314180] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.314351] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.314558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.314649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.314744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.314834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.314926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.315016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.315104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.315193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.315277] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.315373] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.315496] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.316519] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.326505] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.326756] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.327736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.327816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.327893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.327972] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.328051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.328127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.328203] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.328282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.328360] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.328438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.328523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.328597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.328672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.328747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.328823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.328898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.328973] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.329047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.329122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.329204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.329288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.329369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.329450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.329542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.329619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.329697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.329775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.329855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.329937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.330015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.330095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.330174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.330259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.330343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.330427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.330520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.330603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.330685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.330765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.330843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.330923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.331002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.331083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.331163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.331244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.331321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.331398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.331476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.331555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.331630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.331704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.331783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.331859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.331936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.332012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.332090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.332170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.332250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.332331] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.332448] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.332453] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19112, lrc_seqno=19112, guc_id=0, flags=0x73 in no process [-1]
<7> [512.332455] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.332535] ------------[ cut here ]------------
<4> [512.332537] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.332538] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:51/7465
<4> [512.332611] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.332675] autofs4 [last unloaded: snd_hda_intel]
<4> [512.332679] CPU: 8 UID: 0 PID: 7465 Comm: kworker/u64:51 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.332682] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.332683] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.332685] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.332690] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.332760] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.332762] RSP: 0018:ffffc90002f5bca0 EFLAGS: 00010246
<4> [512.332765] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.332766] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.332768] RBP: ffffc90002f5bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.332769] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.332771] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.332772] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [512.332774] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.332776] CR2: 00007b3f4f873000 CR3: 000000012db16005 CR4: 0000000000f72ef0
<4> [512.332777] PKRU: 55555554
<4> [512.332779] Call Trace:
<4> [512.332780] <TASK>
<4> [512.332784] ? lock_sync+0x100/0x100
<4> [512.332789] ? lock_release+0xd0/0x2b0
<4> [512.332794] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.332800] process_one_work+0x239/0x760
<4> [512.332807] worker_thread+0x200/0x3f0
<4> [512.332810] ? __pfx_worker_thread+0x10/0x10
<4> [512.332812] kthread+0x10d/0x150
<4> [512.332815] ? __pfx_kthread+0x10/0x10
<4> [512.332819] ret_from_fork+0x3d4/0x480
<4> [512.332821] ? __pfx_kthread+0x10/0x10
<4> [512.332825] ret_from_fork_asm+0x1a/0x30
<4> [512.332833] </TASK>
<4> [512.332834] irq event stamp: 430077
<4> [512.332835] hardirqs last enabled at (430083): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.332838] hardirqs last disabled at (430088): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.332841] softirqs last enabled at (429066): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.332843] softirqs last disabled at (429059): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.332846] ---[ end trace 0000000000000000 ]---
<6> [512.332848] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.332919] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.332926] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.334172] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [512.334279] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [512.334385] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.334605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.334698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.334793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.334881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.334968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.335054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.335140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.335228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.335311] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.335410] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.335543] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.336553] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.346467] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.346717] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.347731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.347809] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.347886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.347964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.348039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.348116] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.348192] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.348267] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.348341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.348415] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.348503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.348578] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.348652] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.348726] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.348800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.348874] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.348950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.349025] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.349099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.349181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.349263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.349345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.349428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.349520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.349601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.349680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.349758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.349838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.349919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.349997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.350075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.350156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.350244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.350330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.350415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.350506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.350587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.350666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.350748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.350828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.350908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.350987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.351065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.351141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.351223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.351299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.351374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.351449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.351541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.351616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.351691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.351769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.351846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.351925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.352003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.352082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.352159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.352235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.352314] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.352432] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.352436] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19112, lrc_seqno=19112, guc_id=0, flags=0x73 in no process [-1]
<7> [512.352439] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.352514] ------------[ cut here ]------------
<4> [512.352516] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.352517] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:13/2711
<4> [512.352591] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.352666] autofs4 [last unloaded: snd_hda_intel]
<4> [512.352671] CPU: 6 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.352674] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.352676] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.352677] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.352683] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.352753] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.352755] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [512.352757] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.352759] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.352760] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.352762] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.352763] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.352765] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [512.352767] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.352768] CR2: 00007b3f4f70b000 CR3: 000000012db16005 CR4: 0000000000f72ef0
<4> [512.352770] PKRU: 55555554
<4> [512.352772] Call Trace:
<4> [512.352773] <TASK>
<4> [512.352777] ? lock_sync+0x100/0x100
<4> [512.352782] ? lock_release+0xd0/0x2b0
<4> [512.352788] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.352793] process_one_work+0x239/0x760
<4> [512.352800] worker_thread+0x200/0x3f0
<4> [512.352803] ? __pfx_worker_thread+0x10/0x10
<4> [512.352806] kthread+0x10d/0x150
<4> [512.352809] ? __pfx_kthread+0x10/0x10
<4> [512.352813] ret_from_fork+0x3d4/0x480
<4> [512.352815] ? __pfx_kthread+0x10/0x10
<4> [512.352819] ret_from_fork_asm+0x1a/0x30
<4> [512.352826] </TASK>
<4> [512.352828] irq event stamp: 1627411
<4> [512.352829] hardirqs last enabled at (1627417): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.352832] hardirqs last disabled at (1627422): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.352835] softirqs last enabled at (1626306): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.352837] softirqs last disabled at (1626297): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.352840] ---[ end trace 0000000000000000 ]---
<7> [512.354105] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [512.354213] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [512.407932] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19113, lrc_seqno=19113, guc_id=0, flags=0x73 in no process [-1]
<7> [512.407958] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.408319] ------------[ cut here ]------------
<4> [512.408327] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<7> [512.408328] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:567]
<4> [512.408335] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:57/7471
<4> [512.408827] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.409168] autofs4 [last unloaded: snd_hda_intel]
<4> [512.409191] CPU: 8 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.409208] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.409215] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.409223] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.409252] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.409682] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.409692] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [512.409705] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.409713] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.409721] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.409729] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.409736] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.409745] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [512.409755] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.409764] CR2: 00007b3f4f873000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [512.409773] PKRU: 55555554
<4> [512.409780] Call Trace:
<4> [512.409788] <TASK>
<4> [512.409811] ? lock_sync+0x100/0x100
<4> [512.409836] ? lock_release+0xd0/0x2b0
<4> [512.409867] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.409897] process_one_work+0x239/0x760
<4> [512.409931] worker_thread+0x200/0x3f0
<4> [512.409947] ? __pfx_worker_thread+0x10/0x10
<4> [512.409960] kthread+0x10d/0x150
<4> [512.409977] ? __pfx_kthread+0x10/0x10
<4> [512.409996] ret_from_fork+0x3d4/0x480
<4> [512.410006] ? __pfx_kthread+0x10/0x10
<4> [512.410025] ret_from_fork_asm+0x1a/0x30
<4> [512.410064] </TASK>
<4> [512.410071] irq event stamp: 414991
<4> [512.410077] hardirqs last enabled at (414997): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.410092] hardirqs last disabled at (415002): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.410105] softirqs last enabled at (414246): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.410119] softirqs last disabled at (414239): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.410131] ---[ end trace 0000000000000000 ]---
<6> [512.410141] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.410538] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.410585] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.411024] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.411674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.412175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.412705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.413171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.413497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.413591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.413698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.413800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.413889] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.413997] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.414119] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.415134] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.425877] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.426183] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.427553] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.427678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.427796] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.427913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.428028] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.428142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.428260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.428382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.428518] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.428647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.428774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.428901] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.429028] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.429154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.429273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.429393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.429517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.429630] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.429743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.429866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.429993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.430115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.430231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.430342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.430451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.430576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.430682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.430791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.430900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.431006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.431110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.431210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.431316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.431421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.431531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.431629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.431726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.431825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.431920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.432012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.432107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.432200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.432289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.432372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.432464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.432545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.432627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.432707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.432790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.432876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.432961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.433047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.433131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.433214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.433297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.433385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.433474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.433558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.433644] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.433761] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.433766] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19113, lrc_seqno=19113, guc_id=0, flags=0x73 in no process [-1]
<7> [512.433769] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.433830] ------------[ cut here ]------------
<4> [512.433831] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.433833] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:57/7471
<4> [512.433909] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.433975] autofs4 [last unloaded: snd_hda_intel]
<4> [512.433979] CPU: 8 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.433982] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.433984] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.433985] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.433990] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.434067] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.434068] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [512.434071] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.434072] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.434074] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.434075] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.434076] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.434077] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [512.434079] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.434080] CR2: 00007b3f4f873000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [512.434082] PKRU: 55555554
<4> [512.434083] Call Trace:
<4> [512.434084] <TASK>
<4> [512.434088] ? lock_sync+0x100/0x100
<4> [512.434093] ? lock_release+0xd0/0x2b0
<4> [512.434099] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.434105] process_one_work+0x239/0x760
<4> [512.434111] worker_thread+0x200/0x3f0
<4> [512.434114] ? __pfx_worker_thread+0x10/0x10
<4> [512.434116] kthread+0x10d/0x150
<4> [512.434119] ? __pfx_kthread+0x10/0x10
<4> [512.434123] ret_from_fork+0x3d4/0x480
<4> [512.434125] ? __pfx_kthread+0x10/0x10
<4> [512.434128] ret_from_fork_asm+0x1a/0x30
<4> [512.434136] </TASK>
<4> [512.434137] irq event stamp: 418111
<4> [512.434138] hardirqs last enabled at (418117): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.434141] hardirqs last disabled at (418122): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.434143] softirqs last enabled at (417248): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.434146] softirqs last disabled at (417243): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.434148] ---[ end trace 0000000000000000 ]---
<6> [512.434150] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.434225] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.434232] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.435473] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [512.435587] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [512.435697] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.435917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.436017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.436116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.436209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.436302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.436393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.436489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.436582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.436670] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.436770] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.436894] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.437910] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.448467] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.448724] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.449754] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.449841] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.449924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.450007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.450088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.450170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.450253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.450334] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.450416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.450505] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.450586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.450665] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.450746] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.450829] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.450911] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.450992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.451072] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.451151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.451231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.451317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.451403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.451501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.451589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.451673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.451756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.451838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.451920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.452006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.452091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.452177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.452265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.452352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.452442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.452542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.452632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.452718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.452803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.452885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.452970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.453056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.453143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.453229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.453314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.453396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.453486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.453569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.453652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.453733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.453817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.453903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.453988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.454073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.454157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.454240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.454322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.454406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.454494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.454576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.454660] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.454780] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.454785] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19113, lrc_seqno=19113, guc_id=0, flags=0x73 in no process [-1]
<7> [512.454787] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.454849] ------------[ cut here ]------------
<4> [512.454850] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.454851] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:13/2711
<4> [512.454927] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.454991] autofs4 [last unloaded: snd_hda_intel]
<4> [512.454996] CPU: 6 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.454999] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.455000] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.455001] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.455007] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.455081] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.455083] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [512.455085] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.455087] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.455088] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.455090] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.455091] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.455092] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [512.455094] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.455095] CR2: 00007b3f4f70b000 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [512.455097] PKRU: 55555554
<4> [512.455098] Call Trace:
<4> [512.455099] <TASK>
<4> [512.455103] ? lock_sync+0x100/0x100
<4> [512.455108] ? lock_release+0xd0/0x2b0
<4> [512.455114] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.455120] process_one_work+0x239/0x760
<4> [512.455126] worker_thread+0x200/0x3f0
<4> [512.455129] ? __pfx_worker_thread+0x10/0x10
<4> [512.455131] kthread+0x10d/0x150
<4> [512.455134] ? __pfx_kthread+0x10/0x10
<4> [512.455138] ret_from_fork+0x3d4/0x480
<4> [512.455140] ? __pfx_kthread+0x10/0x10
<4> [512.455144] ret_from_fork_asm+0x1a/0x30
<4> [512.455151] </TASK>
<4> [512.455152] irq event stamp: 1630931
<4> [512.455153] hardirqs last enabled at (1630937): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.455157] hardirqs last disabled at (1630942): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.455159] softirqs last enabled at (1629814): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.455161] softirqs last disabled at (1629805): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.455164] ---[ end trace 0000000000000000 ]---
<7> [512.456447] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [512.456952] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [512.460805] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19122, lrc_seqno=19122, guc_id=0, flags=0x73 in no process [-1]
<7> [512.460809] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.460874] ------------[ cut here ]------------
<4> [512.460875] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.460877] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:13/2711
<4> [512.460950] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.461018] autofs4 [last unloaded: snd_hda_intel]
<4> [512.461022] CPU: 6 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.461025] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.461026] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.461028] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.461033] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.461105] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.461106] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [512.461109] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.461110] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.461111] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.461112] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.461113] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.461115] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [512.461116] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.461118] CR2: 00007b3f4f70b000 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [512.461119] PKRU: 55555554
<4> [512.461120] Call Trace:
<4> [512.461122] <TASK>
<4> [512.461126] ? lock_sync+0x100/0x100
<4> [512.461130] ? lock_release+0xd0/0x2b0
<4> [512.461136] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.461141] process_one_work+0x239/0x760
<4> [512.461148] worker_thread+0x200/0x3f0
<4> [512.461150] ? __pfx_worker_thread+0x10/0x10
<4> [512.461153] kthread+0x10d/0x150
<4> [512.461156] ? __pfx_kthread+0x10/0x10
<4> [512.461159] ret_from_fork+0x3d4/0x480
<4> [512.461161] ? __pfx_kthread+0x10/0x10
<4> [512.461165] ret_from_fork_asm+0x1a/0x30
<4> [512.461172] </TASK>
<4> [512.461173] irq event stamp: 1632125
<4> [512.461175] hardirqs last enabled at (1632131): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.461178] hardirqs last disabled at (1632136): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.461180] softirqs last enabled at (1629814): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.461182] softirqs last disabled at (1629805): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.461185] ---[ end trace 0000000000000000 ]---
<6> [512.461187] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.461259] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.461265] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.461557] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.461815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.461908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.462003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.462093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.462181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.462267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.462353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.462443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.462543] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.462655] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.462772] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.463800] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.474468] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.474719] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.475737] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.475816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.475894] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.475972] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.476050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.476128] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.476207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.476284] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.476360] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.476435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.476550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.476648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.476722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.476796] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.476869] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.476943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.477018] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.477092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.477166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.477250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.477332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.477411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.477505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.477599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.477677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.477755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.477834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.477917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.478000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.478080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.478159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.478239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.478324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.478409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.478505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.478610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.478694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.478775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.478857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.478933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.479013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.479093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.479171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.479248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.479330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.479412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.479502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.479605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.479686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.479764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.479843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.479925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.480005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.480085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.480168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.480249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.480329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.480407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.480496] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.480630] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.480635] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19122, lrc_seqno=19122, guc_id=0, flags=0x73 in no process [-1]
<7> [512.480637] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.480696] ------------[ cut here ]------------
<4> [512.480697] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.480698] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:51/7465
<4> [512.480770] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.480837] autofs4 [last unloaded: snd_hda_intel]
<4> [512.480841] CPU: 10 UID: 0 PID: 7465 Comm: kworker/u64:51 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.480844] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.480845] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.480847] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.480852] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.480923] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.480925] RSP: 0018:ffffc90002f5bca0 EFLAGS: 00010246
<4> [512.480927] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.480928] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.480930] RBP: ffffc90002f5bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.480931] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.480932] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.480933] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [512.480935] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.480937] CR2: 00007b3f4f873000 CR3: 000000012db16004 CR4: 0000000000f72ef0
<4> [512.480938] PKRU: 55555554
<4> [512.480939] Call Trace:
<4> [512.480940] <TASK>
<4> [512.480944] ? lock_sync+0x100/0x100
<4> [512.480949] ? lock_release+0xd0/0x2b0
<4> [512.480955] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.480960] process_one_work+0x239/0x760
<4> [512.480967] worker_thread+0x200/0x3f0
<4> [512.480970] ? __pfx_worker_thread+0x10/0x10
<4> [512.480972] kthread+0x10d/0x150
<4> [512.480975] ? __pfx_kthread+0x10/0x10
<4> [512.480979] ret_from_fork+0x3d4/0x480
<4> [512.480981] ? __pfx_kthread+0x10/0x10
<4> [512.480985] ret_from_fork_asm+0x1a/0x30
<4> [512.480992] </TASK>
<4> [512.480994] irq event stamp: 434943
<4> [512.480995] hardirqs last enabled at (434949): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.480998] hardirqs last disabled at (434954): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.481001] softirqs last enabled at (433832): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.481004] softirqs last disabled at (433825): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.481006] ---[ end trace 0000000000000000 ]---
<6> [512.481008] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.481079] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.481087] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.481499] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.481736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.481826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.481920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.482009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.482097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.482184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.482270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.482358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.482442] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.482554] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.482686] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.483701] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.494424] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.494689] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.495725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.495805] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.495882] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.495959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.496037] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.496115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.496193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.496270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.496346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.496420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.496507] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.496607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.496683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.496757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.496831] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.496906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.496981] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.497057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.497133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.497217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.497299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.497380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.497465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.497561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.497644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.497724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.497803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.497884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.497965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.498042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.498121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.498202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.498286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.498372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.498456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.498555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.498672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.498757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.498839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.498917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.498998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.499080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.499162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.499240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.499322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.499400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.499486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.499581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.499664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.499743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.499820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.499900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.499981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.500063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.500141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.500221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.500299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.500378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.500457] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.500597] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.500604] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19122, lrc_seqno=19122, guc_id=0, flags=0x73 in no process [-1]
<7> [512.500607] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.500666] ------------[ cut here ]------------
<4> [512.500667] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.500669] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:51/7465
<4> [512.500742] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.500806] autofs4 [last unloaded: snd_hda_intel]
<4> [512.500810] CPU: 10 UID: 0 PID: 7465 Comm: kworker/u64:51 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.500813] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.500815] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.500816] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.500821] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.500891] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.500893] RSP: 0018:ffffc90002f5bca0 EFLAGS: 00010246
<4> [512.500895] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.500897] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.500898] RBP: ffffc90002f5bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.500899] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.500901] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.500902] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [512.500904] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.500905] CR2: 00007b3f4f873000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [512.500907] PKRU: 55555554
<4> [512.500908] Call Trace:
<4> [512.500909] <TASK>
<4> [512.500913] ? lock_sync+0x100/0x100
<4> [512.500917] ? lock_release+0xd0/0x2b0
<4> [512.500923] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.500928] process_one_work+0x239/0x760
<4> [512.500935] worker_thread+0x200/0x3f0
<4> [512.500937] ? __pfx_worker_thread+0x10/0x10
<4> [512.500940] kthread+0x10d/0x150
<4> [512.500943] ? __pfx_kthread+0x10/0x10
<4> [512.500946] ret_from_fork+0x3d4/0x480
<4> [512.500948] ? __pfx_kthread+0x10/0x10
<4> [512.500952] ret_from_fork_asm+0x1a/0x30
<4> [512.500959] </TASK>
<4> [512.500960] irq event stamp: 438079
<4> [512.500961] hardirqs last enabled at (438085): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.500964] hardirqs last disabled at (438090): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.500966] softirqs last enabled at (437150): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.500969] softirqs last disabled at (437145): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.500971] ---[ end trace 0000000000000000 ]---
<7> [512.502263] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [512.502370] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [512.503092] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19123, lrc_seqno=19123, guc_id=0, flags=0x73 in no process [-1]
<7> [512.503096] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<7> [512.503152] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:571]
<4> [512.503161] ------------[ cut here ]------------
<4> [512.503163] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.503164] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:51/7465
<4> [512.503239] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.503324] autofs4 [last unloaded: snd_hda_intel]
<4> [512.503329] CPU: 8 UID: 0 PID: 7465 Comm: kworker/u64:51 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.503333] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.503334] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.503336] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.503341] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.503412] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.503414] RSP: 0018:ffffc90002f5bca0 EFLAGS: 00010246
<4> [512.503416] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.503418] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.503420] RBP: ffffc90002f5bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.503421] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.503423] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.503424] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [512.503426] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.503427] CR2: 00007b3f4f873000 CR3: 000000012d64b006 CR4: 0000000000f72ef0
<4> [512.503429] PKRU: 55555554
<4> [512.503431] Call Trace:
<4> [512.503432] <TASK>
<4> [512.503436] ? lock_sync+0x100/0x100
<4> [512.503441] ? lock_release+0xd0/0x2b0
<4> [512.503447] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.503453] process_one_work+0x239/0x760
<4> [512.503467] worker_thread+0x200/0x3f0
<4> [512.503471] ? __pfx_worker_thread+0x10/0x10
<4> [512.503473] kthread+0x10d/0x150
<4> [512.503476] ? __pfx_kthread+0x10/0x10
<4> [512.503480] ret_from_fork+0x3d4/0x480
<4> [512.503482] ? __pfx_kthread+0x10/0x10
<4> [512.503486] ret_from_fork_asm+0x1a/0x30
<4> [512.503493] </TASK>
<4> [512.503495] irq event stamp: 439065
<4> [512.503496] hardirqs last enabled at (439071): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.503499] hardirqs last disabled at (439076): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.503501] softirqs last enabled at (439016): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.503504] softirqs last disabled at (439007): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.503506] ---[ end trace 0000000000000000 ]---
<6> [512.503508] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.503578] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.503586] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.503638] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.503899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.504038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.504196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.504333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.504481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.504615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.504749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.504885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.505017] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.505161] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.505328] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.506816] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.517556] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.517870] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.519060] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.519182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.519302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.519423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.519561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.519653] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.519735] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.519813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.519890] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.519965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.520041] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.520115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.520189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.520264] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.520338] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.520413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.520498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.520573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.520647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.520729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.520809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.520890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.520971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.521051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.521128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.521206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.521284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.521364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.521443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.521532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.521616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.521698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.521785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.521870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.521955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.522035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.522117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.522194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.522270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.522346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.522426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.522513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.522596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.522676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.522759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.522837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.522916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.522993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.523072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.523148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.523225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.523308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.523389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.523471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.523550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.523629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.523705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.523781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.523861] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.523977] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.523982] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19123, lrc_seqno=19123, guc_id=0, flags=0x73 in no process [-1]
<7> [512.523985] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.524044] ------------[ cut here ]------------
<4> [512.524045] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.524046] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:57/7471
<4> [512.524119] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.524185] autofs4 [last unloaded: snd_hda_intel]
<4> [512.524189] CPU: 4 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.524192] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.524193] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.524195] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.524200] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.524270] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.524272] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [512.524274] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.524275] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.524277] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.524278] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.524279] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.524280] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [512.524282] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.524283] CR2: 0000737de22cb2b0 CR3: 000000012d64b001 CR4: 0000000000f72ef0
<4> [512.524285] PKRU: 55555554
<4> [512.524286] Call Trace:
<4> [512.524287] <TASK>
<4> [512.524291] ? lock_sync+0x100/0x100
<4> [512.524296] ? lock_release+0xd0/0x2b0
<4> [512.524302] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.524307] process_one_work+0x239/0x760
<4> [512.524313] worker_thread+0x200/0x3f0
<4> [512.524316] ? __pfx_worker_thread+0x10/0x10
<4> [512.524319] kthread+0x10d/0x150
<4> [512.524322] ? __pfx_kthread+0x10/0x10
<4> [512.524325] ret_from_fork+0x3d4/0x480
<4> [512.524327] ? __pfx_kthread+0x10/0x10
<4> [512.524331] ret_from_fork_asm+0x1a/0x30
<4> [512.524338] </TASK>
<4> [512.524339] irq event stamp: 422071
<4> [512.524340] hardirqs last enabled at (422077): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.524343] hardirqs last disabled at (422082): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.524345] softirqs last enabled at (421106): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.524348] softirqs last disabled at (421101): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.524350] ---[ end trace 0000000000000000 ]---
<6> [512.524352] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.524422] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.524428] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.524838] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.525042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.525131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.525224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.525314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.525401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.525495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.525582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.525671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.525754] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.525848] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.525968] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.526978] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.537466] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.537716] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.538740] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.538818] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.538896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.538974] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.539052] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.539129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.539206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.539281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.539356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.539430] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.539515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.539589] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.539665] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.539742] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.539818] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.539894] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.539969] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.540044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.540119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.540201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.540282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.540361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.540441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.540530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.540611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.540692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.540770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.540851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.540931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.541010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.541090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.541169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.541255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.541340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.541426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.541519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.541602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.541681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.541760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.541836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.541916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.541993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.542070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.542145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.542225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.542303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.542380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.542456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.542546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.542622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.542697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.542779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.542861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.542940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.543017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.543095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.543171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.543247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.543327] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.543441] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.543445] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19123, lrc_seqno=19123, guc_id=0, flags=0x73 in no process [-1]
<7> [512.543447] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.544383] ------------[ cut here ]------------
<4> [512.544385] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.544386] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:57/7471
<4> [512.544466] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.544531] autofs4 [last unloaded: snd_hda_intel]
<4> [512.544535] CPU: 4 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.544538] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.544539] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.544540] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.544546] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.544617] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.544619] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [512.544621] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.544623] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.544624] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.544626] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.544627] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.544629] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [512.544630] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.544632] CR2: 0000737de22cb2b0 CR3: 000000012d64b001 CR4: 0000000000f72ef0
<4> [512.544634] PKRU: 55555554
<4> [512.544635] Call Trace:
<4> [512.544636] <TASK>
<4> [512.544640] ? lock_sync+0x100/0x100
<4> [512.544645] ? lock_release+0xd0/0x2b0
<4> [512.544651] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.544657] process_one_work+0x239/0x760
<4> [512.544663] worker_thread+0x200/0x3f0
<4> [512.544666] ? __pfx_worker_thread+0x10/0x10
<4> [512.544669] kthread+0x10d/0x150
<4> [512.544672] ? __pfx_kthread+0x10/0x10
<4> [512.544676] ret_from_fork+0x3d4/0x480
<4> [512.544678] ? __pfx_kthread+0x10/0x10
<4> [512.544681] ret_from_fork_asm+0x1a/0x30
<4> [512.544689] </TASK>
<4> [512.544690] irq event stamp: 425213
<4> [512.544692] hardirqs last enabled at (425219): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.544695] hardirqs last disabled at (425224): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.544697] softirqs last enabled at (424470): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.544700] softirqs last disabled at (424463): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.544702] ---[ end trace 0000000000000000 ]---
<7> [512.544718] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [512.544821] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [512.548455] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19132, lrc_seqno=19132, guc_id=0, flags=0x73 in no process [-1]
<7> [512.548461] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.548526] ------------[ cut here ]------------
<4> [512.548528] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.548529] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:57/7471
<4> [512.548605] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.548669] autofs4 [last unloaded: snd_hda_intel]
<4> [512.548673] CPU: 4 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.548676] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.548678] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.548679] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.548684] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.548755] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.548757] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [512.548759] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.548760] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.548761] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.548763] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.548764] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.548765] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [512.548767] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.548768] CR2: 0000737de22cb2b0 CR3: 000000012d64b001 CR4: 0000000000f72ef0
<4> [512.548770] PKRU: 55555554
<4> [512.548771] Call Trace:
<4> [512.548772] <TASK>
<4> [512.548776] ? lock_sync+0x100/0x100
<4> [512.548780] ? lock_release+0xd0/0x2b0
<4> [512.548786] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.548791] process_one_work+0x239/0x760
<4> [512.548797] worker_thread+0x200/0x3f0
<4> [512.548800] ? __pfx_worker_thread+0x10/0x10
<4> [512.548802] kthread+0x10d/0x150
<4> [512.548805] ? __pfx_kthread+0x10/0x10
<4> [512.548809] ret_from_fork+0x3d4/0x480
<4> [512.548811] ? __pfx_kthread+0x10/0x10
<4> [512.548814] ret_from_fork_asm+0x1a/0x30
<4> [512.548822] </TASK>
<4> [512.548823] irq event stamp: 426669
<4> [512.548824] hardirqs last enabled at (426675): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.548827] hardirqs last disabled at (426680): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.548829] softirqs last enabled at (424470): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.548831] softirqs last disabled at (424463): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.548833] ---[ end trace 0000000000000000 ]---
<6> [512.548835] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.548906] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.548912] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.549187] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.549389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.549485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.549578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.549668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.549754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.549839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.549924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.550014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.550100] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.550197] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.550313] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.551320] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.561466] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.561715] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.562754] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.562834] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.562911] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.562988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.563064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.563139] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.563214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.563288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.563362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.563435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.563566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.563643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.563719] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.563795] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.563871] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.563946] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.564020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.564094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.564168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.564250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.564330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.564418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.564507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.564585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.564665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.564745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.564827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.564911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.564991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.565071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.565150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.565229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.565315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.565398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.565486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.565571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.565655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.565736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.565816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.565894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.565973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.566051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.566134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.566217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.566303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.566385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.566467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.566546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.566625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.566703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.566779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.566858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.566935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.567012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.567091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.567174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.567253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.567331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.567411] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.567532] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.567536] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19132, lrc_seqno=19132, guc_id=0, flags=0x73 in no process [-1]
<7> [512.567539] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.567597] ------------[ cut here ]------------
<4> [512.567599] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.567600] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:57/7471
<4> [512.567672] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.567736] autofs4 [last unloaded: snd_hda_intel]
<4> [512.567740] CPU: 4 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.567743] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.567744] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.567745] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.567750] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.567820] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.567822] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [512.567824] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.567825] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.567826] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.567828] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.567829] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.567830] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [512.567832] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.567833] CR2: 0000737de22cb2b0 CR3: 000000012d64b001 CR4: 0000000000f72ef0
<4> [512.567835] PKRU: 55555554
<4> [512.567836] Call Trace:
<4> [512.567837] <TASK>
<4> [512.567841] ? lock_sync+0x100/0x100
<4> [512.567845] ? lock_release+0xd0/0x2b0
<4> [512.567850] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.567856] process_one_work+0x239/0x760
<4> [512.567862] worker_thread+0x200/0x3f0
<4> [512.567865] ? __pfx_worker_thread+0x10/0x10
<4> [512.567867] kthread+0x10d/0x150
<4> [512.567870] ? __pfx_kthread+0x10/0x10
<4> [512.567874] ret_from_fork+0x3d4/0x480
<4> [512.567876] ? __pfx_kthread+0x10/0x10
<4> [512.567879] ret_from_fork_asm+0x1a/0x30
<4> [512.567887] </TASK>
<4> [512.567888] irq event stamp: 429995
<4> [512.567889] hardirqs last enabled at (430001): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.567892] hardirqs last disabled at (430006): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.567894] softirqs last enabled at (428884): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.567896] softirqs last disabled at (428877): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.567898] ---[ end trace 0000000000000000 ]---
<6> [512.567900] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.567970] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.567976] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.568382] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.568589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.568677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.568769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.568857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.568943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.569028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.569113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.569199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.569282] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.569379] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.569500] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.570507] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.580466] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.580715] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.581759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.581838] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.581915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.581993] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.582073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.582150] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.582226] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.582302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.582377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.582452] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.582545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.582619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.582693] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.582767] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.582845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.582922] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.582998] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.583075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.583152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.583235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.583317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.583398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.583483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.583563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.583642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.583725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.583805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.583886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.583967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.584046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.584126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.584204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.584291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.584379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.584469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.584552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.584633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.584711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.584788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.584865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.584945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.585021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.585098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.585175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.585256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.585332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.585407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.585491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.585569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.585646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.585727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.585810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.585888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.585967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.586045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.586124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.586200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.586275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.586355] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.587322] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.587328] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19132, lrc_seqno=19132, guc_id=0, flags=0x73 in no process [-1]
<7> [512.587331] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.587396] ------------[ cut here ]------------
<4> [512.587397] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.587398] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:57/7471
<4> [512.587476] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.587541] autofs4 [last unloaded: snd_hda_intel]
<4> [512.587545] CPU: 4 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.587547] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.587549] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.587550] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.587555] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.587626] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.587628] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [512.587630] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.587632] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.587633] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.587635] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.587636] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.587638] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [512.587639] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.587641] CR2: 0000737de22cb2b0 CR3: 000000012d64b001 CR4: 0000000000f72ef0
<4> [512.587643] PKRU: 55555554
<4> [512.587644] Call Trace:
<4> [512.587645] <TASK>
<4> [512.587649] ? lock_sync+0x100/0x100
<4> [512.587654] ? lock_release+0xd0/0x2b0
<4> [512.587659] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.587665] process_one_work+0x239/0x760
<4> [512.587672] worker_thread+0x200/0x3f0
<4> [512.587675] ? __pfx_worker_thread+0x10/0x10
<4> [512.587677] kthread+0x10d/0x150
<4> [512.587680] ? __pfx_kthread+0x10/0x10
<4> [512.587684] ret_from_fork+0x3d4/0x480
<4> [512.587686] ? __pfx_kthread+0x10/0x10
<4> [512.587690] ret_from_fork_asm+0x1a/0x30
<4> [512.587697] </TASK>
<4> [512.587699] irq event stamp: 433163
<4> [512.587700] hardirqs last enabled at (433169): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.587703] hardirqs last disabled at (433174): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.587705] softirqs last enabled at (432420): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.587708] softirqs last disabled at (432413): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.587710] ---[ end trace 0000000000000000 ]---
<7> [512.587725] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [512.587832] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [512.641363] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19133, lrc_seqno=19133, guc_id=0, flags=0x73 in no process [-1]
<7> [512.641389] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<7> [512.641740] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:570]
<4> [512.641865] ------------[ cut here ]------------
<4> [512.641872] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.641880] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:57/7471
<4> [512.642382] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.642852] autofs4 [last unloaded: snd_hda_intel]
<4> [512.642875] CPU: 10 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.642893] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.642900] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.642908] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.642938] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.643310] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.643319] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [512.643331] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.643339] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.643346] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.643352] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.643358] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.643365] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [512.643374] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.643381] CR2: 00007b3f4f873000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [512.643389] PKRU: 55555554
<4> [512.643394] Call Trace:
<4> [512.643400] <TASK>
<4> [512.643419] ? lock_sync+0x100/0x100
<4> [512.643443] ? lock_release+0xd0/0x2b0
<4> [512.643504] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.643535] process_one_work+0x239/0x760
<4> [512.643566] worker_thread+0x200/0x3f0
<4> [512.643581] ? __pfx_worker_thread+0x10/0x10
<4> [512.643594] kthread+0x10d/0x150
<4> [512.643609] ? __pfx_kthread+0x10/0x10
<4> [512.643629] ret_from_fork+0x3d4/0x480
<4> [512.643640] ? __pfx_kthread+0x10/0x10
<4> [512.643658] ret_from_fork_asm+0x1a/0x30
<4> [512.643695] </TASK>
<4> [512.643701] irq event stamp: 434381
<4> [512.643709] hardirqs last enabled at (434387): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.643730] hardirqs last disabled at (434392): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.643747] softirqs last enabled at (433616): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.643767] softirqs last disabled at (433611): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.643785] ---[ end trace 0000000000000000 ]---
<6> [512.643802] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.644289] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.644341] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.644711] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.645333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.645837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.646374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.646619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.646738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.646821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.646902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.646982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.647058] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.647146] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.647272] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.648276] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.658872] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.659185] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.660558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.660679] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.660793] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.660908] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.661020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.661134] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.661249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.661367] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.661495] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.661651] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.661775] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.661901] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.662025] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.662147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.662264] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.662382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.662506] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.662651] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.662764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.662893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.663020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.663140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.663259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.663374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.663491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.663624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.663731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.663842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.663951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.664057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.664158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.664264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.664372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.664490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.664610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.664709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.664807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.664902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.664999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.665093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.665189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.665280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.665367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.665454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.665559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.665663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.665752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.665836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.665921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.666003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.666086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.666169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.666248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.666327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.666410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.666501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.666602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.666682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.666763] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.666879] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.666884] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19133, lrc_seqno=19133, guc_id=0, flags=0x73 in no process [-1]
<7> [512.666886] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.666946] ------------[ cut here ]------------
<4> [512.666947] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.666949] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:57/7471
<4> [512.667023] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.667091] autofs4 [last unloaded: snd_hda_intel]
<4> [512.667095] CPU: 10 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.667098] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.667100] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.667101] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.667106] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.667176] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.667178] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [512.667180] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.667182] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.667183] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.667184] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.667185] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.667187] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [512.667188] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.667190] CR2: 00007b3f4f873000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [512.667191] PKRU: 55555554
<4> [512.667192] Call Trace:
<4> [512.667194] <TASK>
<4> [512.667197] ? lock_sync+0x100/0x100
<4> [512.667202] ? lock_release+0xd0/0x2b0
<4> [512.667208] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.667213] process_one_work+0x239/0x760
<4> [512.667220] worker_thread+0x200/0x3f0
<4> [512.667222] ? __pfx_worker_thread+0x10/0x10
<4> [512.667225] kthread+0x10d/0x150
<4> [512.667228] ? __pfx_kthread+0x10/0x10
<4> [512.667231] ret_from_fork+0x3d4/0x480
<4> [512.667233] ? __pfx_kthread+0x10/0x10
<4> [512.667237] ret_from_fork_asm+0x1a/0x30
<4> [512.667244] </TASK>
<4> [512.667245] irq event stamp: 437505
<4> [512.667247] hardirqs last enabled at (437511): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.667250] hardirqs last disabled at (437516): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.667252] softirqs last enabled at (436474): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.667254] softirqs last disabled at (436467): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.667257] ---[ end trace 0000000000000000 ]---
<6> [512.667258] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.667329] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.667336] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.667721] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.667954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.668045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.668140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.668229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.668317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.668404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.668508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.668623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.668710] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.668809] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.668926] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.669942] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.680644] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.680887] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.681979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.682055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.682128] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.682200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.682271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.682341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.682411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.682489] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.682582] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.682658] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.682732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.682807] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.682884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.682960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.683034] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.683108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.683182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.683255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.683328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.683409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.683500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.683602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.683684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.683762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.683843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.683922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.683999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.684079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.684160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.684237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.684315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.684394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.684485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.684588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.684676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.684758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.684839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.684917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.684998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.685080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.685163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.685244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.685324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.685403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.685497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.685591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.685670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.685747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.685827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.685904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.685986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.686070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.686150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.686230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.686310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.686389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.686472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.686572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.686656] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.686772] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.686776] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19133, lrc_seqno=19133, guc_id=0, flags=0x73 in no process [-1]
<7> [512.686779] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.686838] ------------[ cut here ]------------
<4> [512.686840] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.686841] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:57/7471
<4> [512.686914] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.686979] autofs4 [last unloaded: snd_hda_intel]
<4> [512.686983] CPU: 10 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.686986] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.686987] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.686989] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.686994] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.687063] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.687065] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [512.687067] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.687069] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.687070] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.687071] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.687072] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.687074] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [512.687075] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.687077] CR2: 00007b3f4f873000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [512.687078] PKRU: 55555554
<4> [512.687079] Call Trace:
<4> [512.687081] <TASK>
<4> [512.687085] ? lock_sync+0x100/0x100
<4> [512.687089] ? lock_release+0xd0/0x2b0
<4> [512.687095] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.687100] process_one_work+0x239/0x760
<4> [512.687106] worker_thread+0x200/0x3f0
<4> [512.687109] ? __pfx_worker_thread+0x10/0x10
<4> [512.687112] kthread+0x10d/0x150
<4> [512.687115] ? __pfx_kthread+0x10/0x10
<4> [512.687118] ret_from_fork+0x3d4/0x480
<4> [512.687120] ? __pfx_kthread+0x10/0x10
<4> [512.687124] ret_from_fork_asm+0x1a/0x30
<4> [512.687131] </TASK>
<4> [512.687132] irq event stamp: 440637
<4> [512.687133] hardirqs last enabled at (440643): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.687136] hardirqs last disabled at (440648): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.687138] softirqs last enabled at (439692): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.687141] softirqs last disabled at (439683): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.687143] ---[ end trace 0000000000000000 ]---
<7> [512.688195] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [512.688293] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [512.691853] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19142, lrc_seqno=19142, guc_id=0, flags=0x73 in no process [-1]
<7> [512.691857] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.691923] ------------[ cut here ]------------
<4> [512.691924] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.691926] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:57/7471
<4> [512.692001] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.692068] autofs4 [last unloaded: snd_hda_intel]
<4> [512.692072] CPU: 8 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.692075] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.692076] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.692077] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.692083] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.692155] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.692156] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [512.692159] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.692160] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.692162] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.692163] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.692164] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.692165] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [512.692167] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.692168] CR2: 00007b3f4f873000 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [512.692170] PKRU: 55555554
<4> [512.692171] Call Trace:
<4> [512.692172] <TASK>
<4> [512.692176] ? lock_sync+0x100/0x100
<4> [512.692181] ? lock_release+0xd0/0x2b0
<4> [512.692186] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.692192] process_one_work+0x239/0x760
<4> [512.692198] worker_thread+0x200/0x3f0
<4> [512.692201] ? __pfx_worker_thread+0x10/0x10
<4> [512.692204] kthread+0x10d/0x150
<4> [512.692206] ? __pfx_kthread+0x10/0x10
<4> [512.692210] ret_from_fork+0x3d4/0x480
<4> [512.692212] ? __pfx_kthread+0x10/0x10
<4> [512.692216] ret_from_fork_asm+0x1a/0x30
<4> [512.692223] </TASK>
<4> [512.692224] irq event stamp: 442117
<4> [512.692225] hardirqs last enabled at (442123): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.692228] hardirqs last disabled at (442128): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.692231] softirqs last enabled at (439692): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.692233] softirqs last disabled at (439683): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.692235] ---[ end trace 0000000000000000 ]---
<6> [512.692237] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.692308] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.692314] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.692494] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.692767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.692896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.693032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.693165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.693292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.693416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.693566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.693668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.693755] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.693853] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.693972] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.695059] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.705478] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.705749] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.706805] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.706895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.706976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.707058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.707135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.707212] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.707326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.707440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.707584] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.707695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.707811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.707925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.708017] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.708095] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.708173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.708253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.708336] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.708450] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.708602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.708721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.708841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.708960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.709058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.709138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.709218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.709299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.709387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.709526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.709645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.709763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.709886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.710010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.710114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.710202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.710290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.710375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.710489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.710608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.710727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.710843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.710966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.711088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.711197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.711280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.711367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.711451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.711563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.711681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.711805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.711920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.712033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.712153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.712259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.712344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.712426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.712517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.712596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.712713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.712833] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.712994] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.713001] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19142, lrc_seqno=19142, guc_id=0, flags=0x73 in no process [-1]
<7> [512.713005] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.713094] ------------[ cut here ]------------
<4> [512.713096] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.713099] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:57/7471
<4> [512.713208] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.713336] autofs4 [last unloaded: snd_hda_intel]
<4> [512.713343] CPU: 8 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.713347] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.713350] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.713352] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.713361] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.713437] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.713439] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [512.713441] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.713443] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.713444] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.713445] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.713447] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.713448] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [512.713450] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.713451] CR2: 00007b3f4f873000 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [512.713453] PKRU: 55555554
<4> [512.713454] Call Trace:
<4> [512.713455] <TASK>
<4> [512.713465] ? lock_sync+0x100/0x100
<4> [512.713469] ? lock_release+0xd0/0x2b0
<4> [512.713475] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.713481] process_one_work+0x239/0x760
<4> [512.713487] worker_thread+0x200/0x3f0
<4> [512.713490] ? __pfx_worker_thread+0x10/0x10
<4> [512.713493] kthread+0x10d/0x150
<4> [512.713496] ? __pfx_kthread+0x10/0x10
<4> [512.713499] ret_from_fork+0x3d4/0x480
<4> [512.713501] ? __pfx_kthread+0x10/0x10
<4> [512.713505] ret_from_fork_asm+0x1a/0x30
<4> [512.713512] </TASK>
<4> [512.713514] irq event stamp: 445207
<4> [512.713515] hardirqs last enabled at (445213): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.713518] hardirqs last disabled at (445218): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.713520] softirqs last enabled at (444064): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.713523] softirqs last disabled at (444059): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.713525] ---[ end trace 0000000000000000 ]---
<6> [512.713527] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.713598] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.713605] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.714012] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.714260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.714392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.714559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.714659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.714751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.714841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.714931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.715022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.715109] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.715206] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.715323] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.716345] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.726467] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.726714] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.727691] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.727769] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.727844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.727922] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.728000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.728077] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.728153] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.728230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.728309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.728386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.728465] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.728539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.728614] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.728688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.728761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.728834] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.728908] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.728982] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.729056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.729137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.729217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.729296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.729376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.729453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.729546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.729623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.729701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.729782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.729864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.729949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.730031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.730112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.730197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.730281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.730366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.730447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.730540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.730619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.730699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.730779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.730859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.730937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.731015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.731092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.731172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.731249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.731327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.731404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.731491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.731571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.731649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.731729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.731807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.731885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.731961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.732039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.732115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.732193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.732276] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.732392] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.732397] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19142, lrc_seqno=19142, guc_id=0, flags=0x73 in no process [-1]
<7> [512.732399] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.732461] ------------[ cut here ]------------
<4> [512.732463] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.732464] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:57/7471
<4> [512.732535] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.732600] autofs4 [last unloaded: snd_hda_intel]
<4> [512.732604] CPU: 6 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.732607] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.732608] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.732610] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.732615] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.732685] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.732687] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [512.732690] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.732691] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.732693] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.732694] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.732696] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.732697] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [512.732699] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.732701] CR2: 00007b3f4f70b000 CR3: 000000012db16005 CR4: 0000000000f72ef0
<4> [512.732702] PKRU: 55555554
<4> [512.732704] Call Trace:
<4> [512.732705] <TASK>
<4> [512.732709] ? lock_sync+0x100/0x100
<4> [512.732714] ? lock_release+0xd0/0x2b0
<4> [512.732720] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.732726] process_one_work+0x239/0x760
<4> [512.732732] worker_thread+0x200/0x3f0
<4> [512.732735] ? __pfx_worker_thread+0x10/0x10
<4> [512.732738] kthread+0x10d/0x150
<4> [512.732741] ? __pfx_kthread+0x10/0x10
<4> [512.732745] ret_from_fork+0x3d4/0x480
<4> [512.732747] ? __pfx_kthread+0x10/0x10
<4> [512.732751] ret_from_fork_asm+0x1a/0x30
<4> [512.732758] </TASK>
<4> [512.732759] irq event stamp: 448335
<4> [512.732761] hardirqs last enabled at (448341): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.732764] hardirqs last disabled at (448346): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.732766] softirqs last enabled at (447332): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.732769] softirqs last disabled at (447327): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.732772] ---[ end trace 0000000000000000 ]---
<7> [512.733841] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [512.733950] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [512.734381] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19143, lrc_seqno=19143, guc_id=0, flags=0x73 in no process [-1]
<7> [512.734386] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.734450] ------------[ cut here ]------------
<4> [512.734452] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<7> [512.734486] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:571]
<4> [512.734454] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:57/7471
<4> [512.734602] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.734722] autofs4 [last unloaded: snd_hda_intel]
<4> [512.734728] CPU: 8 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.734733] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.734735] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.734737] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.734746] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.734853] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.734856] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [512.734860] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.734862] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.734865] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.734867] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.734869] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.734871] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [512.734874] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.734876] CR2: 00007b3f4f873000 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [512.734879] PKRU: 55555554
<4> [512.734881] Call Trace:
<4> [512.734883] <TASK>
<4> [512.734890] ? lock_sync+0x100/0x100
<4> [512.734898] ? lock_release+0xd0/0x2b0
<4> [512.734908] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.734918] process_one_work+0x239/0x760
<4> [512.734930] worker_thread+0x200/0x3f0
<4> [512.734936] ? __pfx_worker_thread+0x10/0x10
<4> [512.734940] kthread+0x10d/0x150
<4> [512.734944] ? __pfx_kthread+0x10/0x10
<4> [512.734950] ret_from_fork+0x3d4/0x480
<4> [512.734953] ? __pfx_kthread+0x10/0x10
<4> [512.734959] ret_from_fork_asm+0x1a/0x30
<4> [512.734974] </TASK>
<4> [512.734976] irq event stamp: 449327
<4> [512.734978] hardirqs last enabled at (449333): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.734983] hardirqs last disabled at (449338): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.734987] softirqs last enabled at (448584): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.734991] softirqs last disabled at (448579): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.734994] ---[ end trace 0000000000000000 ]---
<6> [512.735006] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.735080] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.735087] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.735191] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.735401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.735522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.735650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.735741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.735830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.735916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.736002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.736089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.736175] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.736273] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.736390] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.737455] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.747468] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.747725] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.749036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.749172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.749294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.749417] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.749568] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.749690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.749820] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.749943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.750065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.750186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.750309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.750430] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.750597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.750719] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.750841] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.750963] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.751086] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.751207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.751328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.751456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.751606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.751694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.751781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.751863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.751943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.752024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.752102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.752184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.752268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.752353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.752434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.752526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.752613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.752699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.752784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.752866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.752947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.753029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.753110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.753191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.753273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.753353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.753431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.753516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.753599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.753681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.753761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.753838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.753918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.753994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.754070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.754150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.754227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.754304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.754379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.754456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.754547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.754624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.754703] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.754815] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.754819] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19143, lrc_seqno=19143, guc_id=0, flags=0x73 in no process [-1]
<7> [512.754822] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.754881] ------------[ cut here ]------------
<4> [512.754882] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.754883] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:51/7465
<4> [512.754955] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.755021] autofs4 [last unloaded: snd_hda_intel]
<4> [512.755025] CPU: 6 UID: 0 PID: 7465 Comm: kworker/u64:51 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.755028] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.755029] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.755030] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.755035] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.755106] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.755108] RSP: 0018:ffffc90002f5bca0 EFLAGS: 00010246
<4> [512.755110] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.755111] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.755113] RBP: ffffc90002f5bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.755114] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.755115] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.755116] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [512.755118] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.755119] CR2: 00007b3f4f70b000 CR3: 000000012db16005 CR4: 0000000000f72ef0
<4> [512.755121] PKRU: 55555554
<4> [512.755122] Call Trace:
<4> [512.755123] <TASK>
<4> [512.755127] ? lock_sync+0x100/0x100
<4> [512.755131] ? lock_release+0xd0/0x2b0
<4> [512.755137] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.755143] process_one_work+0x239/0x760
<4> [512.755149] worker_thread+0x200/0x3f0
<4> [512.755151] ? __pfx_worker_thread+0x10/0x10
<4> [512.755154] kthread+0x10d/0x150
<4> [512.755157] ? __pfx_kthread+0x10/0x10
<4> [512.755160] ret_from_fork+0x3d4/0x480
<4> [512.755162] ? __pfx_kthread+0x10/0x10
<4> [512.755166] ret_from_fork_asm+0x1a/0x30
<4> [512.755173] </TASK>
<4> [512.755175] irq event stamp: 444863
<4> [512.755176] hardirqs last enabled at (444869): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.755179] hardirqs last disabled at (444874): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.755181] softirqs last enabled at (444000): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.755184] softirqs last disabled at (443995): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.755186] ---[ end trace 0000000000000000 ]---
<6> [512.755188] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.755258] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.755264] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.755683] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.755886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.755975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.756067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.756157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.756245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.756330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.756417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.756517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.756600] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.756698] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.756815] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.757822] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.768466] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.768715] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.769694] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.769774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.769852] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.769929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.770006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.770083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.770159] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.770234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.770309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.770385] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.770464] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.770540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.770616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.770694] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.770770] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.770845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.770919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.770993] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.771069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.771151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.771233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.771312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.771393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.771478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.771557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.771635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.771715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.771799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.771881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.771961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.772040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.772120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.772204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.772289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.772372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.772453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.772546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.772624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.772702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.772778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.772858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.772936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.773015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.773091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.773170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.773247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.773324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.773400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.773482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.773558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.773637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.773722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.773801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.773883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.773962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.774041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.774119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.774196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.774276] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.774388] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.774392] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19143, lrc_seqno=19143, guc_id=0, flags=0x73 in no process [-1]
<7> [512.774395] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.774453] ------------[ cut here ]------------
<4> [512.774454] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.774455] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:51/7465
<4> [512.774542] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.774606] autofs4 [last unloaded: snd_hda_intel]
<4> [512.774610] CPU: 6 UID: 0 PID: 7465 Comm: kworker/u64:51 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.774613] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.774614] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.774615] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.774620] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.774691] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.774692] RSP: 0018:ffffc90002f5bca0 EFLAGS: 00010246
<4> [512.774694] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.774696] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.774697] RBP: ffffc90002f5bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.774698] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.774699] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.774701] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [512.774702] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.774703] CR2: 00007b3f4f70b000 CR3: 000000012db16005 CR4: 0000000000f72ef0
<4> [512.774705] PKRU: 55555554
<4> [512.774706] Call Trace:
<4> [512.774707] <TASK>
<4> [512.774711] ? lock_sync+0x100/0x100
<4> [512.774715] ? lock_release+0xd0/0x2b0
<4> [512.774720] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.774726] process_one_work+0x239/0x760
<4> [512.774732] worker_thread+0x200/0x3f0
<4> [512.774735] ? __pfx_worker_thread+0x10/0x10
<4> [512.774738] kthread+0x10d/0x150
<4> [512.774741] ? __pfx_kthread+0x10/0x10
<4> [512.774745] ret_from_fork+0x3d4/0x480
<4> [512.774747] ? __pfx_kthread+0x10/0x10
<4> [512.774751] ret_from_fork_asm+0x1a/0x30
<4> [512.774758] </TASK>
<4> [512.774759] irq event stamp: 447989
<4> [512.774761] hardirqs last enabled at (447995): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.774763] hardirqs last disabled at (448000): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.774766] softirqs last enabled at (447072): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.774769] softirqs last disabled at (447061): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.774771] ---[ end trace 0000000000000000 ]---
<7> [512.775787] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [512.775897] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [512.779408] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19152, lrc_seqno=19152, guc_id=0, flags=0x73 in no process [-1]
<7> [512.779412] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.779514] ------------[ cut here ]------------
<4> [512.779516] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.779519] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:51/7465
<4> [512.779646] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.779767] autofs4 [last unloaded: snd_hda_intel]
<4> [512.779774] CPU: 8 UID: 0 PID: 7465 Comm: kworker/u64:51 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.779778] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.779780] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.779783] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.779791] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.779897] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.779900] RSP: 0018:ffffc90002f5bca0 EFLAGS: 00010246
<4> [512.779904] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.779906] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.779909] RBP: ffffc90002f5bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.779911] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.779913] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.779916] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [512.779918] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.779921] CR2: 00007b3f4f873000 CR3: 000000012db16005 CR4: 0000000000f72ef0
<4> [512.779923] PKRU: 55555554
<4> [512.779926] Call Trace:
<4> [512.779928] <TASK>
<4> [512.779935] ? lock_sync+0x100/0x100
<4> [512.779943] ? lock_release+0xd0/0x2b0
<4> [512.779952] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.779963] process_one_work+0x239/0x760
<4> [512.779975] worker_thread+0x200/0x3f0
<4> [512.779980] ? __pfx_worker_thread+0x10/0x10
<4> [512.779984] kthread+0x10d/0x150
<4> [512.779988] ? __pfx_kthread+0x10/0x10
<4> [512.779995] ret_from_fork+0x3d4/0x480
<4> [512.779999] ? __pfx_kthread+0x10/0x10
<4> [512.780005] ret_from_fork_asm+0x1a/0x30
<4> [512.780019] </TASK>
<4> [512.780021] irq event stamp: 449429
<4> [512.780023] hardirqs last enabled at (449435): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.780028] hardirqs last disabled at (449440): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.780032] softirqs last enabled at (448668): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.780036] softirqs last disabled at (448623): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.780039] ---[ end trace 0000000000000000 ]---
<6> [512.780042] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.780153] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.780163] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.780471] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.780677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.780796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.780931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.781059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.781183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.781309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.781438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.781586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.781674] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.781771] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.781889] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.782953] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.793469] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.794065] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.795158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.795255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.795334] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.795416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.795509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.795626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.795737] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.795849] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.795959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.796071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.796163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.796238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.796314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.796393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.796478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.796579] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.796691] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.796801] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.796914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.797033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.797158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.797263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.797350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.797433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.797522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.797615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.797734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.797891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.798011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.798132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.798251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.798337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.798428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.798529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.798616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.798741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.798867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.798985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.799101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.799218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.799342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.799437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.799538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.799620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.799707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.799815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.799935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.800050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.800169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.800287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.800407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.800505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.800588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.800671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.800750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.800835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.800953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.801071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.801191] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.801355] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.801362] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19152, lrc_seqno=19152, guc_id=0, flags=0x73 in no process [-1]
<7> [512.801366] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.802342] ------------[ cut here ]------------
<4> [512.802344] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.802346] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:51/7465
<4> [512.802486] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.802609] autofs4 [last unloaded: snd_hda_intel]
<4> [512.802616] CPU: 8 UID: 0 PID: 7465 Comm: kworker/u64:51 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.802620] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.802622] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.802625] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.802633] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.802738] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.802741] RSP: 0018:ffffc90002f5bca0 EFLAGS: 00010246
<4> [512.802745] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.802747] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.802750] RBP: ffffc90002f5bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.802752] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.802754] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.802757] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [512.802760] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.802763] CR2: 00007b3f4f873000 CR3: 000000012db16005 CR4: 0000000000f72ef0
<4> [512.802765] PKRU: 55555554
<4> [512.802768] Call Trace:
<4> [512.802770] <TASK>
<4> [512.802777] ? lock_sync+0x100/0x100
<4> [512.802786] ? lock_release+0xd0/0x2b0
<4> [512.802796] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.802806] process_one_work+0x239/0x760
<4> [512.802818] worker_thread+0x200/0x3f0
<4> [512.802823] ? __pfx_worker_thread+0x10/0x10
<4> [512.802827] kthread+0x10d/0x150
<4> [512.802832] ? __pfx_kthread+0x10/0x10
<4> [512.802838] ret_from_fork+0x3d4/0x480
<4> [512.802841] ? __pfx_kthread+0x10/0x10
<4> [512.802847] ret_from_fork_asm+0x1a/0x30
<4> [512.802861] </TASK>
<4> [512.802863] irq event stamp: 452557
<4> [512.802865] hardirqs last enabled at (452563): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.802870] hardirqs last disabled at (452568): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.802873] softirqs last enabled at (451590): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.802877] softirqs last disabled at (451583): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.802881] ---[ end trace 0000000000000000 ]---
<6> [512.802884] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.802963] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.802972] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.802989] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [512.803093] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [512.803385] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.803667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.803766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.803862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.803949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.804037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.804122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.804209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.804296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.804380] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.804482] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.804615] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.805635] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.816359] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.816625] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.817759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.817841] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.817919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.817998] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.818078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.818155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.818229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.818305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.818380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.818455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.818550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.818640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.818716] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.818793] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.818871] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.818947] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.819021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.819096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.819173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.819254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.819336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.819416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.819510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.819608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.819689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.819768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.819846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.819927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.820009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.820088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.820169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.820252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.820340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.820425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.820520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.820628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.820714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.820794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.820874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.820952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.821033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.821111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.821189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.821265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.821346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.821423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.821517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.821613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.821695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.821772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.821850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.821930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.822008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.822085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.822161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.822240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.822319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.822397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.822483] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.822629] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.822634] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19152, lrc_seqno=19152, guc_id=0, flags=0x73 in no process [-1]
<7> [512.822637] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.822697] ------------[ cut here ]------------
<4> [512.822698] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.822700] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:13/2711
<4> [512.822773] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.822839] autofs4 [last unloaded: snd_hda_intel]
<4> [512.822844] CPU: 10 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.822847] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.822848] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.822849] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.822855] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.822926] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.822927] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [512.822930] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.822931] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.822933] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.822934] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.822935] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.822936] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [512.822938] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.822939] CR2: 00007b3f4f873000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [512.822941] PKRU: 55555554
<4> [512.822942] Call Trace:
<4> [512.822943] <TASK>
<4> [512.822947] ? lock_sync+0x100/0x100
<4> [512.822952] ? lock_release+0xd0/0x2b0
<4> [512.822957] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.822963] process_one_work+0x239/0x760
<4> [512.822969] worker_thread+0x200/0x3f0
<4> [512.822972] ? __pfx_worker_thread+0x10/0x10
<4> [512.822975] kthread+0x10d/0x150
<4> [512.822977] ? __pfx_kthread+0x10/0x10
<4> [512.822981] ret_from_fork+0x3d4/0x480
<4> [512.822983] ? __pfx_kthread+0x10/0x10
<4> [512.822987] ret_from_fork_asm+0x1a/0x30
<4> [512.822994] </TASK>
<4> [512.822995] irq event stamp: 1637719
<4> [512.822996] hardirqs last enabled at (1637725): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.822999] hardirqs last disabled at (1637730): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.823001] softirqs last enabled at (1636608): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.823004] softirqs last disabled at (1636601): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.823006] ---[ end trace 0000000000000000 ]---
<7> [512.824053] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [512.824161] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [512.891264] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19153, lrc_seqno=19153, guc_id=0, flags=0x73 in no process [-1]
<7> [512.891284] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<7> [512.891684] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:567]
<4> [512.891698] ------------[ cut here ]------------
<4> [512.891710] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.891718] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:51/7465
<4> [512.892203] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.892574] autofs4 [last unloaded: snd_hda_intel]
<4> [512.892598] CPU: 10 UID: 0 PID: 7465 Comm: kworker/u64:51 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.892615] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.892622] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.892630] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.892663] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.893145] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.893155] RSP: 0018:ffffc90002f5bca0 EFLAGS: 00010246
<4> [512.893167] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.893174] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.893181] RBP: ffffc90002f5bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.893187] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.893194] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.893201] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [512.893209] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.893216] CR2: 00007b3f4f873000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [512.893224] PKRU: 55555554
<4> [512.893230] Call Trace:
<4> [512.893235] <TASK>
<4> [512.893255] ? lock_sync+0x100/0x100
<4> [512.893278] ? lock_release+0xd0/0x2b0
<4> [512.893307] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.893336] process_one_work+0x239/0x760
<4> [512.893368] worker_thread+0x200/0x3f0
<4> [512.893382] ? __pfx_worker_thread+0x10/0x10
<4> [512.893395] kthread+0x10d/0x150
<4> [512.893409] ? __pfx_kthread+0x10/0x10
<4> [512.893428] ret_from_fork+0x3d4/0x480
<4> [512.893439] ? __pfx_kthread+0x10/0x10
<4> [512.893456] ret_from_fork_asm+0x1a/0x30
<4> [512.893518] </TASK>
<4> [512.893525] irq event stamp: 454059
<4> [512.893531] hardirqs last enabled at (454065): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.893547] hardirqs last disabled at (454070): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.893559] softirqs last enabled at (453290): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.893571] softirqs last disabled at (453281): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.893583] ---[ end trace 0000000000000000 ]---
<6> [512.893594] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.894089] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.894157] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.894658] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.895276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.895797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.896325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.896811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.897295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.897392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.897479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.897599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.897693] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.897783] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.897902] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.899028] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.909790] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.910077] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.911293] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.911413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.911545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.911675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.911787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.911901] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.912016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.912130] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.912238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.912344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.912447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.912569] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.912699] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.912802] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.912902] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.913002] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.913103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.913196] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.913290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.913394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.913508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.913633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.913734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.913830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.913922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.914012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.914103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.914198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.914294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.914388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.914484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.914585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.914677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.914766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.914854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.914939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.915022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.915106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.915190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.915270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.915352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.915432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.915538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.915641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.915724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.915807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.915889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.915968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.916048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.916123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.916199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.916278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.916355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.916433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.916525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.916623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.916698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.916777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.916859] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.916989] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.916994] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19153, lrc_seqno=19153, guc_id=0, flags=0x73 in no process [-1]
<7> [512.916997] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.917055] ------------[ cut here ]------------
<4> [512.917056] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.917057] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:51/7465
<4> [512.917128] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.917198] autofs4 [last unloaded: snd_hda_intel]
<4> [512.917203] CPU: 10 UID: 0 PID: 7465 Comm: kworker/u64:51 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.917206] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.917207] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.917209] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.917214] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.917286] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.917288] RSP: 0018:ffffc90002f5bca0 EFLAGS: 00010246
<4> [512.917290] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.917292] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.917293] RBP: ffffc90002f5bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.917295] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.917296] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.917298] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [512.917300] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.917301] CR2: 00007b3f4f873000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [512.917303] PKRU: 55555554
<4> [512.917304] Call Trace:
<4> [512.917306] <TASK>
<4> [512.917310] ? lock_sync+0x100/0x100
<4> [512.917315] ? lock_release+0xd0/0x2b0
<4> [512.917321] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.917327] process_one_work+0x239/0x760
<4> [512.917333] worker_thread+0x200/0x3f0
<4> [512.917336] ? __pfx_worker_thread+0x10/0x10
<4> [512.917339] kthread+0x10d/0x150
<4> [512.917342] ? __pfx_kthread+0x10/0x10
<4> [512.917346] ret_from_fork+0x3d4/0x480
<4> [512.917348] ? __pfx_kthread+0x10/0x10
<4> [512.917352] ret_from_fork_asm+0x1a/0x30
<4> [512.917360] </TASK>
<4> [512.917361] irq event stamp: 457183
<4> [512.917362] hardirqs last enabled at (457189): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.917366] hardirqs last disabled at (457194): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.917368] softirqs last enabled at (456308): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.917371] softirqs last disabled at (456303): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.917373] ---[ end trace 0000000000000000 ]---
<6> [512.917375] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.917445] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.917451] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.917859] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.918095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.918189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.918283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.918371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.918466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.918565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.918651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.918737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.918820] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.918913] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.919032] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.920045] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.930772] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.931016] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.932074] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.932148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.932219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.932291] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.932363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.932434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.932523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.932617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.932695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.932771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.932847] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.932923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.932999] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.933073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.933149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.933224] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.933298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.933375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.933450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.933549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.933663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.933746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.933826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.933905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.933983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.934065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.934144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.934226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.934308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.934388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.934473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.934567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.934653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.934737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.934821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.934904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.934990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.935073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.935153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.935231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.935315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.935397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.935487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.935589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.935672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.935750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.935829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.935906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.935985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.936061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.936138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.936219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.936295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.936372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.936449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.936547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.936642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.936722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.936803] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.936919] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.936923] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19153, lrc_seqno=19153, guc_id=0, flags=0x73 in no process [-1]
<7> [512.936925] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.936984] ------------[ cut here ]------------
<4> [512.936985] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.936987] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:51/7465
<4> [512.937058] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.937123] autofs4 [last unloaded: snd_hda_intel]
<4> [512.937127] CPU: 10 UID: 0 PID: 7465 Comm: kworker/u64:51 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.937129] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.937131] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.937132] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.937137] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.937208] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.937209] RSP: 0018:ffffc90002f5bca0 EFLAGS: 00010246
<4> [512.937212] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.937213] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.937214] RBP: ffffc90002f5bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.937216] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.937217] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.937218] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [512.937220] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.937221] CR2: 00007b3f4f873000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [512.937223] PKRU: 55555554
<4> [512.937224] Call Trace:
<4> [512.937225] <TASK>
<4> [512.937229] ? lock_sync+0x100/0x100
<4> [512.937233] ? lock_release+0xd0/0x2b0
<4> [512.937239] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.937244] process_one_work+0x239/0x760
<4> [512.937251] worker_thread+0x200/0x3f0
<4> [512.937253] ? __pfx_worker_thread+0x10/0x10
<4> [512.937256] kthread+0x10d/0x150
<4> [512.937258] ? __pfx_kthread+0x10/0x10
<4> [512.937262] ret_from_fork+0x3d4/0x480
<4> [512.937264] ? __pfx_kthread+0x10/0x10
<4> [512.937267] ret_from_fork_asm+0x1a/0x30
<4> [512.937275] </TASK>
<4> [512.937276] irq event stamp: 460317
<4> [512.937277] hardirqs last enabled at (460323): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.937280] hardirqs last disabled at (460328): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.937282] softirqs last enabled at (459448): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.937284] softirqs last disabled at (459441): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.937287] ---[ end trace 0000000000000000 ]---
<7> [512.938594] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [512.938704] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [512.942465] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19162, lrc_seqno=19162, guc_id=0, flags=0x73 in no process [-1]
<7> [512.942469] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.942533] ------------[ cut here ]------------
<4> [512.942534] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.942536] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:51/7465
<4> [512.942608] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.942673] autofs4 [last unloaded: snd_hda_intel]
<4> [512.942677] CPU: 10 UID: 0 PID: 7465 Comm: kworker/u64:51 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.942680] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.942682] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.942683] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.942688] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.942759] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.942760] RSP: 0018:ffffc90002f5bca0 EFLAGS: 00010246
<4> [512.942762] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.942764] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.942765] RBP: ffffc90002f5bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.942766] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.942768] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.942769] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [512.942771] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.942772] CR2: 00007b3f4f873000 CR3: 000000018d103002 CR4: 0000000000f72ef0
<4> [512.942773] PKRU: 55555554
<4> [512.942775] Call Trace:
<4> [512.942776] <TASK>
<4> [512.942779] ? lock_sync+0x100/0x100
<4> [512.942784] ? lock_release+0xd0/0x2b0
<4> [512.942789] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.942795] process_one_work+0x239/0x760
<4> [512.942801] worker_thread+0x200/0x3f0
<4> [512.942804] ? __pfx_worker_thread+0x10/0x10
<4> [512.942806] kthread+0x10d/0x150
<4> [512.942809] ? __pfx_kthread+0x10/0x10
<4> [512.942813] ret_from_fork+0x3d4/0x480
<4> [512.942815] ? __pfx_kthread+0x10/0x10
<4> [512.942818] ret_from_fork_asm+0x1a/0x30
<4> [512.942825] </TASK>
<4> [512.942826] irq event stamp: 461535
<4> [512.942828] hardirqs last enabled at (461541): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.942830] hardirqs last disabled at (461546): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.942833] softirqs last enabled at (460758): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.942835] softirqs last disabled at (460747): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.942837] ---[ end trace 0000000000000000 ]---
<6> [512.942839] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.942909] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.942915] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.943367] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.943573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.943679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.943774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.943864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.943953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.944041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.944128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.944216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.944298] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.944395] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.944520] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.945579] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.955468] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.955718] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.956770] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.956850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.956927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.957006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.957082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.957158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.957235] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.957312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.957388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.957472] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.957566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.957645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.957723] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.957798] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.957873] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.957947] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.958021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.958095] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.958170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.958250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.958333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.958413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.958507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.958600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.958679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.958756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.958832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.958912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.958992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.959070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.959149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.959227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.959311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.959401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.959496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.959604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.959686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.959768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.959850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.959931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.960013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.960092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.960170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.960247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.960330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.960408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.960500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.960592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.960671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.960748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.960824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.960908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.960990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.961071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.961149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.961229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.961306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.961383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.961469] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.961609] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.961614] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19162, lrc_seqno=19162, guc_id=0, flags=0x73 in no process [-1]
<7> [512.961616] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.961675] ------------[ cut here ]------------
<4> [512.961676] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.961677] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:51/7465
<4> [512.961748] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.961813] autofs4 [last unloaded: snd_hda_intel]
<4> [512.961817] CPU: 10 UID: 0 PID: 7465 Comm: kworker/u64:51 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.961820] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.961822] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.961823] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.961829] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.961900] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.961901] RSP: 0018:ffffc90002f5bca0 EFLAGS: 00010246
<4> [512.961904] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.961906] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.961907] RBP: ffffc90002f5bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.961908] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.961910] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.961911] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [512.961913] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.961914] CR2: 00007b3f4f873000 CR3: 000000018d103002 CR4: 0000000000f72ef0
<4> [512.961916] PKRU: 55555554
<4> [512.961917] Call Trace:
<4> [512.961918] <TASK>
<4> [512.961922] ? lock_sync+0x100/0x100
<4> [512.961926] ? lock_release+0xd0/0x2b0
<4> [512.961931] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.961937] process_one_work+0x239/0x760
<4> [512.961943] worker_thread+0x200/0x3f0
<4> [512.961946] ? __pfx_worker_thread+0x10/0x10
<4> [512.961948] kthread+0x10d/0x150
<4> [512.961951] ? __pfx_kthread+0x10/0x10
<4> [512.961955] ret_from_fork+0x3d4/0x480
<4> [512.961957] ? __pfx_kthread+0x10/0x10
<4> [512.961960] ret_from_fork_asm+0x1a/0x30
<4> [512.961968] </TASK>
<4> [512.961969] irq event stamp: 464939
<4> [512.961970] hardirqs last enabled at (464945): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.961973] hardirqs last disabled at (464950): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.961975] softirqs last enabled at (464010): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.961977] softirqs last disabled at (464003): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.961980] ---[ end trace 0000000000000000 ]---
<6> [512.961981] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.962053] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.962059] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.963306] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [512.963415] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [512.963534] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.963746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.963839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.963934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.964026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.964118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.964205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.964292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.964380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.964469] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.964566] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.964684] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.965692] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.976414] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.976674] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.977716] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [512.977797] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [512.977873] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [512.977950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [512.978026] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [512.978103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [512.978178] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [512.978254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [512.978330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [512.978406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [512.978485] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [512.978560] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [512.978636] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [512.978713] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [512.978789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [512.978865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [512.978941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [512.979015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [512.979089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [512.979171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [512.979252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [512.979332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [512.979416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [512.979503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [512.979580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [512.979660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [512.979736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [512.979815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [512.979894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [512.979972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [512.980050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [512.980128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [512.980210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [512.980298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [512.980385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [512.980471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [512.980551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [512.980630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [512.980708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [512.980785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [512.980866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [512.980947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [512.981028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [512.981107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [512.981188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [512.981266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [512.981343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [512.981419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [512.981508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [512.981588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [512.981668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [512.981750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [512.981830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [512.981909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [512.981986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [512.982064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [512.982140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [512.982219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [512.982302] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [512.982418] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [512.982423] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19162, lrc_seqno=19162, guc_id=0, flags=0x73 in no process [-1]
<7> [512.982425] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.982496] ------------[ cut here ]------------
<4> [512.982498] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [512.982500] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:13/2711
<4> [512.982572] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.982639] autofs4 [last unloaded: snd_hda_intel]
<4> [512.982644] CPU: 2 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.982647] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.982648] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.982650] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.982655] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.982725] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.982726] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [512.982729] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.982730] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.982731] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.982733] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.982734] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.982735] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [512.982737] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.982738] CR2: 00005f51429361e8 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [512.982740] PKRU: 55555554
<4> [512.982741] Call Trace:
<4> [512.982742] <TASK>
<4> [512.982746] ? lock_sync+0x100/0x100
<4> [512.982751] ? lock_release+0xd0/0x2b0
<4> [512.982756] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.982762] process_one_work+0x239/0x760
<4> [512.982768] worker_thread+0x200/0x3f0
<4> [512.982771] ? __pfx_worker_thread+0x10/0x10
<4> [512.982773] kthread+0x10d/0x150
<4> [512.982776] ? __pfx_kthread+0x10/0x10
<4> [512.982780] ret_from_fork+0x3d4/0x480
<4> [512.982782] ? __pfx_kthread+0x10/0x10
<4> [512.982786] ret_from_fork_asm+0x1a/0x30
<4> [512.982793] </TASK>
<4> [512.982794] irq event stamp: 1641725
<4> [512.982796] hardirqs last enabled at (1641731): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.982799] hardirqs last disabled at (1641736): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.982801] softirqs last enabled at (1640620): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.982803] softirqs last disabled at (1640615): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.982806] ---[ end trace 0000000000000000 ]---
<7> [512.983862] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [512.983968] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [512.984805] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19163, lrc_seqno=19163, guc_id=0, flags=0x73 in no process [-1]
<7> [512.984810] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [512.984878] ------------[ cut here ]------------
<4> [512.984879] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<7> [512.984891] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:571]
<4> [512.984881] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:13/2711
<4> [512.984957] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [512.985023] autofs4 [last unloaded: snd_hda_intel]
<4> [512.985028] CPU: 8 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [512.985031] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [512.985032] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [512.985033] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [512.985039] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [512.985112] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [512.985114] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [512.985116] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [512.985118] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [512.985120] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [512.985122] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [512.985124] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [512.985127] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [512.985130] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [512.985132] CR2: 00007b3f4f873000 CR3: 000000018d103003 CR4: 0000000000f72ef0
<4> [512.985135] PKRU: 55555554
<4> [512.985137] Call Trace:
<4> [512.985139] <TASK>
<4> [512.985147] ? lock_sync+0x100/0x100
<4> [512.985155] ? lock_release+0xd0/0x2b0
<4> [512.985164] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [512.985174] process_one_work+0x239/0x760
<4> [512.985186] worker_thread+0x200/0x3f0
<4> [512.985191] ? __pfx_worker_thread+0x10/0x10
<4> [512.985195] kthread+0x10d/0x150
<4> [512.985199] ? __pfx_kthread+0x10/0x10
<4> [512.985205] ret_from_fork+0x3d4/0x480
<4> [512.985209] ? __pfx_kthread+0x10/0x10
<4> [512.985214] ret_from_fork_asm+0x1a/0x30
<4> [512.985228] </TASK>
<4> [512.985230] irq event stamp: 1642689
<4> [512.985232] hardirqs last enabled at (1642695): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [512.985236] hardirqs last disabled at (1642700): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [512.985240] softirqs last enabled at (1640620): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.985244] softirqs last disabled at (1640615): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [512.985247] ---[ end trace 0000000000000000 ]---
<6> [512.985250] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [512.985371] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [512.985382] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [512.985573] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [512.985880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [512.986020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [512.986152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [512.986266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [512.986364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [512.986466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [512.986555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [512.986642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [512.986728] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [512.986837] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [512.986970] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [512.988183] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [512.998470] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [512.998783] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [512.999978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [513.000102] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [513.000223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [513.000346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [513.000491] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [513.000613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [513.000735] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [513.000856] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [513.000977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [513.001097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [513.001219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [513.001340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [513.001476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [513.001563] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [513.001643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [513.001720] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [513.001797] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [513.001872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [513.001947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [513.002031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [513.002115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [513.002199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [513.002282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [513.002362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [513.002442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [513.002532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [513.002612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [513.002693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [513.002773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [513.002853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [513.002935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [513.003020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [513.003109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [513.003197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [513.003283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [513.003370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [513.003455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [513.003550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [513.003631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [513.003709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [513.003789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [513.003872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [513.003954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [513.004033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [513.004116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [513.004194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [513.004273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [513.004351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [513.004429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [513.004513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [513.004590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [513.004669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [513.004747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [513.004826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [513.004901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [513.004980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [513.005061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [513.005141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [513.005223] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [513.005338] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [513.005342] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19163, lrc_seqno=19163, guc_id=0, flags=0x73 in no process [-1]
<7> [513.005345] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [513.005404] ------------[ cut here ]------------
<4> [513.005406] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [513.005407] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:13/2711
<4> [513.005484] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [513.005561] autofs4 [last unloaded: snd_hda_intel]
<4> [513.005565] CPU: 2 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [513.005569] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [513.005570] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [513.005572] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [513.005578] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [513.005648] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [513.005650] RSP: 0000:ffffc90003f43ca0 EFLAGS: 00010246
<4> [513.005653] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [513.005654] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [513.005655] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [513.005657] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [513.005658] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [513.005659] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [513.005661] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [513.005662] CR2: 00007b3f4f873000 CR3: 000000018d103001 CR4: 0000000000f72ef0
<4> [513.005664] PKRU: 55555554
<4> [513.005665] Call Trace:
<4> [513.005666] <TASK>
<4> [513.005670] ? lock_sync+0x100/0x100
<4> [513.005675] ? lock_release+0xd0/0x2b0
<4> [513.005680] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [513.005686] process_one_work+0x239/0x760
<4> [513.005692] worker_thread+0x200/0x3f0
<4> [513.005695] ? __pfx_worker_thread+0x10/0x10
<4> [513.005697] kthread+0x10d/0x150
<4> [513.005700] ? __pfx_kthread+0x10/0x10
<4> [513.005704] ret_from_fork+0x3d4/0x480
<4> [513.005706] ? __pfx_kthread+0x10/0x10
<4> [513.005709] ret_from_fork_asm+0x1a/0x30
<4> [513.005717] </TASK>
<4> [513.005718] irq event stamp: 1645827
<4> [513.005720] hardirqs last enabled at (1645833): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [513.005723] hardirqs last disabled at (1645838): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [513.005725] softirqs last enabled at (1644734): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.005728] softirqs last disabled at (1644727): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.005730] ---[ end trace 0000000000000000 ]---
<6> [513.006666] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [513.006737] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [513.006744] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [513.006800] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [513.006901] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [513.007597] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [513.007807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [513.007898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [513.007993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [513.008082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [513.008171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [513.008260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [513.008348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [513.008438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [513.008529] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [513.008625] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [513.008742] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [513.009749] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [513.020475] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [513.020728] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [513.021785] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [513.021864] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [513.021940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [513.022017] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [513.022093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [513.022170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [513.022245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [513.022321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [513.022397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [513.022476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [513.022550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [513.022626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [513.022701] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [513.022775] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [513.022851] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [513.022926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [513.023003] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [513.023078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [513.023152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [513.023233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [513.023315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [513.023393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [513.023479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [513.023560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [513.023639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [513.023717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [513.023794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [513.023873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [513.023953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [513.024030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [513.024109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [513.024188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [513.024273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [513.024360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [513.024448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [513.024548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [513.024630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [513.024710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [513.024788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [513.024864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [513.024944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [513.025026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [513.025108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [513.025189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [513.025272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [513.025352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [513.025431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [513.025519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [513.025598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [513.025675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [513.025754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [513.025835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [513.025912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [513.025990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [513.026067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [513.026150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [513.026230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [513.026308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [513.026389] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [513.026505] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [513.026509] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19163, lrc_seqno=19163, guc_id=0, flags=0x73 in no process [-1]
<7> [513.026512] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [513.026570] ------------[ cut here ]------------
<4> [513.026571] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [513.026573] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:13/2711
<4> [513.026645] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [513.026710] autofs4 [last unloaded: snd_hda_intel]
<4> [513.026714] CPU: 2 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [513.026717] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [513.026718] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [513.026720] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [513.026725] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [513.026795] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [513.026796] RSP: 0000:ffffc90003f43ca0 EFLAGS: 00010246
<4> [513.026799] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [513.026800] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [513.026801] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [513.026803] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [513.026804] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [513.026805] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [513.026807] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [513.026808] CR2: 00007b3f4f873000 CR3: 000000018d103001 CR4: 0000000000f72ef0
<4> [513.026810] PKRU: 55555554
<4> [513.026811] Call Trace:
<4> [513.026812] <TASK>
<4> [513.026816] ? lock_sync+0x100/0x100
<4> [513.026821] ? lock_release+0xd0/0x2b0
<4> [513.026826] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [513.026832] process_one_work+0x239/0x760
<4> [513.026838] worker_thread+0x200/0x3f0
<4> [513.026841] ? __pfx_worker_thread+0x10/0x10
<4> [513.026843] kthread+0x10d/0x150
<4> [513.026846] ? __pfx_kthread+0x10/0x10
<4> [513.026850] ret_from_fork+0x3d4/0x480
<4> [513.026852] ? __pfx_kthread+0x10/0x10
<4> [513.026856] ret_from_fork_asm+0x1a/0x30
<4> [513.026863] </TASK>
<4> [513.026864] irq event stamp: 1648951
<4> [513.026865] hardirqs last enabled at (1648957): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [513.026868] hardirqs last disabled at (1648962): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [513.026871] softirqs last enabled at (1648028): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.026873] softirqs last disabled at (1648021): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.026875] ---[ end trace 0000000000000000 ]---
<7> [513.027929] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [513.028038] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [513.031026] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19172, lrc_seqno=19172, guc_id=0, flags=0x73 in no process [-1]
<7> [513.031029] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [513.031090] ------------[ cut here ]------------
<4> [513.031091] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [513.031092] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:13/2711
<4> [513.031163] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [513.031228] autofs4 [last unloaded: snd_hda_intel]
<4> [513.031232] CPU: 2 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [513.031235] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [513.031236] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [513.031238] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [513.031242] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [513.031311] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [513.031313] RSP: 0000:ffffc90003f43ca0 EFLAGS: 00010246
<4> [513.031315] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [513.031316] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [513.031318] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [513.031319] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [513.031320] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [513.031321] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [513.031323] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [513.031324] CR2: 00007b3f4f873000 CR3: 000000018d103001 CR4: 0000000000f72ef0
<4> [513.031325] PKRU: 55555554
<4> [513.031327] Call Trace:
<4> [513.031328] <TASK>
<4> [513.031331] ? lock_sync+0x100/0x100
<4> [513.031336] ? lock_release+0xd0/0x2b0
<4> [513.031341] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [513.031347] process_one_work+0x239/0x760
<4> [513.031353] worker_thread+0x200/0x3f0
<4> [513.031356] ? __pfx_worker_thread+0x10/0x10
<4> [513.031358] kthread+0x10d/0x150
<4> [513.031361] ? __pfx_kthread+0x10/0x10
<4> [513.031364] ret_from_fork+0x3d4/0x480
<4> [513.031366] ? __pfx_kthread+0x10/0x10
<4> [513.031370] ret_from_fork_asm+0x1a/0x30
<4> [513.031377] </TASK>
<4> [513.031378] irq event stamp: 1650123
<4> [513.031379] hardirqs last enabled at (1650129): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [513.031382] hardirqs last disabled at (1650134): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [513.031384] softirqs last enabled at (1648028): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.031387] softirqs last disabled at (1648021): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.031389] ---[ end trace 0000000000000000 ]---
<6> [513.031391] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [513.031465] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [513.031472] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [513.031751] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [513.031954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [513.032044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [513.032137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [513.032226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [513.032315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [513.032400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [513.032492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [513.032581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [513.032665] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [513.032758] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [513.032875] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [513.033894] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [513.044467] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [513.044721] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [513.045746] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [513.045839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [513.045927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [513.046005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [513.046083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [513.046160] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [513.046237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [513.046314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [513.046392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [513.046476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [513.046554] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [513.046631] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [513.046707] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [513.046782] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [513.046857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [513.046932] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [513.047006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [513.047081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [513.047154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [513.047236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [513.047319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [513.047399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [513.047485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [513.047565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [513.047645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [513.047726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [513.047807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [513.047889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [513.047972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [513.048052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [513.048132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [513.048212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [513.048301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [513.048389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [513.048482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [513.048565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [513.048647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [513.048725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [513.048803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [513.048882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [513.048965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [513.049046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [513.049126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [513.049205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [513.049286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [513.049364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [513.049443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [513.049534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [513.049618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [513.049697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [513.049775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [513.049856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [513.049935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [513.050013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [513.050089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [513.050166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [513.050240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [513.050315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [513.050394] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [513.050513] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [513.050517] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19172, lrc_seqno=19172, guc_id=0, flags=0x73 in no process [-1]
<7> [513.050520] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [513.050579] ------------[ cut here ]------------
<4> [513.050580] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [513.050582] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:13/2711
<4> [513.050654] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [513.050722] autofs4 [last unloaded: snd_hda_intel]
<4> [513.050726] CPU: 2 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [513.050730] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [513.050731] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [513.050733] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [513.050738] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [513.050808] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [513.050810] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [513.050812] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [513.050814] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [513.050815] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [513.050816] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [513.050817] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [513.050819] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [513.050820] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [513.050822] CR2: 00007b3f4f873000 CR3: 000000012db16002 CR4: 0000000000f72ef0
<4> [513.050823] PKRU: 55555554
<4> [513.050824] Call Trace:
<4> [513.050825] <TASK>
<4> [513.050829] ? lock_sync+0x100/0x100
<4> [513.050834] ? lock_release+0xd0/0x2b0
<4> [513.050839] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [513.050845] process_one_work+0x239/0x760
<4> [513.050851] worker_thread+0x200/0x3f0
<4> [513.050854] ? __pfx_worker_thread+0x10/0x10
<4> [513.050856] kthread+0x10d/0x150
<4> [513.050859] ? __pfx_kthread+0x10/0x10
<4> [513.050863] ret_from_fork+0x3d4/0x480
<4> [513.050865] ? __pfx_kthread+0x10/0x10
<4> [513.050868] ret_from_fork_asm+0x1a/0x30
<4> [513.050876] </TASK>
<4> [513.050877] irq event stamp: 1653231
<4> [513.050878] hardirqs last enabled at (1653237): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [513.050881] hardirqs last disabled at (1653242): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [513.050883] softirqs last enabled at (1652210): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.050886] softirqs last disabled at (1652205): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.050888] ---[ end trace 0000000000000000 ]---
<6> [513.050889] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [513.050959] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [513.050966] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [513.051374] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [513.051576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [513.051666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [513.051758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [513.051846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [513.051935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [513.052023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [513.052110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [513.052198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [513.052283] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [513.052380] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [513.052511] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [513.053567] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [513.063467] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [513.063719] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [513.064736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [513.064829] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [513.064907] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [513.064986] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [513.065063] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [513.065141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [513.065218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [513.065297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [513.065375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [513.065452] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [513.065545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [513.065621] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [513.065695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [513.065769] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [513.065844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [513.065921] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [513.066001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [513.066078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [513.066153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [513.066238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [513.066322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [513.066402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [513.066494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [513.066576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [513.066657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [513.066737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [513.066815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [513.066896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [513.066980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [513.067066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [513.067151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [513.067235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [513.067322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [513.067408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [513.067503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [513.067586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [513.067672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [513.067756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [513.067836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [513.067915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [513.067997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [513.068077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [513.068156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [513.068235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [513.068316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [513.068398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [513.068487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [513.068567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [513.068648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [513.068726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [513.068805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [513.068889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [513.068972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [513.069053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [513.069131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [513.069211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [513.069288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [513.069366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [513.069446] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [513.069577] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [513.069582] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19172, lrc_seqno=19172, guc_id=0, flags=0x73 in no process [-1]
<7> [513.069585] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [513.069644] ------------[ cut here ]------------
<4> [513.069646] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [513.069648] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:13/2711
<4> [513.069720] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [513.069785] autofs4 [last unloaded: snd_hda_intel]
<4> [513.069789] CPU: 2 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [513.069792] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [513.069793] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [513.069795] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [513.069800] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [513.069869] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [513.069871] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [513.069873] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [513.069874] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [513.069876] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [513.069877] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [513.069878] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [513.069880] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [513.069881] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [513.069882] CR2: 00007b3f4f873000 CR3: 000000012db16002 CR4: 0000000000f72ef0
<4> [513.069884] PKRU: 55555554
<4> [513.069885] Call Trace:
<4> [513.069886] <TASK>
<4> [513.069890] ? lock_sync+0x100/0x100
<4> [513.069895] ? lock_release+0xd0/0x2b0
<4> [513.069900] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [513.069906] process_one_work+0x239/0x760
<4> [513.069912] worker_thread+0x200/0x3f0
<4> [513.069915] ? __pfx_worker_thread+0x10/0x10
<4> [513.069917] kthread+0x10d/0x150
<4> [513.069920] ? __pfx_kthread+0x10/0x10
<4> [513.069923] ret_from_fork+0x3d4/0x480
<4> [513.069925] ? __pfx_kthread+0x10/0x10
<4> [513.069929] ret_from_fork_asm+0x1a/0x30
<4> [513.069936] </TASK>
<4> [513.069937] irq event stamp: 1656391
<4> [513.069938] hardirqs last enabled at (1656397): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [513.069941] hardirqs last disabled at (1656402): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [513.069943] softirqs last enabled at (1655370): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.069946] softirqs last disabled at (1655361): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.069948] ---[ end trace 0000000000000000 ]---
<7> [513.070979] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [513.071089] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [513.073754] xe 0000:03:00.0: [drm:drm_mode_rmfb_work_fn] Removing [FB:570] from all active usage due to RMFB ioctl
<5> [513.124662] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19173, lrc_seqno=19173, guc_id=0, flags=0x73 in no process [-1]
<7> [513.124687] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [513.125051] ------------[ cut here ]------------
<4> [513.125059] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<7> [513.125061] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:570]
<4> [513.125067] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:57/7471
<4> [513.125529] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [513.126149] autofs4 [last unloaded: snd_hda_intel]
<4> [513.126183] CPU: 8 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [513.126206] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [513.126217] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [513.126229] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [513.126270] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [513.126954] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [513.126971] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [513.126991] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [513.127004] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [513.127015] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [513.127027] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [513.127038] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [513.127050] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [513.127063] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [513.127076] CR2: 00007b3f4f873000 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [513.127089] PKRU: 55555554
<4> [513.127100] Call Trace:
<4> [513.127110] <TASK>
<4> [513.127146] ? lock_sync+0x100/0x100
<4> [513.127186] ? lock_release+0xd0/0x2b0
<4> [513.127234] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [513.127284] process_one_work+0x239/0x760
<4> [513.127340] worker_thread+0x200/0x3f0
<4> [513.127365] ? __pfx_worker_thread+0x10/0x10
<4> [513.127386] kthread+0x10d/0x150
<4> [513.127407] ? __pfx_kthread+0x10/0x10
<4> [513.127437] ret_from_fork+0x3d4/0x480
<4> [513.127453] ? __pfx_kthread+0x10/0x10
<4> [513.127511] ret_from_fork_asm+0x1a/0x30
<4> [513.127577] </TASK>
<4> [513.127588] irq event stamp: 454485
<4> [513.127598] hardirqs last enabled at (454491): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [513.127620] hardirqs last disabled at (454496): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [513.127639] softirqs last enabled at (453738): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.127658] softirqs last disabled at (453731): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.127676] ---[ end trace 0000000000000000 ]---
<6> [513.127691] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [513.128487] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [513.128539] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [513.128700] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [513.129751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [513.130513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [513.131000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [513.131441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [513.132030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [513.132949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [513.133591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [513.134149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [513.134720] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [513.135298] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [513.135920] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [513.137621] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [513.148560] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [513.148845] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [513.151137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [513.151343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [513.151552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [513.151750] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [513.151950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [513.152148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [513.152336] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [513.152534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [513.152718] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [513.152898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [513.153078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [513.153245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [513.153410] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [513.153598] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [513.153703] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [513.153800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [513.153893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [513.153984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [513.154074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [513.154169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [513.154263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [513.154353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [513.154442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [513.154546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [513.154632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [513.154715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [513.154800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [513.154885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [513.154969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [513.155052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [513.155135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [513.155218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [513.155304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [513.155390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [513.155480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [513.155561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [513.155641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [513.155717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [513.155799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [513.155881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [513.155964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [513.156044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [513.156124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [513.156202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [513.156284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [513.156366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [513.156448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [513.156541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [513.156624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [513.156703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [513.156781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [513.156863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [513.156942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [513.157021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [513.157099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [513.157179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [513.157259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [513.157339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [513.157422] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [513.157551] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [513.157556] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19173, lrc_seqno=19173, guc_id=0, flags=0x73 in no process [-1]
<7> [513.157559] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [513.157617] ------------[ cut here ]------------
<4> [513.157618] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [513.157620] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:57/7471
<4> [513.157692] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [513.157765] autofs4 [last unloaded: snd_hda_intel]
<4> [513.157770] CPU: 4 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [513.157773] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [513.157774] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [513.157776] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [513.157782] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [513.157852] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [513.157854] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [513.157857] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [513.157858] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [513.157860] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [513.157861] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [513.157863] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [513.157864] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [513.157866] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [513.157868] CR2: 0000737de22cb2b0 CR3: 000000012db16002 CR4: 0000000000f72ef0
<4> [513.157869] PKRU: 55555554
<4> [513.157871] Call Trace:
<4> [513.157872] <TASK>
<4> [513.157876] ? lock_sync+0x100/0x100
<4> [513.157881] ? lock_release+0xd0/0x2b0
<4> [513.157887] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [513.157893] process_one_work+0x239/0x760
<4> [513.157899] worker_thread+0x200/0x3f0
<4> [513.157902] ? __pfx_worker_thread+0x10/0x10
<4> [513.157904] kthread+0x10d/0x150
<4> [513.157907] ? __pfx_kthread+0x10/0x10
<4> [513.157911] ret_from_fork+0x3d4/0x480
<4> [513.157913] ? __pfx_kthread+0x10/0x10
<4> [513.157917] ret_from_fork_asm+0x1a/0x30
<4> [513.157924] </TASK>
<4> [513.157925] irq event stamp: 457707
<4> [513.157927] hardirqs last enabled at (457713): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [513.157929] hardirqs last disabled at (457718): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [513.157932] softirqs last enabled at (456864): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.157934] softirqs last disabled at (456859): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.157937] ---[ end trace 0000000000000000 ]---
<6> [513.157939] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [513.158010] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [513.158017] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [513.158425] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [513.158643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [513.158735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [513.158829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [513.158916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [513.159003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [513.159090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [513.159176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [513.159264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [513.159352] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [513.159448] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [513.159583] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [513.160591] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [513.171314] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [513.171563] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [513.172666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [513.172740] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [513.172810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [513.172881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [513.172952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [513.173020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [513.173089] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [513.173158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [513.173227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [513.173295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [513.173365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [513.173435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [513.173518] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [513.173594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [513.173669] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [513.173743] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [513.173817] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [513.173891] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [513.173964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [513.174045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [513.174127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [513.174209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [513.174290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [513.174369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [513.174447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [513.174538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [513.174620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [513.174703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [513.174785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [513.174865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [513.174944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [513.175024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [513.175109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [513.175194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [513.175280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [513.175361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [513.175441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [513.175528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [513.175610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [513.175691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [513.175773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [513.175853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [513.175931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [513.176008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [513.176088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [513.176166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [513.176243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [513.176319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [513.176397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [513.176479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [513.176560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [513.176640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [513.176720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [513.176798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [513.176875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [513.176955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [513.177030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [513.177105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [513.177183] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [513.177299] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [513.177303] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19173, lrc_seqno=19173, guc_id=0, flags=0x73 in no process [-1]
<7> [513.177306] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [513.177364] ------------[ cut here ]------------
<4> [513.177365] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [513.177366] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:57/7471
<4> [513.177438] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [513.177507] autofs4 [last unloaded: snd_hda_intel]
<4> [513.177511] CPU: 4 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [513.177514] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [513.177515] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [513.177516] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [513.177521] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [513.177590] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [513.177592] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [513.177594] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [513.177595] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [513.177597] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [513.177598] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [513.177599] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [513.177601] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [513.177602] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [513.177604] CR2: 0000737de22cb2b0 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [513.177605] PKRU: 55555554
<4> [513.177606] Call Trace:
<4> [513.177607] <TASK>
<4> [513.177611] ? lock_sync+0x100/0x100
<4> [513.177615] ? lock_release+0xd0/0x2b0
<4> [513.177621] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [513.177627] process_one_work+0x239/0x760
<4> [513.177633] worker_thread+0x200/0x3f0
<4> [513.177636] ? __pfx_worker_thread+0x10/0x10
<4> [513.177638] kthread+0x10d/0x150
<4> [513.177641] ? __pfx_kthread+0x10/0x10
<4> [513.177644] ret_from_fork+0x3d4/0x480
<4> [513.177646] ? __pfx_kthread+0x10/0x10
<4> [513.177650] ret_from_fork_asm+0x1a/0x30
<4> [513.177657] </TASK>
<4> [513.177658] irq event stamp: 460873
<4> [513.177659] hardirqs last enabled at (460879): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [513.177662] hardirqs last disabled at (460884): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [513.177664] softirqs last enabled at (459878): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.177667] softirqs last disabled at (459871): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.177669] ---[ end trace 0000000000000000 ]---
<7> [513.178696] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [513.178800] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [513.182564] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19182, lrc_seqno=19182, guc_id=0, flags=0x73 in no process [-1]
<7> [513.182567] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [513.182629] ------------[ cut here ]------------
<4> [513.182630] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [513.182632] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:57/7471
<4> [513.182703] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [513.182766] autofs4 [last unloaded: snd_hda_intel]
<4> [513.182770] CPU: 4 UID: 0 PID: 7471 Comm: kworker/u64:57 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [513.182773] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [513.182774] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [513.182775] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [513.182780] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [513.182849] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [513.182851] RSP: 0018:ffffc90002f8bca0 EFLAGS: 00010246
<4> [513.182853] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [513.182855] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [513.182856] RBP: ffffc90002f8bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [513.182857] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [513.182858] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [513.182859] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [513.182861] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [513.182862] CR2: 0000737de22cb2b0 CR3: 000000012db16002 CR4: 0000000000f72ef0
<4> [513.182864] PKRU: 55555554
<4> [513.182865] Call Trace:
<4> [513.182866] <TASK>
<4> [513.182870] ? lock_sync+0x100/0x100
<4> [513.182874] ? lock_release+0xd0/0x2b0
<4> [513.182879] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [513.182885] process_one_work+0x239/0x760
<4> [513.182891] worker_thread+0x200/0x3f0
<4> [513.182894] ? __pfx_worker_thread+0x10/0x10
<4> [513.182896] kthread+0x10d/0x150
<4> [513.182899] ? __pfx_kthread+0x10/0x10
<4> [513.182903] ret_from_fork+0x3d4/0x480
<4> [513.182904] ? __pfx_kthread+0x10/0x10
<4> [513.182908] ret_from_fork_asm+0x1a/0x30
<4> [513.182915] </TASK>
<4> [513.182916] irq event stamp: 461919
<4> [513.182917] hardirqs last enabled at (461925): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [513.182920] hardirqs last disabled at (461930): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [513.182922] softirqs last enabled at (459878): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.182925] softirqs last disabled at (459871): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.182927] ---[ end trace 0000000000000000 ]---
<6> [513.182929] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [513.182998] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [513.183004] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [513.183285] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [513.183503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [513.183662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [513.183805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [513.183929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [513.184056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [513.184185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [513.184315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [513.184439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [513.184553] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [513.184650] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [513.184769] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [513.185823] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [513.196468] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [513.196719] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [513.197800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [513.197908] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [513.197988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [513.198067] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [513.198144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [513.198233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [513.198346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [513.198469] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [513.198581] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [513.198693] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [513.198808] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [513.198910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [513.198988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [513.199066] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [513.199144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [513.199232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [513.199344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [513.199454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [513.199607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [513.199729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [513.199851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [513.199971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [513.200067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [513.200148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [513.200228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [513.200308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [513.200396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [513.200542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [513.200662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [513.200779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [513.200897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [513.201018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [513.201120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [513.201207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [513.201297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [513.201382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [513.201513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [513.201632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [513.201750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [513.201863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [513.201987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [513.202099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [513.202181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [513.202261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [513.202344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [513.202444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [513.202612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [513.202699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [513.202784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [513.202866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [513.202948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [513.203029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [513.203109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [513.203187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [513.203265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [513.203343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [513.203419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [513.203506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [513.203591] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [513.203709] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [513.203713] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19182, lrc_seqno=19182, guc_id=0, flags=0x73 in no process [-1]
<7> [513.203716] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [513.203774] ------------[ cut here ]------------
<4> [513.203775] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [513.203777] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:13/2711
<4> [513.203848] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [513.203911] autofs4 [last unloaded: snd_hda_intel]
<4> [513.203915] CPU: 4 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [513.203918] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [513.203919] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [513.203920] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [513.203925] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [513.203994] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [513.203995] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [513.203997] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [513.203999] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [513.204000] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [513.204001] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [513.204002] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [513.204004] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [513.204005] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [513.204007] CR2: 0000737de22cb2b0 CR3: 000000012db16002 CR4: 0000000000f72ef0
<4> [513.204008] PKRU: 55555554
<4> [513.204009] Call Trace:
<4> [513.204010] <TASK>
<4> [513.204014] ? lock_sync+0x100/0x100
<4> [513.204018] ? lock_release+0xd0/0x2b0
<4> [513.204024] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [513.204030] process_one_work+0x239/0x760
<4> [513.204036] worker_thread+0x200/0x3f0
<4> [513.204039] ? __pfx_worker_thread+0x10/0x10
<4> [513.204042] kthread+0x10d/0x150
<4> [513.204045] ? __pfx_kthread+0x10/0x10
<4> [513.204049] ret_from_fork+0x3d4/0x480
<4> [513.204051] ? __pfx_kthread+0x10/0x10
<4> [513.204054] ret_from_fork_asm+0x1a/0x30
<4> [513.204062] </TASK>
<4> [513.204063] irq event stamp: 1660287
<4> [513.204064] hardirqs last enabled at (1660293): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [513.204067] hardirqs last disabled at (1660298): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [513.204070] softirqs last enabled at (1659200): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.204073] softirqs last disabled at (1659193): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.204075] ---[ end trace 0000000000000000 ]---
<6> [513.204077] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [513.204146] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [513.204152] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [513.205472] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [513.205579] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [513.205688] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [513.205895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [513.205985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [513.206079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [513.206172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [513.206262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [513.206350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [513.206437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [513.206538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [513.206621] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [513.206716] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [513.206834] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [513.207844] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [513.218467] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [513.218718] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [513.219801] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [513.219880] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [513.219956] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [513.220033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [513.220112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [513.220189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [513.220268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [513.220348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [513.220426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [513.220514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [513.220591] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [513.220666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [513.220741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [513.220816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [513.220891] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [513.220966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [513.221040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [513.221115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [513.221189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [513.221274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [513.221358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [513.221438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [513.221526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [513.221604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [513.221682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [513.221760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [513.221838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [513.221918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [513.221999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [513.222077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [513.222158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [513.222239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [513.222325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [513.222410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [513.222502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [513.222584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [513.222664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [513.222741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [513.222818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [513.222894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [513.222974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [513.223051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [513.223128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [513.223208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [513.223293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [513.223371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [513.223450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [513.223540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [513.223619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [513.223695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [513.223771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [513.223851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [513.223927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [513.224004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [513.224081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [513.224163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [513.224242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [513.224320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [513.224401] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [513.224524] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [513.224529] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19182, lrc_seqno=19182, guc_id=0, flags=0x73 in no process [-1]
<7> [513.224532] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [513.224590] ------------[ cut here ]------------
<4> [513.224592] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [513.224593] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:13/2711
<4> [513.224664] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [513.224731] autofs4 [last unloaded: snd_hda_intel]
<4> [513.224735] CPU: 4 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [513.224737] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [513.224739] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [513.224740] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [513.224745] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [513.224815] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [513.224816] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [513.224819] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [513.224820] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [513.224821] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [513.224822] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [513.224824] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [513.224825] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [513.224827] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [513.224828] CR2: 0000737de22cb2b0 CR3: 000000012db16002 CR4: 0000000000f72ef0
<4> [513.224829] PKRU: 55555554
<4> [513.224831] Call Trace:
<4> [513.224832] <TASK>
<4> [513.224836] ? lock_sync+0x100/0x100
<4> [513.224840] ? lock_release+0xd0/0x2b0
<4> [513.224846] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [513.224851] process_one_work+0x239/0x760
<4> [513.224857] worker_thread+0x200/0x3f0
<4> [513.224860] ? __pfx_worker_thread+0x10/0x10
<4> [513.224863] kthread+0x10d/0x150
<4> [513.224865] ? __pfx_kthread+0x10/0x10
<4> [513.224869] ret_from_fork+0x3d4/0x480
<4> [513.224871] ? __pfx_kthread+0x10/0x10
<4> [513.224875] ret_from_fork_asm+0x1a/0x30
<4> [513.224882] </TASK>
<4> [513.224883] irq event stamp: 1663451
<4> [513.224884] hardirqs last enabled at (1663457): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [513.224887] hardirqs last disabled at (1663462): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [513.224889] softirqs last enabled at (1662340): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.224892] softirqs last disabled at (1662333): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.224894] ---[ end trace 0000000000000000 ]---
<7> [513.225932] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [513.226036] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [513.226702] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19183, lrc_seqno=19183, guc_id=0, flags=0x73 in no process [-1]
<7> [513.226707] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [513.226774] ------------[ cut here ]------------
<4> [513.226775] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<7> [513.226803] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:571]
<4> [513.226777] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:13/2711
<4> [513.226854] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [513.226922] autofs4 [last unloaded: snd_hda_intel]
<4> [513.226926] CPU: 10 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [513.226929] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [513.226930] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [513.226932] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [513.226937] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [513.227009] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [513.227010] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [513.227013] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [513.227014] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [513.227016] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [513.227017] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [513.227018] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [513.227019] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [513.227021] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [513.227022] CR2: 00007b3f4f873000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [513.227024] PKRU: 55555554
<4> [513.227025] Call Trace:
<4> [513.227026] <TASK>
<4> [513.227030] ? lock_sync+0x100/0x100
<4> [513.227035] ? lock_release+0xd0/0x2b0
<4> [513.227040] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [513.227046] process_one_work+0x239/0x760
<4> [513.227053] worker_thread+0x200/0x3f0
<4> [513.227055] ? __pfx_worker_thread+0x10/0x10
<4> [513.227058] kthread+0x10d/0x150
<4> [513.227060] ? __pfx_kthread+0x10/0x10
<4> [513.227064] ret_from_fork+0x3d4/0x480
<4> [513.227066] ? __pfx_kthread+0x10/0x10
<4> [513.227069] ret_from_fork_asm+0x1a/0x30
<4> [513.227077] </TASK>
<4> [513.227078] irq event stamp: 1664599
<4> [513.227079] hardirqs last enabled at (1664605): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [513.227082] hardirqs last disabled at (1664610): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [513.227084] softirqs last enabled at (1663542): [<ffffffff8133ac13>] kernel_fpu_end+0x53/0x70
<4> [513.227087] softirqs last disabled at (1663540): [<ffffffff8133b324>] kernel_fpu_begin_mask+0xc4/0x120
<4> [513.227089] ---[ end trace 0000000000000000 ]---
<6> [513.227091] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [513.227162] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [513.227170] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [513.227224] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [513.227493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [513.227633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [513.227783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [513.227917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [513.228053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [513.228186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [513.228320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [513.228471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [513.228572] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [513.228673] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [513.228797] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [513.229810] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [513.240466] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [513.240719] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [513.241908] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [513.241987] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [513.242065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [513.242144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [513.242222] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [513.242299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [513.242375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [513.242452] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [513.242596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [513.242671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [513.242745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [513.242819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [513.242895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [513.242970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [513.243045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [513.243119] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [513.243194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [513.243268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [513.243344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [513.243426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [513.243535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [513.243618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [513.243699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [513.243778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [513.243858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [513.243940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [513.244019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [513.244100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [513.244182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [513.244264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [513.244348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [513.244430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [513.244524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [513.244609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [513.244694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [513.244776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [513.244857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [513.244935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [513.245013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [513.245089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [513.245169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [513.245246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [513.245324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [513.245400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [513.245484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [513.245562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [513.245642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [513.245720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [513.245800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [513.245877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [513.245952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [513.246032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [513.246110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [513.246190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [513.246271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [513.246351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [513.246427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [513.246513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [513.246592] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [513.246708] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [513.246712] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19183, lrc_seqno=19183, guc_id=0, flags=0x73 in no process [-1]
<7> [513.246715] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [513.246773] ------------[ cut here ]------------
<4> [513.246774] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [513.246776] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:51/7465
<4> [513.246849] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [513.246921] autofs4 [last unloaded: snd_hda_intel]
<4> [513.246926] CPU: 6 UID: 0 PID: 7465 Comm: kworker/u64:51 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [513.246929] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [513.246931] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [513.246932] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [513.246938] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [513.247009] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [513.247011] RSP: 0018:ffffc90002f5bca0 EFLAGS: 00010246
<4> [513.247013] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [513.247015] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [513.247017] RBP: ffffc90002f5bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [513.247018] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [513.247019] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [513.247021] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [513.247023] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [513.247024] CR2: 00007b3f4f873000 CR3: 000000018d103002 CR4: 0000000000f72ef0
<4> [513.247026] PKRU: 55555554
<4> [513.247028] Call Trace:
<4> [513.247029] <TASK>
<4> [513.247033] ? lock_sync+0x100/0x100
<4> [513.247038] ? lock_release+0xd0/0x2b0
<4> [513.247044] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [513.247050] process_one_work+0x239/0x760
<4> [513.247057] worker_thread+0x200/0x3f0
<4> [513.247060] ? __pfx_worker_thread+0x10/0x10
<4> [513.247062] kthread+0x10d/0x150
<4> [513.247065] ? __pfx_kthread+0x10/0x10
<4> [513.247069] ret_from_fork+0x3d4/0x480
<4> [513.247071] ? __pfx_kthread+0x10/0x10
<4> [513.247075] ret_from_fork_asm+0x1a/0x30
<4> [513.247082] </TASK>
<4> [513.247084] irq event stamp: 470547
<4> [513.247085] hardirqs last enabled at (470553): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [513.247088] hardirqs last disabled at (470558): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [513.247091] softirqs last enabled at (469420): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.247094] softirqs last disabled at (469385): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.247096] ---[ end trace 0000000000000000 ]---
<6> [513.247098] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [513.247169] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [513.247175] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [513.248477] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [513.248584] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [513.248693] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [513.248897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [513.248985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [513.249081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [513.249170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [513.249258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [513.249344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [513.249432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [513.249536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [513.249622] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [513.249718] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [513.249834] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [513.250842] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [513.261466] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [513.261713] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [513.262741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [513.262821] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [513.262899] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [513.262976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [513.263051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [513.263126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [513.263201] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [513.263275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [513.263349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [513.263424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [513.263508] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [513.263582] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [513.263656] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [513.263729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [513.263803] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [513.263878] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [513.263951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [513.264026] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [513.264100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [513.264183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [513.264264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [513.264346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [513.264432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [513.264520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [513.264600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [513.264680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [513.264758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [513.264839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [513.264920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [513.264999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [513.265079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [513.265163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [513.265250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [513.265337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [513.265422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [513.265514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [513.265594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [513.265672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [513.265749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [513.265826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [513.265906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [513.265984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [513.266061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [513.266138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [513.266223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [513.266302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [513.266381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [513.266462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [513.266541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [513.266617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [513.266696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [513.266780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [513.266861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [513.266940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [513.267017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [513.267097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [513.267174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [513.267249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [513.267329] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [513.267442] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [513.267446] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19183, lrc_seqno=19183, guc_id=0, flags=0x73 in no process [-1]
<7> [513.267449] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [513.267529] ------------[ cut here ]------------
<4> [513.267530] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [513.267532] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:51/7465
<4> [513.267603] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [513.267667] autofs4 [last unloaded: snd_hda_intel]
<4> [513.267672] CPU: 6 UID: 0 PID: 7465 Comm: kworker/u64:51 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [513.267675] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [513.267677] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [513.267678] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [513.267684] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [513.267763] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [513.267765] RSP: 0018:ffffc90002f5bca0 EFLAGS: 00010246
<4> [513.267767] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [513.267769] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [513.267771] RBP: ffffc90002f5bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [513.267772] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [513.267773] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [513.267775] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [513.267777] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [513.267778] CR2: 00007b3f4f873000 CR3: 000000018d103002 CR4: 0000000000f72ef0
<4> [513.267780] PKRU: 55555554
<4> [513.267781] Call Trace:
<4> [513.267783] <TASK>
<4> [513.267787] ? lock_sync+0x100/0x100
<4> [513.267791] ? lock_release+0xd0/0x2b0
<4> [513.267797] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [513.267802] process_one_work+0x239/0x760
<4> [513.267809] worker_thread+0x200/0x3f0
<4> [513.267811] ? __pfx_worker_thread+0x10/0x10
<4> [513.267814] kthread+0x10d/0x150
<4> [513.267817] ? __pfx_kthread+0x10/0x10
<4> [513.267820] ret_from_fork+0x3d4/0x480
<4> [513.267822] ? __pfx_kthread+0x10/0x10
<4> [513.267826] ret_from_fork_asm+0x1a/0x30
<4> [513.267833] </TASK>
<4> [513.267834] irq event stamp: 473691
<4> [513.267835] hardirqs last enabled at (473697): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [513.267838] hardirqs last disabled at (473702): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [513.267840] softirqs last enabled at (472928): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.267843] softirqs last disabled at (472921): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.267846] ---[ end trace 0000000000000000 ]---
<7> [513.268868] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [513.268977] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [513.272751] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19192, lrc_seqno=19192, guc_id=0, flags=0x73 in no process [-1]
<7> [513.272755] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [513.272822] ------------[ cut here ]------------
<4> [513.272823] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [513.272824] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:51/7465
<4> [513.272898] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [513.272964] autofs4 [last unloaded: snd_hda_intel]
<4> [513.272968] CPU: 6 UID: 0 PID: 7465 Comm: kworker/u64:51 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [513.272971] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [513.272972] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [513.272974] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [513.272979] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [513.273050] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [513.273052] RSP: 0018:ffffc90002f5bca0 EFLAGS: 00010246
<4> [513.273054] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [513.273055] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [513.273057] RBP: ffffc90002f5bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [513.273058] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [513.273059] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [513.273061] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [513.273062] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [513.273064] CR2: 00007b3f4f873000 CR3: 000000018d103002 CR4: 0000000000f72ef0
<4> [513.273065] PKRU: 55555554
<4> [513.273066] Call Trace:
<4> [513.273067] <TASK>
<4> [513.273071] ? lock_sync+0x100/0x100
<4> [513.273076] ? lock_release+0xd0/0x2b0
<4> [513.273081] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [513.273087] process_one_work+0x239/0x760
<4> [513.273093] worker_thread+0x200/0x3f0
<4> [513.273096] ? __pfx_worker_thread+0x10/0x10
<4> [513.273098] kthread+0x10d/0x150
<4> [513.273101] ? __pfx_kthread+0x10/0x10
<4> [513.273104] ret_from_fork+0x3d4/0x480
<4> [513.273106] ? __pfx_kthread+0x10/0x10
<4> [513.273110] ret_from_fork_asm+0x1a/0x30
<4> [513.273117] </TASK>
<4> [513.273118] irq event stamp: 475081
<4> [513.273120] hardirqs last enabled at (475087): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [513.273123] hardirqs last disabled at (475092): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [513.273125] softirqs last enabled at (473980): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.273127] softirqs last disabled at (473975): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.273129] ---[ end trace 0000000000000000 ]---
<6> [513.273131] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [513.273201] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [513.273208] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [513.273492] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [513.273695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [513.273785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [513.273877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [513.273967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [513.274057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [513.274147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [513.274237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [513.274325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [513.274407] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [513.274514] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [513.274632] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [513.275640] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [513.285467] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [513.285716] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [513.286684] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [513.286765] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [513.286842] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [513.286918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [513.286994] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [513.287070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [513.287146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [513.287221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [513.287295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [513.287369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [513.287443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [513.287570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [513.287646] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [513.287721] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [513.287796] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [513.287874] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [513.287952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [513.288030] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [513.288107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [513.288190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [513.288273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [513.288354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [513.288435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [513.288524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [513.288602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [513.288681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [513.288762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [513.288846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [513.288929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [513.289009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [513.289089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [513.289169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [513.289254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [513.289338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [513.289421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [513.289512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [513.289592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [513.289668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [513.289740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [513.289810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [513.289883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [513.289955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [513.290026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [513.290095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [513.290168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [513.290238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [513.290309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [513.290379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [513.290450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [513.290530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [513.290601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [513.290674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [513.290744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [513.290815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [513.290885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [513.290956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [513.291025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [513.291094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [513.291166] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [513.291273] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [513.291277] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19192, lrc_seqno=19192, guc_id=0, flags=0x73 in no process [-1]
<7> [513.291279] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [513.291333] ------------[ cut here ]------------
<4> [513.291334] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [513.291335] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:51/7465
<4> [513.291400] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [513.291465] autofs4 [last unloaded: snd_hda_intel]
<4> [513.291470] CPU: 6 UID: 0 PID: 7465 Comm: kworker/u64:51 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [513.291473] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [513.291474] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [513.291476] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [513.291480] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [513.291545] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [513.291547] RSP: 0018:ffffc90002f5bca0 EFLAGS: 00010246
<4> [513.291549] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [513.291550] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [513.291552] RBP: ffffc90002f5bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [513.291553] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [513.291554] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [513.291556] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [513.291557] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [513.291559] CR2: 00007b3f4f873000 CR3: 000000018d103002 CR4: 0000000000f72ef0
<4> [513.291561] PKRU: 55555554
<4> [513.291562] Call Trace:
<4> [513.291563] <TASK>
<4> [513.291567] ? lock_sync+0x100/0x100
<4> [513.291571] ? lock_release+0xd0/0x2b0
<4> [513.291576] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [513.291581] process_one_work+0x239/0x760
<4> [513.291587] worker_thread+0x200/0x3f0
<4> [513.291590] ? __pfx_worker_thread+0x10/0x10
<4> [513.291592] kthread+0x10d/0x150
<4> [513.291595] ? __pfx_kthread+0x10/0x10
<4> [513.291599] ret_from_fork+0x3d4/0x480
<4> [513.291601] ? __pfx_kthread+0x10/0x10
<4> [513.291604] ret_from_fork_asm+0x1a/0x30
<4> [513.291611] </TASK>
<4> [513.291612] irq event stamp: 478431
<4> [513.291613] hardirqs last enabled at (478437): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [513.291616] hardirqs last disabled at (478442): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [513.291618] softirqs last enabled at (477326): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.291621] softirqs last disabled at (477317): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.291623] ---[ end trace 0000000000000000 ]---
<6> [513.291625] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [513.291689] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [513.291696] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [513.292707] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [513.292811] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [513.292909] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [513.293115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [513.293199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [513.293288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [513.293370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [513.293450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [513.293553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [513.293636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [513.293718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [513.293796] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [513.293892] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [513.294036] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [513.295082] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [513.305469] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [513.305715] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [513.306761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [513.306852] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [513.306924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [513.306997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [513.307071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [513.307149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [513.307253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [513.307355] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [513.307455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [513.307600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [513.307706] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [513.307786] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [513.307857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [513.307928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [513.307999] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [513.308077] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [513.308179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [513.308280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [513.308382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [513.308500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [513.308610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [513.308722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [513.308825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [513.308904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [513.308976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [513.309049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [513.309120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [513.309205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [513.309317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [513.309426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [513.309592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [513.309737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [513.309877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [513.310013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [513.310148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [513.310279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [513.310410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [513.310545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [513.310674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [513.310799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [513.310928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [513.311055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [513.311181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [513.311306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [513.311436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [513.311567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [513.311693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [513.311828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [513.311955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [513.312079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [513.312203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [513.312332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [513.312457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [513.312588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [513.312713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [513.312840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [513.312964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [513.313088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [513.313217] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [513.313386] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [513.313393] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19192, lrc_seqno=19192, guc_id=0, flags=0x73 in no process [-1]
<7> [513.313398] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [513.313507] ------------[ cut here ]------------
<4> [513.313509] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [513.313511] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:13/2711
<4> [513.313626] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [513.313720] autofs4 [last unloaded: snd_hda_intel]
<4> [513.313725] CPU: 12 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [513.313730] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [513.313731] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [513.313734] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [513.313741] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [513.313853] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [513.313856] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [513.313859] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [513.313861] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [513.313863] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [513.313865] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [513.313867] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [513.313869] FS: 0000000000000000(0000) GS:ffff8888db297000(0000) knlGS:0000000000000000
<4> [513.313871] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [513.313873] CR2: 00005f5142935098 CR3: 000000012db16004 CR4: 0000000000f72ef0
<4> [513.313875] PKRU: 55555554
<4> [513.313877] Call Trace:
<4> [513.313878] <TASK>
<4> [513.313885] ? lock_sync+0x100/0x100
<4> [513.313892] ? lock_release+0xd0/0x2b0
<4> [513.313900] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [513.313910] process_one_work+0x239/0x760
<4> [513.313920] worker_thread+0x200/0x3f0
<4> [513.313925] ? __pfx_worker_thread+0x10/0x10
<4> [513.313928] kthread+0x10d/0x150
<4> [513.313933] ? __pfx_kthread+0x10/0x10
<4> [513.313938] ret_from_fork+0x3d4/0x480
<4> [513.313941] ? __pfx_kthread+0x10/0x10
<4> [513.313947] ret_from_fork_asm+0x1a/0x30
<4> [513.313959] </TASK>
<4> [513.313961] irq event stamp: 1668097
<4> [513.313963] hardirqs last enabled at (1668103): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [513.313967] hardirqs last disabled at (1668108): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [513.313970] softirqs last enabled at (1667336): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.313974] softirqs last disabled at (1667331): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.313978] ---[ end trace 0000000000000000 ]---
<7> [513.315659] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [513.315819] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [513.374588] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19193, lrc_seqno=19193, guc_id=0, flags=0x73 in no process [-1]
<7> [513.374612] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [513.375044] ------------[ cut here ]------------
<4> [513.375051] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<7> [513.375065] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:567]
<4> [513.375060] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#13: kworker/u64:13/2711
<4> [513.375573] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [513.376023] autofs4 [last unloaded: snd_hda_intel]
<4> [513.376047] CPU: 13 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [513.376066] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [513.376074] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [513.376084] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [513.376117] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [513.376603] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [513.376615] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [513.376631] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [513.376641] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [513.376651] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [513.376660] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [513.376669] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [513.376679] FS: 0000000000000000(0000) GS:ffff8888db317000(0000) knlGS:0000000000000000
<4> [513.376690] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [513.376700] CR2: 00007b3f4f70b000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [513.376711] PKRU: 55555554
<4> [513.376719] Call Trace:
<4> [513.376727] <TASK>
<4> [513.376756] ? lock_sync+0x100/0x100
<4> [513.376789] ? lock_release+0xd0/0x2b0
<4> [513.376826] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [513.376864] process_one_work+0x239/0x760
<4> [513.376908] worker_thread+0x200/0x3f0
<4> [513.376926] ? __pfx_worker_thread+0x10/0x10
<4> [513.376941] kthread+0x10d/0x150
<4> [513.376958] ? __pfx_kthread+0x10/0x10
<4> [513.376981] ret_from_fork+0x3d4/0x480
<4> [513.376995] ? __pfx_kthread+0x10/0x10
<4> [513.377015] ret_from_fork_asm+0x1a/0x30
<4> [513.377067] </TASK>
<4> [513.377074] irq event stamp: 1669065
<4> [513.377081] hardirqs last enabled at (1669071): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [513.377099] hardirqs last disabled at (1669076): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [513.377112] softirqs last enabled at (1668318): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.377127] softirqs last disabled at (1668311): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.377141] ---[ end trace 0000000000000000 ]---
<6> [513.377283] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [513.377832] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [513.377895] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [513.378132] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [513.378761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [513.379247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [513.379786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [513.380247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [513.380734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [513.381171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [513.381644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [513.382097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [513.382560] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [513.383078] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [513.383424] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [513.384454] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [513.395277] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [513.395637] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [513.396817] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [513.396946] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [513.397070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [513.397195] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [513.397322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [513.397450] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [513.397609] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [513.397741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [513.397870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [513.398000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [513.398131] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [513.398260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [513.398389] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [513.398530] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [513.398659] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [513.398784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [513.398907] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [513.399027] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [513.399146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [513.399275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [513.399402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [513.399535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [513.399656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [513.399770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [513.399885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [513.399997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [513.400108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [513.400222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [513.400334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [513.400439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [513.400556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [513.400661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [513.400771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [513.400877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [513.400987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [513.401095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [513.401200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [513.401294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [513.401387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [513.401480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [513.401571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [513.401664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [513.401749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [513.401835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [513.401925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [513.402011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [513.402099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [513.402187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [513.402273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [513.402355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [513.402437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [513.402531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [513.402613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [513.402696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [513.402778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [513.402862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [513.402944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [513.403025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [513.403108] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [513.403241] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [513.403246] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19193, lrc_seqno=19193, guc_id=0, flags=0x73 in no process [-1]
<7> [513.403249] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [513.403310] ------------[ cut here ]------------
<4> [513.403311] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [513.403313] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:13/2711
<4> [513.403389] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [513.403456] autofs4 [last unloaded: snd_hda_intel]
<4> [513.403464] CPU: 6 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [513.403468] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [513.403469] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [513.403471] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [513.403478] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [513.403554] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [513.403556] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [513.403558] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [513.403560] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [513.403561] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [513.403563] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [513.403564] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [513.403566] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [513.403567] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [513.403569] CR2: 00007b3f4f873000 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [513.403571] PKRU: 55555554
<4> [513.403572] Call Trace:
<4> [513.403574] <TASK>
<4> [513.403578] ? lock_sync+0x100/0x100
<4> [513.403584] ? lock_release+0xd0/0x2b0
<4> [513.403590] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [513.403595] process_one_work+0x239/0x760
<4> [513.403602] worker_thread+0x200/0x3f0
<4> [513.403605] ? __pfx_worker_thread+0x10/0x10
<4> [513.403608] kthread+0x10d/0x150
<4> [513.403612] ? __pfx_kthread+0x10/0x10
<4> [513.403616] ret_from_fork+0x3d4/0x480
<4> [513.403618] ? __pfx_kthread+0x10/0x10
<4> [513.403622] ret_from_fork_asm+0x1a/0x30
<4> [513.403630] </TASK>
<4> [513.403631] irq event stamp: 1672235
<4> [513.403632] hardirqs last enabled at (1672241): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [513.403636] hardirqs last disabled at (1672246): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [513.403638] softirqs last enabled at (1671336): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.403641] softirqs last disabled at (1671325): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.403644] ---[ end trace 0000000000000000 ]---
<6> [513.404839] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [513.404915] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [513.404926] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [513.404981] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [513.405089] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [513.405201] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [513.405410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [513.405514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [513.405614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [513.405710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [513.405806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [513.405899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [513.406011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [513.406103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [513.406191] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [513.406291] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [513.406414] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [513.407437] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [513.417468] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [513.417724] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [513.418915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [513.419000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [513.419081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [513.419163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [513.419245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [513.419327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [513.419408] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [513.419500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [513.419583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [513.419665] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [513.419744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [513.419825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [513.419903] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [513.419982] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [513.420062] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [513.420140] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [513.420219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [513.420296] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [513.420374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [513.420466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [513.420554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [513.420640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [513.420725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [513.420809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [513.420891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [513.420974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [513.421057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [513.421143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [513.421233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [513.421318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [513.421403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [513.421500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [513.421590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [513.421679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [513.421767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [513.421852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [513.421937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [513.422022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [513.422105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [513.422186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [513.422271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [513.422354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [513.422437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [513.422528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [513.422614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [513.422695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [513.422778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [513.422859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [513.422941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [513.423026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [513.423111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [513.423196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [513.423282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [513.423365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [513.423447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [513.423542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [513.423626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [513.423708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [513.423791] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [513.423908] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [513.423912] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19193, lrc_seqno=19193, guc_id=0, flags=0x73 in no process [-1]
<7> [513.423914] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [513.423977] ------------[ cut here ]------------
<4> [513.423978] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [513.423979] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:13/2711
<4> [513.424054] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [513.424119] autofs4 [last unloaded: snd_hda_intel]
<4> [513.424123] CPU: 6 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [513.424126] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [513.424127] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [513.424128] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [513.424134] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [513.424207] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [513.424209] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [513.424212] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [513.424213] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [513.424215] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [513.424216] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [513.424218] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [513.424219] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [513.424221] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [513.424223] CR2: 00007b3f4f873000 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [513.424224] PKRU: 55555554
<4> [513.424226] Call Trace:
<4> [513.424227] <TASK>
<4> [513.424231] ? lock_sync+0x100/0x100
<4> [513.424236] ? lock_release+0xd0/0x2b0
<4> [513.424241] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [513.424247] process_one_work+0x239/0x760
<4> [513.424254] worker_thread+0x200/0x3f0
<4> [513.424257] ? __pfx_worker_thread+0x10/0x10
<4> [513.424259] kthread+0x10d/0x150
<4> [513.424263] ? __pfx_kthread+0x10/0x10
<4> [513.424267] ret_from_fork+0x3d4/0x480
<4> [513.424269] ? __pfx_kthread+0x10/0x10
<4> [513.424273] ret_from_fork_asm+0x1a/0x30
<4> [513.424281] </TASK>
<4> [513.424282] irq event stamp: 1675409
<4> [513.424283] hardirqs last enabled at (1675415): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [513.424286] hardirqs last disabled at (1675420): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [513.424289] softirqs last enabled at (1674458): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.424292] softirqs last disabled at (1674451): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.424294] ---[ end trace 0000000000000000 ]---
<7> [513.425598] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [513.425706] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [513.429485] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19202, lrc_seqno=19202, guc_id=0, flags=0x73 in no process [-1]
<7> [513.429491] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [513.429560] ------------[ cut here ]------------
<4> [513.429561] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [513.429563] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:13/2711
<4> [513.429639] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp mei_hdcp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid hid kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 snd_hda_core rapl intel_cstate video snd_hwdep snd_pcm realtek snd_timer i2c_i801 snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus spi_intel soundcore mei intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_pad acpi_tad pinctrl_alderlake intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [513.429706] autofs4 [last unloaded: snd_hda_intel]
<4> [513.429710] CPU: 8 UID: 0 PID: 2711 Comm: kworker/u64:13 Tainted: G S U W L 7.0.0-lgci-xe-xe-pw-165069v1-debug+ #1 PREEMPT(lazy)
<4> [513.429713] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [513.429715] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [513.429716] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [513.429722] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [513.429793] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [513.429795] RSP: 0018:ffffc90003f43ca0 EFLAGS: 00010246
<4> [513.429798] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000
<4> [513.429799] RDX: ffff8881294a5f90 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0
<4> [513.429801] RBP: ffffc90003f43db0 R08: 0000000000000000 R09: 0000000000000000
<4> [513.429802] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [513.429803] R13: ffff8881294a5f90 R14: ffff88846e050818 R15: 00000000ffffffc2
<4> [513.429804] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [513.429806] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [513.429807] CR2: 00007b3f4f873000 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [513.429809] PKRU: 55555554
<4> [513.429810] Call Trace:
<4> [513.429811] <TASK>
<4> [513.429815] ? lock_sync+0x100/0x100
<4> [513.429820] ? lock_release+0xd0/0x2b0
<4> [513.429826] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [513.429831] process_one_work+0x239/0x760
<4> [513.429838] worker_thread+0x200/0x3f0
<4> [513.429841] ? __pfx_worker_thread+0x10/0x10
<4> [513.429843] kthread+0x10d/0x150
<4> [513.429846] ? __pfx_kthread+0x10/0x10
<4> [513.429850] ret_from_fork+0x3d4/0x480
<4> [513.429852] ? __pfx_kthread+0x10/0x10
<4> [513.429855] ret_from_fork_asm+0x1a/0x30
<4> [513.429863] </TASK>
<4> [513.429864] irq event stamp: 1676535
<4> [513.429865] hardirqs last enabled at (1676541): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [513.429868] hardirqs last disabled at (1676546): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [513.429870] softirqs last enabled at (1674458): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.429872] softirqs last disabled at (1674451): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [513.429875] ---[ end trace 0000000000000000 ]---
<6> [513.429877] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [513.429948] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [513.429954] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [513.430233] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [513.430439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [513.430548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [513.430643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [513.430732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [513.430819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [513.430905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [513.430991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [513.431081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [513.431226] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [513.431348] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [513.431476] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [513.432506] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [513.442470] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [513.442722] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [513.443696] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [513.443793] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [513.443899] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [513.443985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [513.444061] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [513.444144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [513.444220] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [513.444296] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [513.444370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [513.444446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [513.444559] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [513.444642] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [513.444720] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [513.444799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [513.444877] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [513.444956] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [513.445035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [513.445111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [513.445187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
|