Result: 407 Warning(s)
i915_display_info17 igt_runner17 results17.json results17-xe-load.json guc_logs17.tar i915_display_info_post_exec17 boot17 dmesg17
| Detail | Value |
|---|---|
| Duration | unknown |
| Hostname |
shard-bmg-3 |
| Igt-Version |
IGT-Version: 2.4-g93abaf017 (x86_64) (Linux: 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ x86_64) |
| Out |
Using IGT_SRANDOM=1776060369 for randomisation Opened device: /dev/dri/card0 Test requirement not met in function __igt_unique____real_main2210, file ../tests/intel/xe_pat.c:2298: Test requirement: intel_graphics_ver(dev_id) == IP_VER(35, 10) Last errno: 2, No such file or directory Starting subtest: pt-caching va_bits: 48, num_objs: 16384, spread over pt levels: [0]: 16384 [1]: 512 [2]: 16 runner: This test was killed due to a kernel taint (0x244). This test caused an abort condition: Kernel badly tainted (0x244, 0x200) (check dmesg for details): TAINT_WARN: WARN_ON has happened. |
| Err |
Starting subtest: pt-caching Received signal SIGQUIT. Stack trace: #0 [fatal_sig_handler+0x17b] #1 [__sigaction+0x50] #2 [ioctl+0x3b] #3 [drmIoctl+0x30] #4 [___xe_bo_create+0xe4] #5 [__xe_bo_create_caching+0x17] #6 [xe_bo_create_caching+0x27] #7 [pt_create_objects+0x19a] #8 [pt_caching_test+0x131] #9 [__igt_unique____real_main2210+0xbbe] #10 [main+0x3a] #11 [__libc_init_first+0x8a] #12 [__libc_start_main+0x8b] #13 [_start+0x25] |
| Dmesg |
<6> [208.307726] Console: switching to colour dummy device 80x25
<6> [208.308061] [IGT] xe_pat: executing
<6> [208.333602] [IGT] xe_pat: starting subtest pt-caching
<7> [208.357911] xe 0000:03:00.0: [drm:intel_power_well_enable [xe]] enabling AUX_TC2
<7> [208.461895] xe 0000:03:00.0: [drm:intel_power_well_disable [xe]] disabling AUX_TC2
<7> [210.090969] xe 0000:03:00.0: [drm:icp_irq_handler [xe]] hotplug event received, stat 0x02000000, dig 0x000088a8, pins 0x00000400, long 0x00000400
<7> [210.091580] xe 0000:03:00.0: [drm:intel_hpd_irq_handler [xe]] digital hpd on [ENCODER:526:DDI TC2/PHY G] - long
<7> [210.092143] xe 0000:03:00.0: [drm:intel_hpd_irq_handler [xe]] Received HPD interrupt on PIN 10 - cnt: 10
<7> [210.092895] xe 0000:03:00.0: [drm:intel_dp_hpd_pulse [xe]] got hpd irq on [ENCODER:526:DDI TC2/PHY G] - long
<7> [210.241448] xe 0000:03:00.0: [drm:drm_dp_dpcd_access [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: Too many retries, giving up. First error: -6
<7> [210.241535] xe 0000:03:00.0: [drm:i915_hotplug_work_func [xe]] running encoder hotplug functions
<7> [210.242060] xe 0000:03:00.0: [drm:i915_hotplug_work_func [xe]] Connector DP-2 (pin 10) received hotplug event. (retry 0)
<7> [210.242578] xe 0000:03:00.0: [drm:intel_dp_detect [xe]] [CONNECTOR:527:DP-2]
<7> [210.394793] xe 0000:03:00.0: [drm:drm_dp_dpcd_access [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: Too many retries, giving up. First error: -6
<7> [210.542713] xe 0000:03:00.0: [drm:drm_dp_dpcd_access [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: Too many retries, giving up. First error: -6
<7> [210.542802] xe 0000:03:00.0: [drm:intel_hotplug_detect_connector [xe]] [CONNECTOR:527:DP-2] status updated from connected to disconnected (epoch counter 14->15)
<7> [210.543281] xe 0000:03:00.0: [drm:i915_hotplug_work_func [xe]] Connector HDMI-A-2 (pin 10) received hotplug event. (retry 0)
<7> [210.543674] xe 0000:03:00.0: [drm:intel_hdmi_detect [xe]] [CONNECTOR:535:HDMI-A-2]
<7> [210.548101] xe 0000:03:00.0: [drm:drm_sysfs_connector_hotplug_event] [CONNECTOR:527:DP-2] generating connector hotplug event
<7> [210.548279] xe 0000:03:00.0: [drm:drm_client_hotplug] fbdev: ret=0
<7> [210.592645] xe 0000:03:00.0: [drm:icp_irq_handler [xe]] hotplug event received, stat 0x02000000, dig 0x000088a8, pins 0x00000400, long 0x00000400
<7> [210.593199] xe 0000:03:00.0: [drm:intel_hpd_irq_handler [xe]] digital hpd on [ENCODER:526:DDI TC2/PHY G] - long
<7> [210.593733] xe 0000:03:00.0: [drm:intel_hpd_irq_handler [xe]] Received HPD interrupt on PIN 10 - cnt: 20
<7> [210.594317] xe 0000:03:00.0: [drm:intel_dp_hpd_pulse [xe]] got hpd irq on [ENCODER:526:DDI TC2/PHY G] - long
<7> [210.595009] xe 0000:03:00.0: [drm:intel_power_well_enable [xe]] enabling AUX_TC2
<7> [210.598247] xe 0000:03:00.0: [drm:drm_dp_read_dpcd_caps [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: DPCD: 12 14 c4 01 01 15 01 81 00 01 04 01 0f 00 01
<7> [210.598338] xe 0000:03:00.0: [drm:i915_hotplug_work_func [xe]] running encoder hotplug functions
<7> [210.598890] xe 0000:03:00.0: [drm:i915_hotplug_work_func [xe]] Connector DP-2 (pin 10) received hotplug event. (retry 0)
<7> [210.599463] xe 0000:03:00.0: [drm:intel_dp_detect [xe]] [CONNECTOR:527:DP-2]
<7> [210.601580] xe 0000:03:00.0: [drm:drm_dp_read_dpcd_caps [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: DPCD: 12 14 c4 01 01 15 01 81 00 01 04 01 0f 00 01
<7> [210.609153] xe 0000:03:00.0: [drm:intel_dp_init_lttpr_and_dprx_caps [xe]] [CONNECTOR:527:DP-2][ENCODER:526:DDI TC2/PHY G][DPRX] LTTPR common capabilities: 00 00 00 00 00 00 00 00
<7> [210.610722] xe 0000:03:00.0: [drm:drm_dp_read_dpcd_caps [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: DPCD: 12 14 c4 01 01 15 01 81 00 01 04 01 0f 00 01
<7> [210.611876] xe 0000:03:00.0: [drm:drm_dp_dump_desc [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: DP branch: OUI 00-1c-f8 dev-ID 176GB0 HW-rev 0.0 SW-rev 199.85 quirks 0x0000
<7> [210.614869] xe 0000:03:00.0: [drm:drm_dp_read_downstream_info [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: DPCD DFP: 0b f0 02 11
<7> [210.615886] xe 0000:03:00.0: [drm:intel_dp_detect [xe]] [ENCODER:526:DDI TC2/PHY G] MST support: port: yes, sink: SST, modparam: yes -> enable: SST
<7> [210.624702] xe 0000:03:00.0: [drm:intel_dp_print_rates [xe]] source rates: 162000, 216000, 243000, 270000, 324000, 432000, 540000, 675000, 810000, 1000000
<7> [210.625263] xe 0000:03:00.0: [drm:intel_dp_print_rates [xe]] sink rates: 162000, 270000, 540000
<7> [210.625589] xe 0000:03:00.0: [drm:intel_dp_print_rates [xe]] common rates: 162000, 270000, 540000
<7> [210.630191] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer
<7> [210.631960] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer
<7> [210.633725] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer
<7> [210.635504] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer
<7> [210.637361] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer
<7> [210.639150] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer
<7> [210.640905] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer
<7> [210.642616] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer
<7> [210.645626] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer
<7> [210.647389] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer
<7> [210.648500] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer
<7> [210.649902] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer
<7> [210.651675] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer
<7> [210.653445] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer
<7> [210.654561] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer
<7> [210.655964] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer
<7> [210.657703] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer
<7> [210.659473] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer
<7> [210.660590] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer
<7> [210.661800] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] HDMI: DVI dual 0, max TMDS clock 300000 kHz
<7> [210.661811] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] HDMI sink does deep color 30.
<7> [210.661816] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] HDMI sink does deep color 36.
<7> [210.661846] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] HDMI sink does deep color 48.
<7> [210.661856] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] Assigning HDMI sink color depth as 16 bpc.
<7> [210.661864] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] HDMI sink does YCRCB444 in deep color.
<7> [210.661876] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] ELD monitor DPF90435
<7> [210.661886] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] HDMI: latency present 0 0, video latency 0 0, audio latency 0 0
<7> [210.661898] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] ELD size 40, SAD count 3
<7> [210.661953] xe 0000:03:00.0: [drm:intel_dp_set_edid [xe]] [CONNECTOR:527:DP-2] VRR capable: no
<7> [210.662226] xe 0000:03:00.0: [drm:intel_dp_set_edid [xe]] [CONNECTOR:527:DP-2] DFP max bpc 12, max dotclock 0, TMDS clock 25000-600000, PCON Max FRL BW 0Gbps
<7> [210.663279] xe 0000:03:00.0: [drm:intel_dp_set_edid [xe]] PCON ENCODER DSC DPCD: 00 00 00 00 00 00 00 00 00 00 00 00 00
<7> [210.663504] xe 0000:03:00.0: [drm:intel_dp_set_edid [xe]] [CONNECTOR:527:DP-2] RGB->YcbCr conversion? no, YCbCr 4:2:0 allowed? no, YCbCr 4:4:4->4:2:0 conversion? no
<7> [210.664468] xe 0000:03:00.0: [drm:intel_hotplug_detect_connector [xe]] [CONNECTOR:527:DP-2] status updated from disconnected to connected (epoch counter 15->16)
<7> [210.665091] xe 0000:03:00.0: [drm:intel_dp_dump_link_status [xe]] [CONNECTOR:527:DP-2][ENCODER:526:DDI TC2/PHY G][DPRX] ln0_1:0x0 ln2_3:0x0 align:0x0 sink:0x0 adj_req0_1:0x0 adj_req2_3:0x0
<7> [210.665191] xe 0000:03:00.0: [drm:intel_dp_needs_link_retrain [xe]] [ENCODER:526:DDI TC2/PHY G] 8b/10b link not ok, retraining
<7> [210.665341] xe 0000:03:00.0: [drm:i915_hotplug_work_func [xe]] Connector HDMI-A-2 (pin 10) received hotplug event. (retry 0)
<7> [210.665507] xe 0000:03:00.0: [drm:intel_hdmi_detect [xe]] [CONNECTOR:535:HDMI-A-2]
<7> [210.665763] xe 0000:03:00.0: [drm:do_gmbus_xfer [xe]] GMBUS [i915 gmbus tc2] NAK for addr: 0050 w(1)
<7> [210.665867] xe 0000:03:00.0: [drm:do_gmbus_xfer [xe]] GMBUS [i915 gmbus tc2] NAK on first message, retry
<7> [210.666118] xe 0000:03:00.0: [drm:do_gmbus_xfer [xe]] GMBUS [i915 gmbus tc2] NAK for addr: 0050 w(1)
<7> [210.666208] [drm:drm_do_probe_ddc_edid] drm: skipping non-existent adapter i915 gmbus tc2
<7> [210.666212] xe 0000:03:00.0: [drm:intel_hdmi_set_edid [xe]] HDMI GMBUS EDID read failed, retry using GPIO bit-banging
<7> [210.666307] xe 0000:03:00.0: [drm:intel_gmbus_force_bit [xe]] enabling bit-banging on i915 gmbus tc2. force bit now 1
<7> [210.667458] [drm:drm_do_probe_ddc_edid] drm: skipping non-existent adapter i915 gmbus tc2
<7> [210.667462] xe 0000:03:00.0: [drm:intel_gmbus_force_bit [xe]] disabling bit-banging on i915 gmbus tc2. force bit now 0
<7> [210.667560] xe 0000:03:00.0: [drm:drm_sysfs_connector_hotplug_event] [CONNECTOR:527:DP-2] generating connector hotplug event
<7> [210.667602] xe 0000:03:00.0: [drm:drm_client_hotplug] fbdev: ret=0
<7> [210.668025] xe 0000:03:00.0: [drm:intel_dp_dump_link_status [xe]] [CONNECTOR:527:DP-2][ENCODER:526:DDI TC2/PHY G][DPRX] ln0_1:0x0 ln2_3:0x0 align:0x0 sink:0x0 adj_req0_1:0x0 adj_req2_3:0x0
<7> [210.668158] xe 0000:03:00.0: [drm:intel_dp_needs_link_retrain [xe]] [ENCODER:526:DDI TC2/PHY G] 8b/10b link not ok, retraining
<7> [210.668713] xe 0000:03:00.0: [drm:intel_dp_dump_link_status [xe]] [CONNECTOR:527:DP-2][ENCODER:526:DDI TC2/PHY G][DPRX] ln0_1:0x0 ln2_3:0x0 align:0x0 sink:0x0 adj_req0_1:0x0 adj_req2_3:0x0
<7> [210.668861] xe 0000:03:00.0: [drm:intel_dp_needs_link_retrain [xe]] [ENCODER:526:DDI TC2/PHY G] 8b/10b link not ok, retraining
<7> [210.669004] xe 0000:03:00.0: [drm:intel_dp_link_check [xe]] [ENCODER:526:DDI TC2/PHY G] retraining link (forced no)
<7> [210.669237] xe 0000:03:00.0: [drm:intel_dp_compute_config_limits [xe]] [ENCODER:526:DDI TC2/PHY G][CRTC:151:pipe A] DP link limits: pixel clock 148500 kHz DSC off max lanes 4 max rate 540000 max pipe_bpp 36 min link_bpp 18.0000 max link_bpp 36.0000
<7> [210.669347] xe 0000:03:00.0: [drm:intel_dp_compute_link_config [xe]] DP lane count 4 clock 270000 bpp input 36 compressed 0.0000 HDR no link rate required 668250 available 1080000
<7> [210.669451] xe 0000:03:00.0: [drm:intel_atomic_check [xe]] [CRTC:151:pipe A] hw max bpp: 36, pipe bpp: 36, dithering: 0
<7> [210.669553] xe 0000:03:00.0: [drm:intel_ddi_compute_config_late [xe]] [ENCODER:526:DDI TC2/PHY G] [CRTC:151:pipe A]
<7> [210.669660] xe 0000:03:00.0: [drm:intel_dpll_crtc_put [xe]] [CRTC:151:pipe A] releasing TC PLL 2
<7> [210.670282] xe 0000:03:00.0: [drm:intel_dp_dump_link_status [xe]] [CONNECTOR:527:DP-2][ENCODER:526:DDI TC2/PHY G][DPRX] ln0_1:0x0 ln2_3:0x0 align:0x0 sink:0x0 adj_req0_1:0x0 adj_req2_3:0x0
<7> [210.670385] xe 0000:03:00.0: [drm:intel_dp_needs_link_retrain [xe]] [ENCODER:526:DDI TC2/PHY G] 8b/10b link not ok, retraining
<7> [210.670915] xe 0000:03:00.0: [drm:intel_dp_dump_link_status [xe]] [CONNECTOR:527:DP-2][ENCODER:526:DDI TC2/PHY G][DPRX] ln0_1:0x0 ln2_3:0x0 align:0x0 sink:0x0 adj_req0_1:0x0 adj_req2_3:0x0
<7> [210.671023] xe 0000:03:00.0: [drm:intel_dp_needs_link_retrain [xe]] [ENCODER:526:DDI TC2/PHY G] 8b/10b link not ok, retraining
<7> [210.671136] xe 0000:03:00.0: [drm:intel_dp_link_check [xe]] [ENCODER:526:DDI TC2/PHY G] retraining link (forced no)
<7> [210.671730] xe 0000:03:00.0: [drm:intel_dp_dump_link_status [xe]] [CONNECTOR:527:DP-2][ENCODER:526:DDI TC2/PHY G][DPRX] ln0_1:0x0 ln2_3:0x0 align:0x0 sink:0x0 adj_req0_1:0x0 adj_req2_3:0x0
<7> [210.671844] xe 0000:03:00.0: [drm:intel_dp_needs_link_retrain [xe]] [ENCODER:526:DDI TC2/PHY G] 8b/10b link not ok, retraining
<7> [210.672373] xe 0000:03:00.0: [drm:intel_dp_dump_link_status [xe]] [CONNECTOR:527:DP-2][ENCODER:526:DDI TC2/PHY G][DPRX] ln0_1:0x0 ln2_3:0x0 align:0x0 sink:0x0 adj_req0_1:0x0 adj_req2_3:0x0
<7> [210.672473] xe 0000:03:00.0: [drm:intel_dp_needs_link_retrain [xe]] [ENCODER:526:DDI TC2/PHY G] 8b/10b link not ok, retraining
<7> [210.672572] xe 0000:03:00.0: [drm:intel_dp_link_check [xe]] [ENCODER:526:DDI TC2/PHY G] retraining link (forced no)
<7> [210.672736] xe 0000:03:00.0: [drm:intel_dp_compute_config_limits [xe]] [ENCODER:526:DDI TC2/PHY G][CRTC:151:pipe A] DP link limits: pixel clock 148500 kHz DSC off max lanes 4 max rate 540000 max pipe_bpp 36 min link_bpp 18.0000 max link_bpp 36.0000
<7> [210.672844] xe 0000:03:00.0: [drm:intel_dp_compute_link_config [xe]] DP lane count 4 clock 270000 bpp input 36 compressed 0.0000 HDR no link rate required 668250 available 1080000
<7> [210.672950] xe 0000:03:00.0: [drm:intel_atomic_check [xe]] [CRTC:151:pipe A] hw max bpp: 36, pipe bpp: 36, dithering: 0
<7> [210.673054] xe 0000:03:00.0: [drm:intel_ddi_compute_config_late [xe]] [ENCODER:526:DDI TC2/PHY G] [CRTC:151:pipe A]
<7> [210.673158] xe 0000:03:00.0: [drm:intel_dpll_crtc_put [xe]] [CRTC:151:pipe A] releasing TC PLL 2
<7> [210.673299] xe 0000:03:00.0: [drm:intel_find_dpll [xe]] [CRTC:151:pipe A] allocated TC PLL 2
<7> [210.673394] xe 0000:03:00.0: [drm:intel_dpll_crtc_get [xe]] [CRTC:151:pipe A] reserving TC PLL 2
<7> [210.673491] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [CRTC:151:pipe A] enable: yes [modeset]
<7> [210.673598] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] active: yes, output_types: DP (0x80), output format: RGB, sink format: RGB
<7> [210.673700] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] cpu_transcoder: A, pipe bpp: 36, dithering: 0
<7> [210.673799] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] MST master transcoder: <invalid>
<7> [210.673909] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] port sync: master transcoder: <invalid>, slave transcoder bitmask = 0x0
<7> [210.674016] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] joiner: no, pipes: 0x0
<7> [210.674110] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] splitter: disabled, link count 0, overlap 0
<7> [210.674203] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] dp m_n: lanes: 4; data_m: 5190451, data_n: 8388608, link_m: 288358, link_n: 524288, tu: 64
<7> [210.674296] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] dp m2_n2: lanes: 4; data_m: 0, data_n: 0, link_m: 0, link_n: 0, tu: 0
<7> [210.674387] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] fec: disabled, enhanced framing: enabled
<7> [210.674482] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] sdp split: disabled
<7> [210.674574] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] psr: disabled, selective update: disabled, panel replay: disabled, selective fetch: disabled
<7> [210.674667] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] minimum hblank: 0
<7> [210.674761] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] audio: 1, infoframes: 0, infoframes enabled: 0x0
<7> [210.674864] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] ELD: 10 00 09 00 68 36 00 01 00 00 00 00 00 00 00 00
<7> [210.674972] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] ELD: 61 a4 9a 00 44 50 46 39 30 34 33 35 09 07 07 11
<7> [210.675070] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] ELD: 17 50 51 07 00 00 00 00
<7> [210.675167] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] scanline offset: 1
<7> [210.675262] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] framestart delay: 1, MSA timing delay: 0, set context latency: 0
<7> [210.675356] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] vrr: no, fixed rr: yes, vmin: 1125, vmax: 1125, flipline: 1125, pipeline full: 0, guardband: 42 vsync start: 41, vsync end: 36
<7> [210.675451] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] vrr: vmin vblank: 1083, vmax vblank: 1083, vmin vtotal: 1125, vmax vtotal: 1125
<7> [210.675544] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] vrr: dc balance: no, vmin: 0 vmax: 0 guardband: 0, slope: 0 max increase: 0 max decrease: 0 vblank target: 0
<7> [210.675639] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] requested mode: "1920x1080": 60 148500 1920 2008 2052 2200 1080 1084 1089 1125 0x48 0x5
<7> [210.675732] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] adjusted mode: "1920x1080": 60 148500 1920 2008 2052 2200 1080 1084 1089 1125 0x48 0x5
<7> [210.675833] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] crtc timings: clock=148500, hd=1920 hb=1920-2200 hs=2008-2052 ht=2200, vd=1080 vb=1080-1125 vs=1084-1089 vt=1125, flags=0x5
<7> [210.675939] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pipe mode: "1920x1080": 60 148500 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5
<7> [210.676032] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] crtc timings: clock=148500, hd=1920 hb=1920-2200 hs=2008-2052 ht=2200, vd=1080 vb=1080-1125 vs=1084-1089 vt=1125, flags=0x5
<7> [210.676131] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] port clock: 270000, pixel rate 148500, min cdclk 192000, min voltage level 0
<7> [210.676230] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] linetime: 119, ips linetime: 0
<7> [210.676326] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] num_scalers: 2, scaler_users: 0x0, scaler_id: -1, scaling_filter: 0, sharpness_strength: 0
<7> [210.676421] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pipe src: 1920x1080+0+0
<7> [210.676515] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pch pfit: 0x0+0+0, disabled, force thru: no
<7> [210.676610] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] sharpness strength: 0, sharpness tap size: 0, sharpness enable: 0
<7> [210.676703] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] ips: 0, double wide: 0, drrs: 0
<7> [210.676797] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] cx0pll_hw_state: lane_count: 4, ssc_enabled: no, use_c10: no, tbt_mode: no
<7> [210.676909] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] c20pll_hw_state:
<7> [210.677013] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] tx[0] = 0xbe88, tx[1] = 0x4800, tx[2] = 0x0000
<7> [210.677105] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] cmn[0] = 0x0500, cmn[1] = 0x0005, cmn[2] = 0x0000, cmn[3] = 0x0000
<7> [210.677196] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[0] = 0x308c
<7> [210.677286] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[1] = 0x2110
<7> [210.677378] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[2] = 0xcc9c
<7> [210.677470] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[3] = 0xbfc1
<7> [210.677561] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[4] = 0x4b9a
<7> [210.677659] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[5] = 0x3f81
<7> [210.677757] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[6] = 0x2000
<7> [210.677862] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[7] = 0x0001
<7> [210.677969] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[8] = 0x5000
<7> [210.678062] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[9] = 0x0000
<7> [210.678154] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[10] = 0x0000
<7> [210.678246] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] vdr: custom width: 0x00, serdes rate: 0x42, hdmi rate: 0x00
<7> [210.678340] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] csc_mode: 0x0 gamma_mode: 0x0 gamma_enable: 0 csc_enable: 0
<7> [210.678432] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pre csc lut: 0 entries, post csc lut: 0 entries
<7> [210.678525] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] output csc: pre offsets: 0x0000 0x0000 0x0000
<7> [210.678618] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] output csc: coefficients: 0x0000 0x0000 0x0000
<7> [210.678711] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] output csc: coefficients: 0x0000 0x0000 0x0000
<7> [210.678805] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] output csc: coefficients: 0x0000 0x0000 0x0000
<7> [210.678911] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] output csc: post offsets: 0x0000 0x0000 0x0000
<7> [210.679015] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pipe csc: pre offsets: 0x0000 0x0000 0x0000
<7> [210.679106] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pipe csc: coefficients: 0x0000 0x0000 0x0000
<7> [210.679197] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pipe csc: coefficients: 0x0000 0x0000 0x0000
<7> [210.679287] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pipe csc: coefficients: 0x0000 0x0000 0x0000
<7> [210.679378] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pipe csc: post offsets: 0x0000 0x0000 0x0000
<7> [210.679470] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:35:plane 1A] fb: [FB:555] 1920x1080 format = XR24 little-endian (0x34325258) modifier = 0x0, visible: yes
<7> [210.679564] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] rotation: 0x1, scaler: -1, scaling_filter: 0
<7> [210.679656] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] src: 1920.000000x1080.000000+0.000000+0.000000 dst: 1920x1080+0+0
<7> [210.679749] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:65:plane 2A] fb: [NOFB], visible: no
<7> [210.679847] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:95:plane 3A] fb: [NOFB], visible: no
<7> [210.679952] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:125:plane 4A] fb: [NOFB], visible: no
<7> [210.680045] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:135:plane 5A] fb: [NOFB], visible: no
<7> [210.680142] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:145:cursor A] fb: [NOFB], visible: no
<7> [210.680297] xe 0000:03:00.0: [drm:intel_audio_codec_disable [xe]] [CONNECTOR:527:DP-2][ENCODER:526:DDI TC2/PHY G] Disable audio codec on [CRTC:151:pipe A]
<7> [210.704202] xe 0000:03:00.0: [drm:intel_audio_component_get_eld [xe]] Not valid for port E
<7> [210.704577] xe 0000:03:00.0: [drm:intel_disable_transcoder [xe]] disabling pipe A
<7> [210.721380] xe 0000:03:00.0: [drm:intel_dpll_disable [xe]] disable TC PLL 2 (active 0x1, on? 1) for [CRTC:151:pipe A]
<7> [210.723800] xe 0000:03:00.0: [drm:intel_dpll_disable [xe]] disabling TC PLL 2
<7> [210.724494] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:507:DDI TC1/PHY F]
<7> [210.725044] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:509:DP-MST A]
<7> [210.725547] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:510:DP-MST B]
<7> [210.726064] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:511:DP-MST C]
<7> [210.726547] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:512:DP-MST D]
<7> [210.726988] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:526:DDI TC2/PHY G]
<7> [210.727414] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:528:DP-MST A]
<7> [210.727807] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:529:DP-MST B]
<6> [210.728139] pcieport 0000:00:01.0: PME: Spurious native interrupt!
<7> [210.728028] xe 0000:03:00.0: [drm:intel_audio_component_get_power [xe]] restored AUD_FREQ_CNTRL to 0x8010
<7> [210.728256] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:530:DP-MST C]
<7> [210.728637] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:531:DP-MST D]
<7> [210.729063] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:538:DDI TC3/PHY H]
<7> [210.729438] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:542:DDI TC4/PHY I]
<7> [210.729776] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:544:DP-MST A]
<7> [210.730159] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:545:DP-MST B]
<7> [210.730492] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:546:DP-MST C]
<7> [210.730782] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:547:DP-MST D]
<7> [210.732784] xe 0000:03:00.0: [drm:intel_dpll_enable [xe]] enable TC PLL 2 (active 0x1, on? 0) for [CRTC:151:pipe A]
<7> [210.733080] xe 0000:03:00.0: [drm:intel_dpll_enable [xe]] enabling TC PLL 2
<7> [210.737300] xe 0000:03:00.0: [drm:drm_dp_read_dpcd_caps [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: DPCD: 12 14 c4 01 01 15 01 81 00 01 04 01 0f 00 01
<7> [210.741129] xe 0000:03:00.0: [drm:intel_dp_init_lttpr_and_dprx_caps [xe]] [CONNECTOR:527:DP-2][ENCODER:526:DDI TC2/PHY G][DPRX] LTTPR common capabilities: 00 00 00 00 00 00 00 00
<7> [210.742103] xe 0000:03:00.0: [drm:drm_dp_read_dpcd_caps [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: DPCD: 12 14 c4 01 01 15 01 81 00 01 04 01 0f 00 01
<7> [210.742582] xe 0000:03:00.0: [drm:intel_dp_start_link_train [xe]] [CONNECTOR:527:DP-2][ENCODER:526:DDI TC2/PHY G][DPRX] Using LINK_BW_SET value 0a
<7> [210.743564] xe 0000:03:00.0: [drm:intel_dp_set_signal_levels [xe]] [CONNECTOR:527:DP-2][ENCODER:526:DDI TC2/PHY G][DPRX] 8b/10b, lanes: 4, vswing levels: 0/0/0/0, pre-emphasis levels: 0/0/0/0
<7> [210.744215] xe 0000:03:00.0: [drm:intel_dp_program_link_training_pattern [xe]] [CONNECTOR:527:DP-2][ENCODER:526:DDI TC2/PHY G][DPRX] Using DP training pattern TPS1
<7> [210.749379] xe 0000:03:00.0: [drm:intel_dp_link_train_phy [xe]] [CONNECTOR:527:DP-2][ENCODER:526:DDI TC2/PHY G][DPRX] Clock recovery OK
<7> [210.749816] xe 0000:03:00.0: [drm:intel_dp_program_link_training_pattern [xe]] [CONNECTOR:527:DP-2][ENCODER:526:DDI TC2/PHY G][DPRX] Using DP training pattern TPS3
<7> [210.755362] xe 0000:03:00.0: [drm:intel_dp_link_train_phy [xe]] [CONNECTOR:527:DP-2][ENCODER:526:DDI TC2/PHY G][DPRX] Channel EQ done. DP Training successful
<7> [210.755776] xe 0000:03:00.0: [drm:intel_dp_link_train_phy [xe]] [CONNECTOR:527:DP-2][ENCODER:526:DDI TC2/PHY G][DPRX] Link Training passed at link rate = 270000, lane count = 4
<7> [210.756768] xe 0000:03:00.0: [drm:intel_enable_transcoder [xe]] enabling pipe A
<7> [210.774018] xe 0000:03:00.0: [drm:intel_audio_codec_enable [xe]] [CONNECTOR:527:DP-2][ENCODER:526:DDI TC2/PHY G] Enable audio codec on [CRTC:151:pipe A], 40 bytes ELD
<7> [210.787398] xe 0000:03:00.0: [drm:intel_audio_component_get_power [xe]] restored AUD_FREQ_CNTRL to 0x8010
<7> [210.790761] xe 0000:03:00.0: [drm:verify_connector_state [xe]] [CONNECTOR:527:DP-2]
<7> [210.791425] xe 0000:03:00.0: [drm:intel_modeset_verify_crtc [xe]] [CRTC:151:pipe A]
<7> [210.862017] xe 0000:03:00.0: [drm:intel_power_well_disable [xe]] disabling AUX_TC2
<7> [212.774143] xe 0000:03:00.0: [drm:intel_power_well_enable [xe]] enabling AUX_TC2
<7> [212.878111] xe 0000:03:00.0: [drm:intel_power_well_disable [xe]] disabling AUX_TC2
<4> [214.054899] ------------[ cut here ]------------
<4> [214.054914] xe 0000:03:00.0: [drm] Tile0: GT0: Unexpected engine class:instance 3:8 for context utilization
<4> [214.054928] WARNING: drivers/gpu/drm/xe/xe_lrc.c:2580 at xe_lrc_timestamp+0x196/0x460 [xe], CPU#8: kworker/u64:1/118
<4> [214.055386] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [214.055737] efi_pstore nfnetlink autofs4
<4> [214.055760] CPU: 8 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [214.055775] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER
<4> [214.055781] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [214.055789] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [214.055858] RIP: 0010:xe_lrc_timestamp+0x1a7/0x460 [xe]
<4> [214.056255] Code: b6 79 26 48 89 55 c8 88 45 d0 e8 14 eb 5c e1 48 89 c6 48 8d 3d aa bb 37 00 0f b6 4d d0 41 54 45 89 e9 45 0f b6 c7 48 8b 55 c8 <67> 48 0f b9 3a 58 eb 91 41 0f b6 bd 99 0f 00 00 e8 14 e0 03 00 41
<4> [214.056264] RSP: 0018:ffffc9000054bc00 EFLAGS: 00010246
<4> [214.056278] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [214.056287] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1004f40
<4> [214.056294] RBP: ffffc9000054bc90 R08: 0000000000000000 R09: 0000000000000003
<4> [214.056302] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000008
<4> [214.056308] R13: 0000000000000003 R14: ffff888136186780 R15: 0000000000000000
<4> [214.056316] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [214.056325] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [214.056333] CR2: 000077f8abad0008 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [214.056342] PKRU: 55555554
<4> [214.056349] Call Trace:
<4> [214.056356] <TASK>
<4> [214.056368] ? enable_work+0x9d/0x100
<4> [214.056393] ? xe_lrc_start_seqno+0x33/0x70 [xe]
<4> [214.056785] guc_exec_queue_timedout_job+0xf80/0x2400 [xe]
<4> [214.057275] ? lock_sync+0x100/0x100
<4> [214.057296] ? lock_release+0xd0/0x2b0
<4> [214.057325] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [214.057357] process_one_work+0x239/0x760
<4> [214.057389] worker_thread+0x200/0x3f0
<4> [214.057405] ? __pfx_worker_thread+0x10/0x10
<4> [214.057418] kthread+0x10d/0x150
<4> [214.057434] ? __pfx_kthread+0x10/0x10
<4> [214.057454] ret_from_fork+0x3d4/0x480
<4> [214.057465] ? __pfx_kthread+0x10/0x10
<4> [214.057484] ret_from_fork_asm+0x1a/0x30
<4> [214.057522] </TASK>
<4> [214.057529] irq event stamp: 544203
<4> [214.057536] hardirqs last enabled at (544209): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [214.057552] hardirqs last disabled at (544214): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [214.057565] softirqs last enabled at (544126): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [214.057579] softirqs last disabled at (544121): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [214.057591] ---[ end trace 0000000000000000 ]---
<7> [214.057606] xe 0000:03:00.0: [drm:guc_exec_queue_timedout_job [xe]] Tile0: GT0: Check job timeout: seqno=43606, lrc_seqno=43606, guc_id=0, running_time_ms=232896, timeout_ms=5000, diff=0xfdd6849d
<6> [214.698876] xe 0000:03:00.0: [drm] Tile0: GT0: Engine reset: engine_class=bcs, logical_mask: 0x2, guc_id=0, state=0x209
<5> [214.699008] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43606, lrc_seqno=43606, guc_id=0, flags=0x73 in no process [-1]
<7> [214.699034] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [214.699421] ------------[ cut here ]------------
<4> [214.699429] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [214.699437] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:1/118
<4> [214.699900] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [214.700254] efi_pstore nfnetlink autofs4
<4> [214.700282] CPU: 8 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [214.700298] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [214.700306] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [214.700314] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [214.700343] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [214.700734] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [214.700743] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [214.700757] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [214.700766] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [214.700773] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [214.700780] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [214.700812] R13: ffff888102a1a110 R14: ffff88812a4c8000 R15: 00000000ffffffc2
<4> [214.700820] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [214.700828] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [214.700838] CR2: 000077f8abad0008 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [214.700852] PKRU: 55555554
<4> [214.700863] Call Trace:
<4> [214.700875] <TASK>
<4> [214.700915] ? lock_sync+0x100/0x100
<4> [214.700958] ? __pfx_autoremove_wake_function+0x10/0x10
<4> [214.700986] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [214.701017] process_one_work+0x239/0x760
<4> [214.701050] worker_thread+0x200/0x3f0
<4> [214.701065] ? __pfx_worker_thread+0x10/0x10
<4> [214.701078] kthread+0x10d/0x150
<4> [214.701094] ? __pfx_kthread+0x10/0x10
<4> [214.701114] ret_from_fork+0x3d4/0x480
<4> [214.701126] ? __pfx_kthread+0x10/0x10
<4> [214.701144] ret_from_fork_asm+0x1a/0x30
<4> [214.701183] </TASK>
<4> [214.701190] irq event stamp: 545061
<4> [214.701198] hardirqs last enabled at (545067): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [214.701214] hardirqs last disabled at (545072): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [214.701227] softirqs last enabled at (544310): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [214.701241] softirqs last disabled at (544305): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [214.701253] ---[ end trace 0000000000000000 ]---
<6> [214.701264] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [214.701628] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [214.702185] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [214.702583] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [214.703771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [214.704073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [214.704161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [214.704247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [214.704328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [214.704406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [214.704484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [214.704564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [214.704639] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [214.704726] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [214.704846] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [214.706033] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [214.715905] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [214.716340] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [214.719318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [214.719552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [214.719780] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [214.720083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [214.720308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [214.720528] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [214.720753] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [214.721014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [214.721237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [214.721441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [214.721642] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [214.721856] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [214.722049] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [214.722234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [214.722420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [214.722603] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [214.722778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [214.723004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [214.723186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [214.723385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [214.723570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [214.723747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [214.723968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [214.724135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [214.724301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [214.724469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [214.724634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [214.724811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [214.724981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [214.725134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [214.725286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [214.725435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [214.725586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [214.725735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [214.725899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [214.726041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [214.726181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [214.726317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [214.726454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [214.726589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [214.726722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [214.726865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [214.726991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [214.727112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [214.727239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [214.727359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [214.727477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [214.727591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [214.727706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [214.727823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [214.727932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [214.728046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [214.728159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [214.728284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [214.728396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [214.728502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [214.728604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [214.728704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [214.728811] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [214.729386] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<7> [214.731087] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [214.731204] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [217.553410] xe 0000:03:00.0: [drm:xe_hwmon_read [xe]] thermal data for group 0 val 0x29282727
<7> [217.553613] xe 0000:03:00.0: [drm:xe_hwmon_read [xe]] thermal data for group 1 val 0x2c2a2a2a
<5> [220.198013] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43606, lrc_seqno=43606, guc_id=0, flags=0x73 in no process [-1]
<7> [220.198040] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [220.198382] ------------[ cut here ]------------
<4> [220.198390] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [220.198398] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:8/716
<4> [220.198853] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [220.199204] efi_pstore nfnetlink autofs4
<4> [220.199232] CPU: 5 UID: 0 PID: 716 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [220.199247] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [220.199255] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [220.199263] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [220.199292] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [220.199659] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [220.199669] RSP: 0018:ffffc9000293fca0 EFLAGS: 00010246
<4> [220.199683] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [220.199693] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [220.199701] RBP: ffffc9000293fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [220.199708] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [220.199715] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [220.199723] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000
<4> [220.199733] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [220.199767] CR2: 000078007f9e62f4 CR3: 000000000344c003 CR4: 0000000000f72ef0
<4> [220.199776] PKRU: 55555554
<4> [220.199783] Call Trace:
<4> [220.199790] <TASK>
<4> [220.199813] ? lock_sync+0x100/0x100
<4> [220.199839] ? lock_release+0xd0/0x2b0
<4> [220.199868] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [220.199898] process_one_work+0x239/0x760
<4> [220.199931] worker_thread+0x200/0x3f0
<4> [220.199947] ? __pfx_worker_thread+0x10/0x10
<4> [220.199960] kthread+0x10d/0x150
<4> [220.199976] ? __pfx_kthread+0x10/0x10
<4> [220.199996] ret_from_fork+0x3d4/0x480
<4> [220.200007] ? __pfx_kthread+0x10/0x10
<4> [220.200026] ret_from_fork_asm+0x1a/0x30
<4> [220.200064] </TASK>
<4> [220.200070] irq event stamp: 522127
<4> [220.200077] hardirqs last enabled at (522133): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [220.200093] hardirqs last disabled at (522138): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [220.200105] softirqs last enabled at (521376): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [220.200119] softirqs last disabled at (521371): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [220.200132] ---[ end trace 0000000000000000 ]---
<6> [220.200143] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [220.200508] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [220.200553] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [220.201141] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [220.201691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [220.202197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [220.202659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [220.203147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [220.203575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [220.203657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [220.203747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [220.203836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [220.203918] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [220.204004] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [220.204111] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [220.205113] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [220.216211] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [220.216673] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [220.218597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [220.218856] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [220.219086] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [220.219311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [220.219534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [220.219772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [220.220005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [220.220237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [220.220478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [220.220704] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [220.220952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [220.221169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [220.221380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [220.221588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [220.221804] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [220.222008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [220.222215] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [220.222419] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [220.222609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [220.222838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [220.223037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [220.223228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [220.223416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [220.223595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [220.223780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [220.223962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [220.224141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [220.224322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [220.224494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [220.224657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [220.224836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [220.224997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [220.225158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [220.225316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [220.225470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [220.225617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [220.225769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [220.225910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [220.226056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [220.226193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [220.226332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [220.226467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [220.226598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [220.226726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [220.226878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [220.227005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [220.227133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [220.227259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [220.227385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [220.227501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [220.227614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [220.227731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [220.227862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [220.227973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [220.228082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [220.228194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [220.228302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [220.228409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [220.228515] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [220.228963] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<7> [220.229987] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [220.230146] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [225.318020] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43606, lrc_seqno=43606, guc_id=0, flags=0x73 in no process [-1]
<7> [225.318050] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.318443] ------------[ cut here ]------------
<4> [225.318451] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.318459] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:8/716
<4> [225.319008] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.319471] efi_pstore nfnetlink autofs4
<4> [225.319500] CPU: 10 UID: 0 PID: 716 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.319516] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.319524] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.319532] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.319562] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.320020] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.320036] RSP: 0018:ffffc9000293fca0 EFLAGS: 00010246
<4> [225.320060] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.320073] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.320086] RBP: ffffc9000293fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.320097] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.320108] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.320123] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [225.320138] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.320152] CR2: 0000775911423058 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.320166] PKRU: 55555554
<4> [225.320179] Call Trace:
<4> [225.320190] <TASK>
<4> [225.320227] ? lock_sync+0x100/0x100
<4> [225.320272] ? lock_release+0xd0/0x2b0
<4> [225.320320] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.320372] process_one_work+0x239/0x760
<4> [225.320433] worker_thread+0x200/0x3f0
<4> [225.320459] ? __pfx_worker_thread+0x10/0x10
<4> [225.320481] kthread+0x10d/0x150
<4> [225.320505] ? __pfx_kthread+0x10/0x10
<4> [225.320538] ret_from_fork+0x3d4/0x480
<4> [225.320556] ? __pfx_kthread+0x10/0x10
<4> [225.320586] ret_from_fork_asm+0x1a/0x30
<4> [225.320657] </TASK>
<4> [225.320668] irq event stamp: 528151
<4> [225.320680] hardirqs last enabled at (528157): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.320725] hardirqs last disabled at (528164): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.320746] softirqs last enabled at (527990): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.320767] softirqs last disabled at (527985): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.320787] ---[ end trace 0000000000000000 ]---
<5> [225.323767] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43661, lrc_seqno=43661, guc_id=0, flags=0x73 in no process [-1]
<7> [225.323773] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.323879] ------------[ cut here ]------------
<4> [225.323881] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.323883] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:1/118
<4> [225.323999] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.324089] efi_pstore nfnetlink autofs4
<4> [225.324095] CPU: 12 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.324099] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.324101] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.324103] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.324110] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.324222] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.324224] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [225.324227] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.324229] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.324231] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.324233] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.324235] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.324237] FS: 0000000000000000(0000) GS:ffff8888db297000(0000) knlGS:0000000000000000
<4> [225.324239] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.324241] CR2: 00005e422c95f1e0 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [225.324243] PKRU: 55555554
<4> [225.324245] Call Trace:
<4> [225.324246] <TASK>
<4> [225.324253] ? lock_sync+0x100/0x100
<4> [225.324260] ? lock_release+0xd0/0x2b0
<4> [225.324269] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.324278] process_one_work+0x239/0x760
<4> [225.324288] worker_thread+0x200/0x3f0
<4> [225.324292] ? __pfx_worker_thread+0x10/0x10
<4> [225.324295] kthread+0x10d/0x150
<4> [225.324299] ? __pfx_kthread+0x10/0x10
<4> [225.324304] ret_from_fork+0x3d4/0x480
<4> [225.324307] ? __pfx_kthread+0x10/0x10
<4> [225.324312] ret_from_fork_asm+0x1a/0x30
<4> [225.324324] </TASK>
<4> [225.324326] irq event stamp: 554105
<4> [225.324327] hardirqs last enabled at (554111): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.324331] hardirqs last disabled at (554116): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.324334] softirqs last enabled at (552250): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.324337] softirqs last disabled at (552245): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.324340] ---[ end trace 0000000000000000 ]---
<6> [225.324343] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.324455] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.324467] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.324519] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.324780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.324912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.325048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.325179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.325309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.325438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.325568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.325705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.325834] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.325974] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.326138] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.327521] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.338381] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.338775] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.340624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.340789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.340908] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.341024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.341135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.341244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.341354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.341464] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.341575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.341688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.341831] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.341953] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.342072] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.342189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.342305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.342420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.342536] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.342647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.342780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.342906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.343028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.343151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.343277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.343393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.343506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.343615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.343727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.343836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.343944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.344049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.344157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.344264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.344378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.344482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.344587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.344690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.344809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.344905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.345000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.345094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.345193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.345289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.345380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.345469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.345561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.345648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.345746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.345827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.345901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.345970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.346042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.346116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.346187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.346258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.346328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.346398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.346466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.346535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.346606] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.346813] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.346818] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43661, lrc_seqno=43661, guc_id=0, flags=0x73 in no process [-1]
<7> [225.346821] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.346876] ------------[ cut here ]------------
<4> [225.346877] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.346878] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:1/118
<4> [225.346943] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.347003] efi_pstore nfnetlink autofs4
<4> [225.347008] CPU: 0 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.347010] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.347011] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.347013] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.347018] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.347082] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.347084] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [225.347086] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.347087] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.347088] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.347090] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.347091] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.347092] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [225.347093] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.347095] CR2: 000000c0005a6000 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [225.347096] PKRU: 55555554
<4> [225.347097] Call Trace:
<4> [225.347098] <TASK>
<4> [225.347102] ? lock_sync+0x100/0x100
<4> [225.347106] ? lock_release+0xd0/0x2b0
<4> [225.347111] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.347116] process_one_work+0x239/0x760
<4> [225.347122] worker_thread+0x200/0x3f0
<4> [225.347125] ? __pfx_worker_thread+0x10/0x10
<4> [225.347127] kthread+0x10d/0x150
<4> [225.347130] ? __pfx_kthread+0x10/0x10
<4> [225.347133] ret_from_fork+0x3d4/0x480
<4> [225.347135] ? __pfx_kthread+0x10/0x10
<4> [225.347138] ret_from_fork_asm+0x1a/0x30
<4> [225.347145] </TASK>
<4> [225.347146] irq event stamp: 557231
<4> [225.347147] hardirqs last enabled at (557237): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.347149] hardirqs last disabled at (557242): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.347151] softirqs last enabled at (556402): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.347154] softirqs last disabled at (556397): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.347156] ---[ end trace 0000000000000000 ]---
<6> [225.347158] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.347221] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.347227] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.347634] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.347834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.347916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.348002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.348084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.348164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.348246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.348327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.348408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.348483] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.348571] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.348690] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.349702] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.359703] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.359965] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.361003] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.361075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.361145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.361213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.361283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.361353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.361422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.361491] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.361558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.361626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.361692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.361776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.361842] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.361909] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.361975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.362041] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.362108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.362173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.362239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.362314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.362388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.362463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.362537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.362608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.362679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.362761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.362830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.362902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.362974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.363045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.363121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.363195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.363274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.363352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.363430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.363505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.363578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.363649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.363724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.363794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.363866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.363937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.364006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.364079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.364155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.364227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.364298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.364367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.364438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.364508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.364579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.364653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.364731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.364801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.364870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.364940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.365008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.365076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.365148] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.365250] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.365254] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43661, lrc_seqno=43661, guc_id=0, flags=0x73 in no process [-1]
<7> [225.365256] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.365309] ------------[ cut here ]------------
<4> [225.365310] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.365311] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:1/118
<4> [225.365376] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.365433] efi_pstore nfnetlink autofs4
<4> [225.365437] CPU: 0 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.365440] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.365441] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.365442] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.365447] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.365512] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.365513] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [225.365515] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.365517] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.365518] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.365519] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.365520] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.365521] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [225.365523] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.365524] CR2: 000000c0005a6000 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [225.365525] PKRU: 55555554
<4> [225.365526] Call Trace:
<4> [225.365527] <TASK>
<4> [225.365531] ? lock_sync+0x100/0x100
<4> [225.365535] ? lock_release+0xd0/0x2b0
<4> [225.365540] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.365545] process_one_work+0x239/0x760
<4> [225.365550] worker_thread+0x200/0x3f0
<4> [225.365552] ? __pfx_worker_thread+0x10/0x10
<4> [225.365555] kthread+0x10d/0x150
<4> [225.365557] ? __pfx_kthread+0x10/0x10
<4> [225.365560] ret_from_fork+0x3d4/0x480
<4> [225.365562] ? __pfx_kthread+0x10/0x10
<4> [225.365565] ret_from_fork_asm+0x1a/0x30
<4> [225.365572] </TASK>
<4> [225.365573] irq event stamp: 560339
<4> [225.365574] hardirqs last enabled at (560345): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.365576] hardirqs last disabled at (560350): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.365578] softirqs last enabled at (559250): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.365581] softirqs last disabled at (559241): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.365583] ---[ end trace 0000000000000000 ]---
<7> [225.366968] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.367114] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [225.367554] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43716, lrc_seqno=43716, guc_id=0, flags=0x73 in no process [-1]
<7> [225.367559] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.367624] ------------[ cut here ]------------
<4> [225.367626] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.367627] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:8/716
<4> [225.367719] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.367791] efi_pstore nfnetlink autofs4
<4> [225.367796] CPU: 10 UID: 0 PID: 716 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.367799] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.367800] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.367801] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.367807] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.367879] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.367880] RSP: 0018:ffffc9000293fca0 EFLAGS: 00010246
<4> [225.367883] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.367884] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.367886] RBP: ffffc9000293fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.367887] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.367888] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.367889] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [225.367891] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.367892] CR2: 0000775911423058 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.367894] PKRU: 55555554
<4> [225.367895] Call Trace:
<4> [225.367896] <TASK>
<4> [225.367900] ? lock_sync+0x100/0x100
<4> [225.367904] ? lock_release+0xd0/0x2b0
<4> [225.367910] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.367916] process_one_work+0x239/0x760
<4> [225.367922] worker_thread+0x200/0x3f0
<4> [225.367925] ? __pfx_worker_thread+0x10/0x10
<4> [225.367927] kthread+0x10d/0x150
<4> [225.367930] ? __pfx_kthread+0x10/0x10
<4> [225.367933] ret_from_fork+0x3d4/0x480
<4> [225.367935] ? __pfx_kthread+0x10/0x10
<4> [225.367939] ret_from_fork_asm+0x1a/0x30
<4> [225.367946] </TASK>
<4> [225.367947] irq event stamp: 533379
<4> [225.367948] hardirqs last enabled at (533385): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.367951] hardirqs last disabled at (533390): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.367953] softirqs last enabled at (532630): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.367956] softirqs last disabled at (532609): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.367958] ---[ end trace 0000000000000000 ]---
<6> [225.367960] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.368033] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.368040] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.368092] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.368505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.368597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.368689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.368799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.368908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.368993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.369079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.369167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.369249] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.369346] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.369463] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.370473] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.381053] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.381295] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.382305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.382377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.382447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.382519] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.382588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.382657] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.382805] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.382910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.382996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.383078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.383158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.383237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.383315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.383393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.383471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.383549] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.383626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.383713] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.383792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.383880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.383967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.384052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.384140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.384224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.384307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.384389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.384474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.384562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.384649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.384741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.384830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.384919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.385010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.385098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.385187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.385273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.385356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.385437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.385524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.385609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.385699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.385783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.385866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.385946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.386031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.386111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.386191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.386271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.386353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.386432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.386511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.386593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.386675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.386766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.386846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.386927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.387009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.387092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.387179] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.387296] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.387301] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43716, lrc_seqno=43716, guc_id=0, flags=0x73 in no process [-1]
<7> [225.387304] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.387366] ------------[ cut here ]------------
<4> [225.387367] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.387369] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:8/716
<4> [225.387445] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.387513] efi_pstore nfnetlink autofs4
<4> [225.387518] CPU: 4 UID: 0 PID: 716 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.387521] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.387522] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.387523] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.387529] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.387603] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.387605] RSP: 0018:ffffc9000293fca0 EFLAGS: 00010246
<4> [225.387607] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.387608] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.387610] RBP: ffffc9000293fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.387611] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.387612] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.387613] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [225.387615] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.387617] CR2: 000000c0005a8600 CR3: 000000000344c003 CR4: 0000000000f72ef0
<4> [225.387618] PKRU: 55555554
<4> [225.387619] Call Trace:
<4> [225.387620] <TASK>
<4> [225.387625] ? lock_sync+0x100/0x100
<4> [225.387629] ? lock_release+0xd0/0x2b0
<4> [225.387635] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.387640] process_one_work+0x239/0x760
<4> [225.387647] worker_thread+0x200/0x3f0
<4> [225.387649] ? __pfx_worker_thread+0x10/0x10
<4> [225.387652] kthread+0x10d/0x150
<4> [225.387655] ? __pfx_kthread+0x10/0x10
<4> [225.387658] ret_from_fork+0x3d4/0x480
<4> [225.387660] ? __pfx_kthread+0x10/0x10
<4> [225.387663] ret_from_fork_asm+0x1a/0x30
<4> [225.387671] </TASK>
<4> [225.387672] irq event stamp: 536491
<4> [225.387673] hardirqs last enabled at (536497): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.387676] hardirqs last disabled at (536502): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.387678] softirqs last enabled at (535610): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.387681] softirqs last disabled at (535603): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.387683] ---[ end trace 0000000000000000 ]---
<6> [225.387685] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.387774] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.387780] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.389089] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.389197] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [225.389396] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.389605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.389702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.389796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.389874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.389953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.390031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.390110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.390189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.390265] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.390353] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.390461] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.391459] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.401703] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.401949] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.402942] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.403014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.403083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.403154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.403223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.403292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.403358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.403425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.403492] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.403558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.403625] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.403691] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.403780] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.403850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.403919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.403988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.404058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.404126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.404193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.404269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.404343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.404415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.404489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.404561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.404633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.404706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.404782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.404856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.404929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.404999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.405070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.405142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.405218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.405294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.405370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.405446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.405521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.405593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.405664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.405744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.405823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.405894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.405967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.406041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.406117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.406189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.406259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.406329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.406399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.406468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.406538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.406608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.406681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.406773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.406850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.406922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.406990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.407058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.407129] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.407236] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.407241] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43716, lrc_seqno=43716, guc_id=0, flags=0x73 in no process [-1]
<7> [225.407243] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.407297] ------------[ cut here ]------------
<4> [225.407298] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.407299] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#1: kworker/u64:1/118
<4> [225.407365] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.407425] efi_pstore nfnetlink autofs4
<4> [225.407430] CPU: 1 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.407433] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.407434] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.407435] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.407440] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.407505] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.407506] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [225.407508] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.407510] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.407511] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.407512] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.407513] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.407514] FS: 0000000000000000(0000) GS:ffff8888dad17000(0000) knlGS:0000000000000000
<4> [225.407516] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.407517] CR2: 000058efdf46ae98 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.407518] PKRU: 55555554
<4> [225.407519] Call Trace:
<4> [225.407520] <TASK>
<4> [225.407524] ? lock_sync+0x100/0x100
<4> [225.407529] ? lock_release+0xd0/0x2b0
<4> [225.407534] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.407540] process_one_work+0x239/0x760
<4> [225.407546] worker_thread+0x200/0x3f0
<4> [225.407548] ? __pfx_worker_thread+0x10/0x10
<4> [225.407551] kthread+0x10d/0x150
<4> [225.407553] ? __pfx_kthread+0x10/0x10
<4> [225.407557] ret_from_fork+0x3d4/0x480
<4> [225.407558] ? __pfx_kthread+0x10/0x10
<4> [225.407562] ret_from_fork_asm+0x1a/0x30
<4> [225.407568] </TASK>
<4> [225.407569] irq event stamp: 566079
<4> [225.407570] hardirqs last enabled at (566085): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.407573] hardirqs last disabled at (566090): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.407575] softirqs last enabled at (565200): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.407578] softirqs last disabled at (565193): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.407580] ---[ end trace 0000000000000000 ]---
<5> [225.408166] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43771, lrc_seqno=43771, guc_id=0, flags=0x73 in no process [-1]
<7> [225.408168] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.408228] ------------[ cut here ]------------
<4> [225.408229] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.408230] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#1: kworker/u64:1/118
<4> [225.408299] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.408362] efi_pstore nfnetlink autofs4
<4> [225.408366] CPU: 1 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.408368] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.408369] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.408371] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.408375] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.408442] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.408444] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [225.408446] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.408447] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.408448] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.408450] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.408451] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.408452] FS: 0000000000000000(0000) GS:ffff8888dad17000(0000) knlGS:0000000000000000
<4> [225.408453] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.408455] CR2: 000058efdf46ae98 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.408456] PKRU: 55555554
<4> [225.408457] Call Trace:
<4> [225.408458] <TASK>
<4> [225.408462] ? lock_sync+0x100/0x100
<4> [225.408466] ? lock_release+0xd0/0x2b0
<4> [225.408471] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.408477] process_one_work+0x239/0x760
<4> [225.408482] worker_thread+0x200/0x3f0
<4> [225.408485] ? __pfx_worker_thread+0x10/0x10
<4> [225.408487] kthread+0x10d/0x150
<4> [225.408490] ? __pfx_kthread+0x10/0x10
<4> [225.408494] ret_from_fork+0x3d4/0x480
<4> [225.408496] ? __pfx_kthread+0x10/0x10
<4> [225.408499] ret_from_fork_asm+0x1a/0x30
<4> [225.408506] </TASK>
<4> [225.408507] irq event stamp: 568757
<4> [225.408508] hardirqs last enabled at (568763): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.408511] hardirqs last disabled at (568768): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.408513] softirqs last enabled at (565200): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.408515] softirqs last disabled at (565193): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.408517] ---[ end trace 0000000000000000 ]---
<6> [225.408519] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.408588] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.408594] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.409497] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.409606] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [225.409720] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.409930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.410022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.410115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.410203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.410290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.410376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.410462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.410549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.410636] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.410770] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.410886] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.411897] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.421702] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.421951] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.423021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.423096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.423165] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.423235] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.423304] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.423372] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.423443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.423513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.423582] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.423650] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.423736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.423811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.423886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.423959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.424032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.424105] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.424179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.424252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.424325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.424406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.424489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.424570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.424650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.424738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.424815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.424892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.424970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.425051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.425132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.425210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.425287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.425364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.425449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.425532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.425614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.425693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.425814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.425896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.425977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.426054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.426134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.426212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.426289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.426365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.426445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.426522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.426599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.426679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.426770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.426847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.426924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.427003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.427080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.427157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.427233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.427310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.427385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.427460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.427541] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.427676] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.427681] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43771, lrc_seqno=43771, guc_id=0, flags=0x73 in no process [-1]
<7> [225.427683] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.427762] ------------[ cut here ]------------
<4> [225.427763] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.427765] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:8/716
<4> [225.427837] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.427904] efi_pstore nfnetlink autofs4
<4> [225.427909] CPU: 11 UID: 0 PID: 716 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.427913] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.427914] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.427916] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.427921] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.427992] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.427994] RSP: 0018:ffffc9000293fca0 EFLAGS: 00010246
<4> [225.427996] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.427998] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.427999] RBP: ffffc9000293fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.428000] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.428001] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.428003] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [225.428004] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.428006] CR2: 00007d95ce1ad000 CR3: 000000012e577005 CR4: 0000000000f72ef0
<4> [225.428007] PKRU: 55555554
<4> [225.428008] Call Trace:
<4> [225.428009] <TASK>
<4> [225.428013] ? lock_sync+0x100/0x100
<4> [225.428018] ? lock_release+0xd0/0x2b0
<4> [225.428024] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.428029] process_one_work+0x239/0x760
<4> [225.428036] worker_thread+0x200/0x3f0
<4> [225.428039] ? __pfx_worker_thread+0x10/0x10
<4> [225.428041] kthread+0x10d/0x150
<4> [225.428044] ? __pfx_kthread+0x10/0x10
<4> [225.428048] ret_from_fork+0x3d4/0x480
<4> [225.428050] ? __pfx_kthread+0x10/0x10
<4> [225.428053] ret_from_fork_asm+0x1a/0x30
<4> [225.428061] </TASK>
<4> [225.428062] irq event stamp: 542551
<4> [225.428063] hardirqs last enabled at (542557): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.428066] hardirqs last disabled at (542562): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.428068] softirqs last enabled at (541636): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.428071] softirqs last disabled at (541629): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.428073] ---[ end trace 0000000000000000 ]---
<6> [225.428075] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.428145] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.428151] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.428557] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.428766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.428854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.428944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.429033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.429119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.429204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.429289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.429375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.429456] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.429552] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.429669] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.430681] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.441414] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.441671] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.442951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.443024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.443093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.443163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.443234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.443303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.443373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.443440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.443507] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.443574] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.443641] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.443713] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.443786] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.443859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.443932] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.444004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.444076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.444149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.444221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.444301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.444385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.444465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.444546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.444623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.444702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.444778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.444856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.444939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.445021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.445100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.445180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.445260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.445343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.445428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.445512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.445596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.445680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.445770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.445851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.445931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.446013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.446095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.446173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.446250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.446331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.446408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.446486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.446564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.446643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.446725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.446801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.446880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.446957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.447033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.447112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.447191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.447268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.447343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.447421] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.447530] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.447535] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43771, lrc_seqno=43771, guc_id=0, flags=0x73 in no process [-1]
<7> [225.447537] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.447596] ------------[ cut here ]------------
<4> [225.447597] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.447599] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:8/716
<4> [225.447670] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.447738] efi_pstore nfnetlink autofs4
<4> [225.447743] CPU: 11 UID: 0 PID: 716 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.447746] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.447747] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.447749] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.447754] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.447825] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.447826] RSP: 0018:ffffc9000293fca0 EFLAGS: 00010246
<4> [225.447829] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.447830] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.447831] RBP: ffffc9000293fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.447833] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.447834] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.447835] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [225.447837] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.447838] CR2: 00007d95ce1ad000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.447840] PKRU: 55555554
<4> [225.447841] Call Trace:
<4> [225.447842] <TASK>
<4> [225.447846] ? lock_sync+0x100/0x100
<4> [225.447850] ? lock_release+0xd0/0x2b0
<4> [225.447855] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.447861] process_one_work+0x239/0x760
<4> [225.447867] worker_thread+0x200/0x3f0
<4> [225.447870] ? __pfx_worker_thread+0x10/0x10
<4> [225.447872] kthread+0x10d/0x150
<4> [225.447875] ? __pfx_kthread+0x10/0x10
<4> [225.447879] ret_from_fork+0x3d4/0x480
<4> [225.447881] ? __pfx_kthread+0x10/0x10
<4> [225.447884] ret_from_fork_asm+0x1a/0x30
<4> [225.447892] </TASK>
<4> [225.447893] irq event stamp: 545687
<4> [225.447894] hardirqs last enabled at (545693): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.447897] hardirqs last disabled at (545698): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.447899] softirqs last enabled at (544778): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.447901] softirqs last disabled at (544773): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.447904] ---[ end trace 0000000000000000 ]---
<7> [225.449563] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.449671] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [225.449782] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43826, lrc_seqno=43826, guc_id=0, flags=0x73 in no process [-1]
<7> [225.449785] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.449845] ------------[ cut here ]------------
<4> [225.449846] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.449847] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:8/716
<4> [225.449919] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.449982] efi_pstore nfnetlink autofs4
<4> [225.449986] CPU: 11 UID: 0 PID: 716 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.449989] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.449990] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.449991] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.449996] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.450066] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.450067] RSP: 0018:ffffc9000293fca0 EFLAGS: 00010246
<4> [225.450069] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.450071] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.450072] RBP: ffffc9000293fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.450073] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.450074] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.450076] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [225.450077] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.450078] CR2: 00007d95ce1ad000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.450080] PKRU: 55555554
<4> [225.450081] Call Trace:
<4> [225.450082] <TASK>
<4> [225.450086] ? lock_sync+0x100/0x100
<4> [225.450090] ? lock_release+0xd0/0x2b0
<4> [225.450095] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.450101] process_one_work+0x239/0x760
<4> [225.450107] worker_thread+0x200/0x3f0
<4> [225.450110] ? __pfx_worker_thread+0x10/0x10
<4> [225.450112] kthread+0x10d/0x150
<4> [225.450115] ? __pfx_kthread+0x10/0x10
<4> [225.450118] ret_from_fork+0x3d4/0x480
<4> [225.450120] ? __pfx_kthread+0x10/0x10
<4> [225.450124] ret_from_fork_asm+0x1a/0x30
<4> [225.450131] </TASK>
<4> [225.450132] irq event stamp: 548941
<4> [225.450133] hardirqs last enabled at (548947): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.450135] hardirqs last disabled at (548952): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.450138] softirqs last enabled at (544778): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.450140] softirqs last disabled at (544773): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.450143] ---[ end trace 0000000000000000 ]---
<6> [225.450144] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.450214] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.450220] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.450349] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.450552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.450642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.450741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.450829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.450915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.451000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.451085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.451173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.451257] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.451352] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.451467] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.452476] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.462702] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.462952] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.464153] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.464238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.464315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.464392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.464468] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.464542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.464616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.464692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.464782] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.464858] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.464932] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.465006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.465079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.465152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.465226] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.465299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.465371] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.465443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.465515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.465595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.465675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.465761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.465845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.465923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.466000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.466076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.466150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.466227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.466304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.466380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.466458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.466535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.466616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.466704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.466791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.466875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.466955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.467032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.467111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.467192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.467273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.467351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.467428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.467504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.467584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.467661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.467746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.467826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.467907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.467985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.468062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.468140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.468217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.468294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.468370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.468445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.468521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.468595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.468678] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.468802] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.468807] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43826, lrc_seqno=43826, guc_id=0, flags=0x73 in no process [-1]
<7> [225.468809] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.468868] ------------[ cut here ]------------
<4> [225.468869] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.468870] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:8/716
<4> [225.468942] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.469005] efi_pstore nfnetlink autofs4
<4> [225.469009] CPU: 11 UID: 0 PID: 716 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.469012] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.469013] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.469015] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.469020] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.469089] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.469091] RSP: 0018:ffffc9000293fca0 EFLAGS: 00010246
<4> [225.469093] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.469095] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.469096] RBP: ffffc9000293fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.469097] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.469098] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.469100] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [225.469101] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.469103] CR2: 00007d95ce1ad000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.469104] PKRU: 55555554
<4> [225.469105] Call Trace:
<4> [225.469106] <TASK>
<4> [225.469110] ? lock_sync+0x100/0x100
<4> [225.469114] ? lock_release+0xd0/0x2b0
<4> [225.469120] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.469126] process_one_work+0x239/0x760
<4> [225.469132] worker_thread+0x200/0x3f0
<4> [225.469134] ? __pfx_worker_thread+0x10/0x10
<4> [225.469137] kthread+0x10d/0x150
<4> [225.469140] ? __pfx_kthread+0x10/0x10
<4> [225.469143] ret_from_fork+0x3d4/0x480
<4> [225.469145] ? __pfx_kthread+0x10/0x10
<4> [225.469148] ret_from_fork_asm+0x1a/0x30
<4> [225.469155] </TASK>
<4> [225.469157] irq event stamp: 552049
<4> [225.469158] hardirqs last enabled at (552055): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.469160] hardirqs last disabled at (552060): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.469163] softirqs last enabled at (551208): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.469165] softirqs last disabled at (551197): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.469168] ---[ end trace 0000000000000000 ]---
<6> [225.469169] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.469239] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.469245] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.470489] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.470593] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [225.470702] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.470911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.471003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.471098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.471185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.471271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.471356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.471441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.471532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.471617] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.471719] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.471836] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.472845] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.483568] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.483814] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.484882] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.484954] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.485023] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.485094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.485162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.485230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.485300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.485370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.485439] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.485507] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.485575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.485643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.485713] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.485787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.485864] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.485940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.486014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.486088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.486161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.486242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.486322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.486401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.486483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.486562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.486639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.486724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.486801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.486880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.486960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.487038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.487117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.487201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.487289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.487374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.487463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.487546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.487627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.487711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.487789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.487863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.487942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.488019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.488094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.488168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.488247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.488324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.488403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.488480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.488556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.488630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.488708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.488786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.488866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.488945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.489022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.489100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.489176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.489254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.489336] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.489447] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.489452] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43826, lrc_seqno=43826, guc_id=0, flags=0x73 in no process [-1]
<7> [225.489454] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.489512] ------------[ cut here ]------------
<4> [225.489514] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.489515] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#1: kworker/u64:1/118
<4> [225.489587] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.489651] efi_pstore nfnetlink autofs4
<4> [225.489656] CPU: 1 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.489659] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.489660] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.489662] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.489667] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.489747] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.489749] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [225.489752] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.489753] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.489755] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.489756] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.489757] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.489759] FS: 0000000000000000(0000) GS:ffff8888dad17000(0000) knlGS:0000000000000000
<4> [225.489761] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.489762] CR2: 000058efdf46ae98 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.489764] PKRU: 55555554
<4> [225.489765] Call Trace:
<4> [225.489766] <TASK>
<4> [225.489770] ? lock_sync+0x100/0x100
<4> [225.489775] ? lock_release+0xd0/0x2b0
<4> [225.489781] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.489786] process_one_work+0x239/0x760
<4> [225.489792] worker_thread+0x200/0x3f0
<4> [225.489795] ? __pfx_worker_thread+0x10/0x10
<4> [225.489798] kthread+0x10d/0x150
<4> [225.489801] ? __pfx_kthread+0x10/0x10
<4> [225.489804] ret_from_fork+0x3d4/0x480
<4> [225.489806] ? __pfx_kthread+0x10/0x10
<4> [225.489810] ret_from_fork_asm+0x1a/0x30
<4> [225.489817] </TASK>
<4> [225.489818] irq event stamp: 572289
<4> [225.489819] hardirqs last enabled at (572295): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.489822] hardirqs last disabled at (572300): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.489824] softirqs last enabled at (571386): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.489827] softirqs last disabled at (571381): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.489829] ---[ end trace 0000000000000000 ]---
<7> [225.491573] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.491728] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [225.491870] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43881, lrc_seqno=43881, guc_id=0, flags=0x73 in no process [-1]
<7> [225.491874] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.491966] ------------[ cut here ]------------
<4> [225.491968] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.491970] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#1: kworker/u64:1/118
<4> [225.492079] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.492202] efi_pstore nfnetlink autofs4
<4> [225.492210] CPU: 1 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.492215] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.492217] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.492220] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.492228] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.492334] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.492337] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [225.492341] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.492343] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.492345] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.492348] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.492350] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.492352] FS: 0000000000000000(0000) GS:ffff8888dad17000(0000) knlGS:0000000000000000
<4> [225.492355] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.492357] CR2: 000058efdf46ae98 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.492360] PKRU: 55555554
<4> [225.492362] Call Trace:
<4> [225.492364] <TASK>
<4> [225.492371] ? lock_sync+0x100/0x100
<4> [225.492379] ? lock_release+0xd0/0x2b0
<4> [225.492389] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.492399] process_one_work+0x239/0x760
<4> [225.492410] worker_thread+0x200/0x3f0
<4> [225.492415] ? __pfx_worker_thread+0x10/0x10
<4> [225.492419] kthread+0x10d/0x150
<4> [225.492424] ? __pfx_kthread+0x10/0x10
<4> [225.492430] ret_from_fork+0x3d4/0x480
<4> [225.492433] ? __pfx_kthread+0x10/0x10
<4> [225.492439] ret_from_fork_asm+0x1a/0x30
<4> [225.492452] </TASK>
<4> [225.492454] irq event stamp: 574443
<4> [225.492456] hardirqs last enabled at (574449): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.492460] hardirqs last disabled at (574454): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.492464] softirqs last enabled at (571386): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.492468] softirqs last disabled at (571381): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.492472] ---[ end trace 0000000000000000 ]---
<6> [225.492475] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.492580] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.492590] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.492830] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.493078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.493207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.493343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.493470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.493596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.493727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.493852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.493980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.494104] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.494242] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.494399] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.495499] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.505708] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.505969] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.507003] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.507082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.507151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.507221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.507290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.507359] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.507432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.507507] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.507582] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.507658] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.507751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.507829] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.507905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.507979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.508052] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.508125] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.508198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.508271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.508344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.508425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.508507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.508587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.508670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.508768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.508847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.508925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.509000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.509081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.509163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.509242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.509323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.509402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.509486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.509568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.509650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.509739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.509818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.509899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.509979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.510055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.510134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.510210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.510286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.510362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.510442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.510519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.510595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.510674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.510765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.510842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.510919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.510998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.511074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.511150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.511225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.511302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.511378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.511453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.511531] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.511643] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.511647] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43881, lrc_seqno=43881, guc_id=0, flags=0x73 in no process [-1]
<7> [225.511650] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.512738] ------------[ cut here ]------------
<4> [225.512743] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.512747] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:1/118
<4> [225.512936] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.513001] efi_pstore nfnetlink autofs4
<4> [225.513029] CPU: 0 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.513033] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.513034] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.513036] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.513041] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.513147] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<7> [225.513074] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<4> [225.513150] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [225.513153] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.513156] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.513157] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.513159] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.513161] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.513163] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [225.513165] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.513167] CR2: 000000c0005a6000 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [225.513168] PKRU: 55555554
<4> [225.513170] Call Trace:
<4> [225.513171] <TASK>
<4> [225.513177] ? lock_sync+0x100/0x100
<4> [225.513184] ? lock_release+0xd0/0x2b0
<4> [225.513193] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.513203] process_one_work+0x239/0x760
<4> [225.513214] worker_thread+0x200/0x3f0
<4> [225.513219] ? __pfx_worker_thread+0x10/0x10
<4> [225.513227] kthread+0x10d/0x150
<4> [225.513231] ? __pfx_kthread+0x10/0x10
<4> [225.513237] ret_from_fork+0x3d4/0x480
<4> [225.513240] ? __pfx_kthread+0x10/0x10
<4> [225.513245] ret_from_fork_asm+0x1a/0x30
<4> [225.513256] </TASK>
<4> [225.513258] irq event stamp: 577585
<4> [225.513260] hardirqs last enabled at (577591): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.513263] hardirqs last disabled at (577596): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.513267] softirqs last enabled at (576814): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.513270] softirqs last disabled at (576807): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.513274] ---[ end trace 0000000000000000 ]---
<7> [225.513231] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<6> [225.513277] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.513390] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.513399] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.513812] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.514017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.514107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.514200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.514290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.514378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.514463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.514553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.514644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.514748] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.514844] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.514960] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.515990] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.526703] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.526976] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.528127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.528206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.528275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.528345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.528414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.528484] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.528552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.528621] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.528688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.528781] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.528857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.528931] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.529006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.529081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.529155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.529229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.529302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.529375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.529448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.529529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.529609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.529692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.529793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.529872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.529950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.530027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.530103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.530181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.530260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.530339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.530418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.530497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.530584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.530674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.530775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.530858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.530938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.531015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.531092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.531168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.531248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.531326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.531404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.531484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.531565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.531644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.531730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.531809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.531887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.531962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.532041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.532123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.532201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.532279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.532355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.532432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.532509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.532585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.532664] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.532786] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.532791] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43881, lrc_seqno=43881, guc_id=0, flags=0x73 in no process [-1]
<7> [225.532793] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.532853] ------------[ cut here ]------------
<4> [225.532854] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.532855] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:1/118
<4> [225.532926] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.532990] efi_pstore nfnetlink autofs4
<4> [225.532994] CPU: 0 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.532997] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.532998] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.533000] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.533005] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.533075] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.533077] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [225.533079] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.533081] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.533082] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.533083] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.533084] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.533086] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [225.533087] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.533089] CR2: 000000c0005a6000 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [225.533090] PKRU: 55555554
<4> [225.533091] Call Trace:
<4> [225.533092] <TASK>
<4> [225.533096] ? lock_sync+0x100/0x100
<4> [225.533101] ? lock_release+0xd0/0x2b0
<4> [225.533106] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.533112] process_one_work+0x239/0x760
<4> [225.533118] worker_thread+0x200/0x3f0
<4> [225.533121] ? __pfx_worker_thread+0x10/0x10
<4> [225.533123] kthread+0x10d/0x150
<4> [225.533126] ? __pfx_kthread+0x10/0x10
<4> [225.533130] ret_from_fork+0x3d4/0x480
<4> [225.533132] ? __pfx_kthread+0x10/0x10
<4> [225.533135] ret_from_fork_asm+0x1a/0x30
<4> [225.533142] </TASK>
<4> [225.533143] irq event stamp: 580703
<4> [225.533145] hardirqs last enabled at (580709): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.533147] hardirqs last disabled at (580714): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.533150] softirqs last enabled at (579684): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.533152] softirqs last disabled at (579677): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.533155] ---[ end trace 0000000000000000 ]---
<5> [225.534155] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43936, lrc_seqno=43936, guc_id=0, flags=0x73 in no process [-1]
<7> [225.534159] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.534253] ------------[ cut here ]------------
<4> [225.534255] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.534257] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:1/118
<4> [225.534365] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.534489] efi_pstore nfnetlink autofs4
<4> [225.534496] CPU: 0 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.534500] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.534503] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.534505] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.534513] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.534618] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.534621] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [225.534625] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.534628] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.534630] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.534632] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.534634] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.534637] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [225.534639] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.534642] CR2: 000000c0005a6000 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [225.534644] PKRU: 55555554
<4> [225.534646] Call Trace:
<4> [225.534648] <TASK>
<4> [225.534655] ? lock_sync+0x100/0x100
<4> [225.534663] ? lock_release+0xd0/0x2b0
<4> [225.534672] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.534682] process_one_work+0x239/0x760
<4> [225.534703] worker_thread+0x200/0x3f0
<4> [225.534708] ? __pfx_worker_thread+0x10/0x10
<4> [225.534712] kthread+0x10d/0x150
<4> [225.534717] ? __pfx_kthread+0x10/0x10
<4> [225.534723] ret_from_fork+0x3d4/0x480
<4> [225.534727] ? __pfx_kthread+0x10/0x10
<4> [225.534732] ret_from_fork_asm+0x1a/0x30
<4> [225.534746] </TASK>
<4> [225.534748] irq event stamp: 583251
<4> [225.534750] hardirqs last enabled at (583257): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.534754] hardirqs last disabled at (583262): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.534758] softirqs last enabled at (583202): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.534762] softirqs last disabled at (583191): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.534766] ---[ end trace 0000000000000000 ]---
<6> [225.536016] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.536126] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.536135] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.536217] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.536366] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [225.536788] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.537038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.537164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.537299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.537426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.537552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.537678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.537834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.537963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.538087] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.538224] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.538382] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.539485] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.549703] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.549955] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.550977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.551056] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.551131] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.551208] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.551282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.551358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.551432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.551507] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.551583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.551658] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.551749] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.551824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.551899] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.551976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.552053] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.552128] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.552201] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.552275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.552348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.552429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.552511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.552589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.552669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.552760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.552843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.552923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.553002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.553082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.553162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.553240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.553319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.553396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.553479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.553563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.553646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.553733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.553819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.553901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.553981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.554059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.554140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.554216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.554293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.554369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.554448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.554524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.554601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.554676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.554768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.554847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.554925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.555005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.555082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.555159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.555234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.555311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.555389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.555469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.555551] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.555662] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.555667] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43936, lrc_seqno=43936, guc_id=0, flags=0x73 in no process [-1]
<7> [225.555669] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.556594] ------------[ cut here ]------------
<4> [225.556595] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.556597] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:1/118
<4> [225.556670] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.556745] efi_pstore nfnetlink autofs4
<4> [225.556750] CPU: 0 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.556753] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.556754] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.556755] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.556761] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.556831] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.556833] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [225.556835] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.556836] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.556838] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.556839] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.556840] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.556841] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [225.556843] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.556844] CR2: 000000c0005a6000 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [225.556846] PKRU: 55555554
<4> [225.556847] Call Trace:
<4> [225.556848] <TASK>
<4> [225.556852] ? lock_sync+0x100/0x100
<4> [225.556857] ? lock_release+0xd0/0x2b0
<4> [225.556863] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.556868] process_one_work+0x239/0x760
<4> [225.556874] worker_thread+0x200/0x3f0
<4> [225.556877] ? __pfx_worker_thread+0x10/0x10
<4> [225.556879] kthread+0x10d/0x150
<4> [225.556882] ? __pfx_kthread+0x10/0x10
<4> [225.556886] ret_from_fork+0x3d4/0x480
<4> [225.556888] ? __pfx_kthread+0x10/0x10
<4> [225.556891] ret_from_fork_asm+0x1a/0x30
<4> [225.556899] </TASK>
<4> [225.556900] irq event stamp: 586371
<4> [225.556901] hardirqs last enabled at (586377): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.556904] hardirqs last disabled at (586382): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.556906] softirqs last enabled at (585262): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.556909] softirqs last disabled at (585255): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.556911] ---[ end trace 0000000000000000 ]---
<6> [225.556913] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.556983] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.556990] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.557005] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.557107] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [225.557398] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.557602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.557696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.557789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.557877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.557962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.558047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.558131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.558217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.558299] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.558393] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.558510] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.559522] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.569700] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.569949] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.570909] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.570988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.571067] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.571144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.571222] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.571298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.571372] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.571446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.571520] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.571592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.571665] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.571748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.571822] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.571893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.571965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.572038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.572110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.572184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.572257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.572337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.572417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.572495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.572577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.572657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.572743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.572821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.572897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.572977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.573059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.573141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.573221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.573300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.573385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.573468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.573551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.573630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.573714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.573791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.573872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.573951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.574031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.574110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.574188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.574264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.574344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.574421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.574497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.574573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.574649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.574731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.574811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.574893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.574972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.575049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.575125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.575205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.575283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.575362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.575442] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.575552] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.575557] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43936, lrc_seqno=43936, guc_id=0, flags=0x73 in no process [-1]
<7> [225.575559] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.575617] ------------[ cut here ]------------
<4> [225.575618] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.575619] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:8/716
<4> [225.575690] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.575760] efi_pstore nfnetlink autofs4
<4> [225.575765] CPU: 11 UID: 0 PID: 716 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.575768] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.575769] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.575771] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.575776] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.575845] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.575847] RSP: 0018:ffffc9000293fca0 EFLAGS: 00010246
<4> [225.575849] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.575850] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.575852] RBP: ffffc9000293fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.575853] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.575854] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.575855] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [225.575857] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.575858] CR2: 00007d95ce1ad000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.575860] PKRU: 55555554
<4> [225.575861] Call Trace:
<4> [225.575862] <TASK>
<4> [225.575866] ? lock_sync+0x100/0x100
<4> [225.575871] ? lock_release+0xd0/0x2b0
<4> [225.575876] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.575882] process_one_work+0x239/0x760
<4> [225.575888] worker_thread+0x200/0x3f0
<4> [225.575891] ? __pfx_worker_thread+0x10/0x10
<4> [225.575893] kthread+0x10d/0x150
<4> [225.575896] ? __pfx_kthread+0x10/0x10
<4> [225.575900] ret_from_fork+0x3d4/0x480
<4> [225.575902] ? __pfx_kthread+0x10/0x10
<4> [225.575905] ret_from_fork_asm+0x1a/0x30
<4> [225.575913] </TASK>
<4> [225.575914] irq event stamp: 557869
<4> [225.575915] hardirqs last enabled at (557875): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.575918] hardirqs last disabled at (557880): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.575920] softirqs last enabled at (556868): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.575922] softirqs last disabled at (556861): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.575925] ---[ end trace 0000000000000000 ]---
<5> [225.576563] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43991, lrc_seqno=43991, guc_id=0, flags=0x73 in no process [-1]
<7> [225.576569] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.576930] ------------[ cut here ]------------
<4> [225.576934] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.576936] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:1/118
<4> [225.577095] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.577224] efi_pstore nfnetlink autofs4
<4> [225.577233] CPU: 0 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.577238] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.577240] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.577243] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.577253] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.577415] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.577419] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [225.577423] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.577426] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.577429] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.577430] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.577433] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.577435] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [225.577438] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.577441] CR2: 000000c0005a6000 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [225.577443] PKRU: 55555554
<4> [225.577445] Call Trace:
<4> [225.577448] <TASK>
<4> [225.577455] ? lock_sync+0x100/0x100
<4> [225.577463] ? lock_release+0xd0/0x2b0
<4> [225.577472] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.577482] process_one_work+0x239/0x760
<4> [225.577493] worker_thread+0x200/0x3f0
<4> [225.577498] ? __pfx_worker_thread+0x10/0x10
<4> [225.577503] kthread+0x10d/0x150
<4> [225.577507] ? __pfx_kthread+0x10/0x10
<4> [225.577513] ret_from_fork+0x3d4/0x480
<4> [225.577517] ? __pfx_kthread+0x10/0x10
<4> [225.577522] ret_from_fork_asm+0x1a/0x30
<4> [225.577536] </TASK>
<4> [225.577538] irq event stamp: 588607
<4> [225.577540] hardirqs last enabled at (588613): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.577545] hardirqs last disabled at (588618): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.577548] softirqs last enabled at (587840): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.577552] softirqs last disabled at (587701): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.577556] ---[ end trace 0000000000000000 ]---
<6> [225.577559] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<7> [225.577564] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<6> [225.577666] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.577678] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.577669] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [225.577968] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.578215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.578346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.578479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.578605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.578746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.578875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.579002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.579131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.579253] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.579390] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.579548] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.580649] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.590703] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.590959] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.592016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.592096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.592174] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.592252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.592329] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.592405] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.592483] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.592558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.592634] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.592715] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.592790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.592866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.592943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.593018] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.593093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.593166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.593240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.593314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.593387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.593467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.593547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.593629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.593716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.593795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.593873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.593950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.594028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.594108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.594192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.594272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.594352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.594433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.594517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.594601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.594689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.594788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.594869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.594946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.595024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.595100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.595179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.595255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.595331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.595405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.595484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.595561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.595640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.595726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.595806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.595881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.595957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.596036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.596112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.596189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.596264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.596341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.596416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.596492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.596575] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.596685] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.596690] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43991, lrc_seqno=43991, guc_id=0, flags=0x73 in no process [-1]
<7> [225.596696] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.596759] ------------[ cut here ]------------
<4> [225.596760] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.596761] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:1/118
<4> [225.596832] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.596896] efi_pstore nfnetlink autofs4
<4> [225.596901] CPU: 0 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.596904] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.596905] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.596906] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.596911] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.596982] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.596983] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [225.596986] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.596987] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.596989] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.596990] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.596991] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.596993] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [225.596994] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.596996] CR2: 000000c0005a6000 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [225.596997] PKRU: 55555554
<4> [225.596998] Call Trace:
<4> [225.596999] <TASK>
<4> [225.597003] ? lock_sync+0x100/0x100
<4> [225.597008] ? lock_release+0xd0/0x2b0
<4> [225.597013] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.597019] process_one_work+0x239/0x760
<4> [225.597025] worker_thread+0x200/0x3f0
<4> [225.597028] ? __pfx_worker_thread+0x10/0x10
<4> [225.597030] kthread+0x10d/0x150
<4> [225.597033] ? __pfx_kthread+0x10/0x10
<4> [225.597036] ret_from_fork+0x3d4/0x480
<4> [225.597038] ? __pfx_kthread+0x10/0x10
<4> [225.597042] ret_from_fork_asm+0x1a/0x30
<4> [225.597049] </TASK>
<4> [225.597050] irq event stamp: 591773
<4> [225.597051] hardirqs last enabled at (591779): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.597054] hardirqs last disabled at (591784): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.597056] softirqs last enabled at (590764): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.597059] softirqs last disabled at (590757): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.597061] ---[ end trace 0000000000000000 ]---
<6> [225.597063] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.597133] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.597139] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.597547] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.597755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.597840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.597929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.598017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.598102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.598186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.598271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.598358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.598439] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.598533] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.598647] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.599660] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.609701] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.609973] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.611341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.611418] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.611494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.611572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.611648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.611736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.611817] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.611893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.611968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.612046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.612122] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.612196] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.612272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.612347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.612421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.612494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.612567] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.612640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.612722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.612803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.612884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.612965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.613046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.613124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.613201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.613277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.613353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.613432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.613511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.613589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.613668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.613754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.613838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.613922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.614004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.614085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.614163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.614239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.614319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.614399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.614480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.614559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.614637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.614719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.614799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.614875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.614953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.615032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.615115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.615193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.615270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.615350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.615427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.615503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.615578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.615655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.615739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.615814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.615895] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.616003] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.616007] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43991, lrc_seqno=43991, guc_id=0, flags=0x73 in no process [-1]
<7> [225.616010] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.616068] ------------[ cut here ]------------
<4> [225.616069] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.616070] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:1/118
<4> [225.616142] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.616205] efi_pstore nfnetlink autofs4
<4> [225.616209] CPU: 0 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.616212] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.616213] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.616214] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.616219] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.616287] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.616289] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [225.616291] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.616293] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.616294] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.616295] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.616296] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.616298] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [225.616299] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.616301] CR2: 000000c0005a6000 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [225.616302] PKRU: 55555554
<4> [225.616303] Call Trace:
<4> [225.616304] <TASK>
<4> [225.616308] ? lock_sync+0x100/0x100
<4> [225.616312] ? lock_release+0xd0/0x2b0
<4> [225.616318] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.616323] process_one_work+0x239/0x760
<4> [225.616329] worker_thread+0x200/0x3f0
<4> [225.616332] ? __pfx_worker_thread+0x10/0x10
<4> [225.616334] kthread+0x10d/0x150
<4> [225.616337] ? __pfx_kthread+0x10/0x10
<4> [225.616341] ret_from_fork+0x3d4/0x480
<4> [225.616343] ? __pfx_kthread+0x10/0x10
<4> [225.616346] ret_from_fork_asm+0x1a/0x30
<4> [225.616353] </TASK>
<4> [225.616355] irq event stamp: 594895
<4> [225.616356] hardirqs last enabled at (594901): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.616358] hardirqs last disabled at (594906): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.616361] softirqs last enabled at (594034): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.616363] softirqs last disabled at (594029): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.616365] ---[ end trace 0000000000000000 ]---
<7> [225.617745] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.617895] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [225.618208] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44046, lrc_seqno=44046, guc_id=0, flags=0x73 in no process [-1]
<7> [225.618211] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.618272] ------------[ cut here ]------------
<4> [225.618274] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.618275] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:8/716
<4> [225.618349] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.618412] efi_pstore nfnetlink autofs4
<4> [225.618416] CPU: 11 UID: 0 PID: 716 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.618419] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.618420] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.618421] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.618426] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.618498] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.618500] RSP: 0018:ffffc9000293fca0 EFLAGS: 00010246
<4> [225.618502] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.618504] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.618505] RBP: ffffc9000293fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.618506] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.618507] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.618509] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [225.618510] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.618511] CR2: 00007d95ce1ad000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.618513] PKRU: 55555554
<4> [225.618514] Call Trace:
<4> [225.618515] <TASK>
<4> [225.618519] ? lock_sync+0x100/0x100
<4> [225.618523] ? lock_release+0xd0/0x2b0
<4> [225.618529] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.618534] process_one_work+0x239/0x760
<4> [225.618540] worker_thread+0x200/0x3f0
<4> [225.618543] ? __pfx_worker_thread+0x10/0x10
<4> [225.618545] kthread+0x10d/0x150
<4> [225.618548] ? __pfx_kthread+0x10/0x10
<4> [225.618552] ret_from_fork+0x3d4/0x480
<4> [225.618554] ? __pfx_kthread+0x10/0x10
<4> [225.618557] ret_from_fork_asm+0x1a/0x30
<4> [225.618565] </TASK>
<4> [225.618566] irq event stamp: 563283
<4> [225.618567] hardirqs last enabled at (563289): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.618570] hardirqs last disabled at (563294): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.618572] softirqs last enabled at (560384): [<ffffffff8133ac33>] kernel_fpu_end+0x53/0x70
<4> [225.618574] softirqs last disabled at (560382): [<ffffffff8133b344>] kernel_fpu_begin_mask+0xc4/0x120
<4> [225.618577] ---[ end trace 0000000000000000 ]---
<6> [225.618578] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.618651] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.618657] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.618900] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.619103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.619194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.619286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.619376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.619466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.619553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.619640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.619740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.619827] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.619924] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.620041] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.621049] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.632037] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.632288] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.633366] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.633446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.633523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.633602] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.633682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.633775] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.633848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.633924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.633997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.634070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.634143] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.634217] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.634290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.634363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.634437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.634508] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.634583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.634663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.634751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.634834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.634914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.634993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.635073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.635150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.635227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.635306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.635384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.635463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.635543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.635621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.635705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.635784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.635868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.635952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.636034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.636114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.636192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.636272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.636353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.636431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.636512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.636590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.636667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.636753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.636832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.636908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.636984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.637060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.637137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.637214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.637294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.637376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.637455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.637532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.637609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.637686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.637775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.637857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.637936] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.638046] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.638051] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44046, lrc_seqno=44046, guc_id=0, flags=0x73 in no process [-1]
<7> [225.638053] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.638110] ------------[ cut here ]------------
<4> [225.638112] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.638113] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:8/716
<4> [225.638185] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.638248] efi_pstore nfnetlink autofs4
<4> [225.638252] CPU: 11 UID: 0 PID: 716 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.638255] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.638256] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.638258] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.638263] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.638333] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.638335] RSP: 0018:ffffc9000293fca0 EFLAGS: 00010246
<4> [225.638337] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.638338] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.638340] RBP: ffffc9000293fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.638341] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.638342] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.638343] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [225.638345] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.638346] CR2: 00007d95ce1ad000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.638348] PKRU: 55555554
<4> [225.638349] Call Trace:
<4> [225.638350] <TASK>
<4> [225.638353] ? lock_sync+0x100/0x100
<4> [225.638358] ? lock_release+0xd0/0x2b0
<4> [225.638363] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.638369] process_one_work+0x239/0x760
<4> [225.638375] worker_thread+0x200/0x3f0
<4> [225.638378] ? __pfx_worker_thread+0x10/0x10
<4> [225.638380] kthread+0x10d/0x150
<4> [225.638383] ? __pfx_kthread+0x10/0x10
<4> [225.638386] ret_from_fork+0x3d4/0x480
<4> [225.638388] ? __pfx_kthread+0x10/0x10
<4> [225.638392] ret_from_fork_asm+0x1a/0x30
<4> [225.638399] </TASK>
<4> [225.638400] irq event stamp: 566423
<4> [225.638401] hardirqs last enabled at (566429): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.638404] hardirqs last disabled at (566434): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.638406] softirqs last enabled at (565368): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.638409] softirqs last disabled at (565361): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.638411] ---[ end trace 0000000000000000 ]---
<6> [225.638413] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.638484] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.638490] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.639725] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.639831] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [225.639937] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.640146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.640240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.640335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.640424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.640512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.640598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.640686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.640793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.640878] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.640973] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.641089] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.642099] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.652701] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.652948] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.653935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.654014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.654090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.654166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.654242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.654320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.654396] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.654472] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.654546] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.654620] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.654697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.654771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.654845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.654918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.654991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.655065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.655138] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.655212] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.655285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.655366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.655449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.655529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.655609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.655686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.655782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.655858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.655934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.656013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.656092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.656172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.656253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.656333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.656418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.656502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.656585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.656666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.656754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.656832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.656908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.656982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.657060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.657137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.657212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.657286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.657365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.657441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.657516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.657591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.657667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.657755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.657833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.657914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.657991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.658067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.658142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.658219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.658293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.658371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.658453] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.658565] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.658570] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44046, lrc_seqno=44046, guc_id=0, flags=0x73 in no process [-1]
<7> [225.658572] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.658630] ------------[ cut here ]------------
<4> [225.658632] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.658633] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:1/118
<4> [225.658707] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.658772] efi_pstore nfnetlink autofs4
<4> [225.658777] CPU: 0 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.658780] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.658781] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.658783] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.658788] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.658856] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.658858] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [225.658861] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.658862] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.658863] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.658864] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.658866] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.658867] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [225.658869] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.658870] CR2: 000000c0005a6000 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [225.658872] PKRU: 55555554
<4> [225.658873] Call Trace:
<4> [225.658874] <TASK>
<4> [225.658878] ? lock_sync+0x100/0x100
<4> [225.658883] ? lock_release+0xd0/0x2b0
<4> [225.658888] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.658894] process_one_work+0x239/0x760
<4> [225.658900] worker_thread+0x200/0x3f0
<4> [225.658902] ? __pfx_worker_thread+0x10/0x10
<4> [225.658905] kthread+0x10d/0x150
<4> [225.658908] ? __pfx_kthread+0x10/0x10
<4> [225.658911] ret_from_fork+0x3d4/0x480
<4> [225.658913] ? __pfx_kthread+0x10/0x10
<4> [225.658917] ret_from_fork_asm+0x1a/0x30
<4> [225.658924] </TASK>
<4> [225.658925] irq event stamp: 598475
<4> [225.658926] hardirqs last enabled at (598481): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.658929] hardirqs last disabled at (598486): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.658931] softirqs last enabled at (597474): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.658934] softirqs last disabled at (597467): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.658936] ---[ end trace 0000000000000000 ]---
<7> [225.659978] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.660123] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [225.660343] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44101, lrc_seqno=44101, guc_id=0, flags=0x73 in no process [-1]
<7> [225.660350] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.660455] ------------[ cut here ]------------
<4> [225.660457] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.660459] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:12/2640
<4> [225.660575] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.660667] efi_pstore nfnetlink autofs4
<4> [225.660674] CPU: 12 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.660677] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.660679] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.660681] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.660689] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.660809] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.660812] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [225.660815] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.660817] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.660820] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.660822] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.660823] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.660826] FS: 0000000000000000(0000) GS:ffff8888db297000(0000) knlGS:0000000000000000
<4> [225.660829] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.660831] CR2: 00005e422c95f1e0 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [225.660833] PKRU: 55555554
<4> [225.660835] Call Trace:
<4> [225.660837] <TASK>
<4> [225.660844] ? lock_sync+0x100/0x100
<4> [225.660852] ? lock_release+0xd0/0x2b0
<4> [225.660861] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.660870] process_one_work+0x239/0x760
<4> [225.660880] worker_thread+0x200/0x3f0
<4> [225.660884] ? __pfx_worker_thread+0x10/0x10
<4> [225.660888] kthread+0x10d/0x150
<4> [225.660892] ? __pfx_kthread+0x10/0x10
<4> [225.660897] ret_from_fork+0x3d4/0x480
<4> [225.660900] ? __pfx_kthread+0x10/0x10
<4> [225.660905] ret_from_fork_asm+0x1a/0x30
<4> [225.660917] </TASK>
<4> [225.660918] irq event stamp: 671693
<4> [225.660920] hardirqs last enabled at (671699): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.660924] hardirqs last disabled at (671704): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.660927] softirqs last enabled at (671532): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.660931] softirqs last disabled at (671525): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.660934] ---[ end trace 0000000000000000 ]---
<6> [225.660946] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.661027] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.661036] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.661093] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.661298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.661390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.661482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.661569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.661656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.661754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.661843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.661932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.662016] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.662133] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.662290] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.663395] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.673705] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.673957] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.675055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.675172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.675255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.675333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.675410] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.675487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.675563] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.675640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.675728] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.675805] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.675879] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.675954] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.676026] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.676099] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.676172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.676247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.676324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.676399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.676474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.676556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.676636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.676721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.676801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.676879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.676958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.677036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.677114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.677195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.677278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.677359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.677440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.677519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.677605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.677687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.677786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.677869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.677953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.678033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.678111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.678188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.678269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.678351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.678431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.678509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.678592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.678670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.678757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.678835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.678917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.678995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.679071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.679149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.679225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.679300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.679374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.679450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.679523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.679601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.679683] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.679816] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.679821] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44101, lrc_seqno=44101, guc_id=0, flags=0x73 in no process [-1]
<7> [225.679823] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.679882] ------------[ cut here ]------------
<4> [225.679883] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.679885] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:12/2640
<4> [225.679957] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.680022] efi_pstore nfnetlink autofs4
<4> [225.680027] CPU: 3 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.680030] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.680031] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.680033] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.680038] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.680108] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.680110] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [225.680112] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.680114] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.680115] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.680116] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.680117] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.680119] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000
<4> [225.680120] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.680122] CR2: 00007d95c40663f8 CR3: 000000012e577001 CR4: 0000000000f72ef0
<4> [225.680123] PKRU: 55555554
<4> [225.680124] Call Trace:
<4> [225.680125] <TASK>
<4> [225.680129] ? lock_sync+0x100/0x100
<4> [225.680134] ? lock_release+0xd0/0x2b0
<4> [225.680139] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.680145] process_one_work+0x239/0x760
<4> [225.680152] worker_thread+0x200/0x3f0
<4> [225.680154] ? __pfx_worker_thread+0x10/0x10
<4> [225.680157] kthread+0x10d/0x150
<4> [225.680160] ? __pfx_kthread+0x10/0x10
<4> [225.680163] ret_from_fork+0x3d4/0x480
<4> [225.680166] ? __pfx_kthread+0x10/0x10
<4> [225.680169] ret_from_fork_asm+0x1a/0x30
<4> [225.680176] </TASK>
<4> [225.680178] irq event stamp: 674867
<4> [225.680179] hardirqs last enabled at (674873): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.680182] hardirqs last disabled at (674878): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.680184] softirqs last enabled at (674026): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.680186] softirqs last disabled at (674005): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.680189] ---[ end trace 0000000000000000 ]---
<6> [225.680190] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.680259] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.680265] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.681509] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.681613] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [225.681724] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.681928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.682017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.682110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.682202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.682293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.682380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.682467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.682554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.682636] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.682740] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.682857] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.683863] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.693700] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.693959] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.695011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.695094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.695171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.695249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.695325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.695400] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.695474] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.695548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.695621] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.695700] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.695774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.695848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.695921] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.695994] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.696068] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.696143] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.696220] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.696295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.696369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.696450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.696532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.696613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.696695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.696773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.696850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.696925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.697001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.697079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.697158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.697235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.697315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.697396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.697482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.697565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.697655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.697746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.697825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.697903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.697979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.698054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.698134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.698216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.698296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.698373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.698453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.698530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.698606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.698685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.698778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.698855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.698930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.699010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.699087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.699163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.699237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.699313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.699386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.699460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.699537] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.699651] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.699655] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44101, lrc_seqno=44101, guc_id=0, flags=0x73 in no process [-1]
<7> [225.699658] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.699728] ------------[ cut here ]------------
<4> [225.699729] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.699731] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:8/716
<4> [225.699802] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.699866] efi_pstore nfnetlink autofs4
<4> [225.699871] CPU: 11 UID: 0 PID: 716 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.699873] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.699875] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.699876] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.699881] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.699951] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.699952] RSP: 0018:ffffc9000293fca0 EFLAGS: 00010246
<4> [225.699954] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.699956] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.699957] RBP: ffffc9000293fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.699958] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.699959] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.699961] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [225.699962] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.699964] CR2: 00007d95ce1ad000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.699965] PKRU: 55555554
<4> [225.699966] Call Trace:
<4> [225.699967] <TASK>
<4> [225.699971] ? lock_sync+0x100/0x100
<4> [225.699976] ? lock_release+0xd0/0x2b0
<4> [225.699981] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.699987] process_one_work+0x239/0x760
<4> [225.699993] worker_thread+0x200/0x3f0
<4> [225.699996] ? __pfx_worker_thread+0x10/0x10
<4> [225.699998] kthread+0x10d/0x150
<4> [225.700001] ? __pfx_kthread+0x10/0x10
<4> [225.700004] ret_from_fork+0x3d4/0x480
<4> [225.700006] ? __pfx_kthread+0x10/0x10
<4> [225.700010] ret_from_fork_asm+0x1a/0x30
<4> [225.700017] </TASK>
<4> [225.700018] irq event stamp: 572287
<4> [225.700019] hardirqs last enabled at (572293): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.700022] hardirqs last disabled at (572298): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.700024] softirqs last enabled at (571372): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.700027] softirqs last disabled at (571365): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.700029] ---[ end trace 0000000000000000 ]---
<5> [225.701505] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44156, lrc_seqno=44156, guc_id=0, flags=0x73 in no process [-1]
<7> [225.701508] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.701578] ------------[ cut here ]------------
<4> [225.701579] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.701582] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:8/716
<4> [225.701654] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.701722] efi_pstore nfnetlink autofs4
<4> [225.701726] CPU: 11 UID: 0 PID: 716 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.701729] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.701730] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.701731] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.701736] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.701804] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.701806] RSP: 0018:ffffc9000293fca0 EFLAGS: 00010246
<4> [225.701808] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.701809] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.701811] RBP: ffffc9000293fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.701812] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.701813] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.701814] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [225.701816] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.701817] CR2: 00007d95ce1ad000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.701819] PKRU: 55555554
<4> [225.701820] Call Trace:
<4> [225.701821] <TASK>
<4> [225.701824] ? lock_sync+0x100/0x100
<4> [225.701828] ? lock_release+0xd0/0x2b0
<4> [225.701834] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.701839] process_one_work+0x239/0x760
<4> [225.701845] worker_thread+0x200/0x3f0
<4> [225.701848] ? __pfx_worker_thread+0x10/0x10
<4> [225.701850] kthread+0x10d/0x150
<4> [225.701853] ? __pfx_kthread+0x10/0x10
<4> [225.701856] ret_from_fork+0x3d4/0x480
<4> [225.701858] ? __pfx_kthread+0x10/0x10
<4> [225.701861] ret_from_fork_asm+0x1a/0x30
<4> [225.701869] </TASK>
<4> [225.701870] irq event stamp: 574833
<4> [225.701871] hardirqs last enabled at (574839): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.701873] hardirqs last disabled at (574844): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.701875] softirqs last enabled at (571372): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.701878] softirqs last disabled at (571365): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.701880] ---[ end trace 0000000000000000 ]---
<7> [225.701894] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.701996] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<6> [225.702095] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.702168] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.702175] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.702265] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.702469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.702557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.702649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.702748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.702838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.702924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.703009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.703097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.703179] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.703276] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.703393] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.704406] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.714702] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.714962] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.716038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.716115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.716190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.716267] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.716343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.716422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.716498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.716573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.716646] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.716731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.716804] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.716876] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.716948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.717021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.717093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.717166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.717239] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.717311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.717384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.717464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.717543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.717619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.717707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.717788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.717866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.717945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.718021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.718100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.718179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.718257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.718335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.718413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.718497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.718579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.718663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.718753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.718833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.718910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.718989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.719068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.719149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.719228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.719305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.719381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.719462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.719540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.719621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.719702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.719782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.719858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.719935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.720046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.720139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.720224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.720300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.720378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.720458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.720536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.720616] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.720735] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.720739] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44156, lrc_seqno=44156, guc_id=0, flags=0x73 in no process [-1]
<7> [225.720742] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.720800] ------------[ cut here ]------------
<4> [225.720801] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.720802] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:8/716
<4> [225.720873] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.720935] efi_pstore nfnetlink autofs4
<4> [225.720939] CPU: 11 UID: 0 PID: 716 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.720942] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.720943] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.720945] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.720950] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.721019] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.721021] RSP: 0018:ffffc9000293fca0 EFLAGS: 00010246
<4> [225.721023] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.721024] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.721026] RBP: ffffc9000293fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.721027] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.721028] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.721029] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [225.721031] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.721032] CR2: 00007d95ce1ad000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.721034] PKRU: 55555554
<4> [225.721035] Call Trace:
<4> [225.721036] <TASK>
<4> [225.721040] ? lock_sync+0x100/0x100
<4> [225.721044] ? lock_release+0xd0/0x2b0
<4> [225.721050] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.721055] process_one_work+0x239/0x760
<4> [225.721061] worker_thread+0x200/0x3f0
<4> [225.721064] ? __pfx_worker_thread+0x10/0x10
<4> [225.721066] kthread+0x10d/0x150
<4> [225.721069] ? __pfx_kthread+0x10/0x10
<4> [225.721073] ret_from_fork+0x3d4/0x480
<4> [225.721075] ? __pfx_kthread+0x10/0x10
<4> [225.721078] ret_from_fork_asm+0x1a/0x30
<4> [225.721085] </TASK>
<4> [225.721087] irq event stamp: 577965
<4> [225.721088] hardirqs last enabled at (577971): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.721091] hardirqs last disabled at (577976): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.721093] softirqs last enabled at (577148): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.721095] softirqs last disabled at (577137): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.721097] ---[ end trace 0000000000000000 ]---
<6> [225.721099] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.721169] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.721175] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.722422] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.722528] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [225.722634] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.722848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.722940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.723034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.723126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.723215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.723302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.723389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.723476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.723558] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.723654] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.723784] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.724795] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.735530] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.735805] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.736775] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.736851] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.736921] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.736992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.737064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.737134] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.737203] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.737272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.737340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.737409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.737476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.737543] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.737610] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.737676] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.737761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.737835] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.737909] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.737986] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.738061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.738144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.738225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.738304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.738383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.738460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.738536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.738611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.738686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.738800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.738882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.738962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.739041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.739120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.739204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.739288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.739374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.739457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.739538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.739615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.739700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.739804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.739886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.739964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.740043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.740119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.740200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.740276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.740357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.740437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.740519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.740597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.740673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.740775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.740853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.740929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.741003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.741079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.741155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.741235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.741317] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.741429] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.741433] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44156, lrc_seqno=44156, guc_id=0, flags=0x73 in no process [-1]
<7> [225.741436] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.741495] ------------[ cut here ]------------
<4> [225.741496] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.741497] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:12/2640
<4> [225.741569] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.741633] efi_pstore nfnetlink autofs4
<4> [225.741638] CPU: 3 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.741641] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.741642] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.741644] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.741649] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.741741] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.741743] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [225.741745] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.741747] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.741749] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.741750] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.741751] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.741753] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000
<4> [225.741754] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.741756] CR2: 00007d95c40663f8 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [225.741757] PKRU: 55555554
<4> [225.741759] Call Trace:
<4> [225.741760] <TASK>
<4> [225.741764] ? lock_sync+0x100/0x100
<4> [225.741769] ? lock_release+0xd0/0x2b0
<4> [225.741775] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.741780] process_one_work+0x239/0x760
<4> [225.741786] worker_thread+0x200/0x3f0
<4> [225.741789] ? __pfx_worker_thread+0x10/0x10
<4> [225.741792] kthread+0x10d/0x150
<4> [225.741795] ? __pfx_kthread+0x10/0x10
<4> [225.741798] ret_from_fork+0x3d4/0x480
<4> [225.741801] ? __pfx_kthread+0x10/0x10
<4> [225.741804] ret_from_fork_asm+0x1a/0x30
<4> [225.741811] </TASK>
<4> [225.741813] irq event stamp: 678369
<4> [225.741814] hardirqs last enabled at (678375): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.741817] hardirqs last disabled at (678380): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.741819] softirqs last enabled at (677472): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.741825] softirqs last disabled at (677467): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.741827] ---[ end trace 0000000000000000 ]---
<5> [225.742423] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44211, lrc_seqno=44211, guc_id=0, flags=0x73 in no process [-1]
<7> [225.742426] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.742485] ------------[ cut here ]------------
<4> [225.742486] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.742488] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:12/2640
<4> [225.742559] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.742621] efi_pstore nfnetlink autofs4
<4> [225.742625] CPU: 3 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.742628] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.742629] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.742630] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.742635] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.742711] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.742712] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [225.742715] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.742718] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.742720] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.742721] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.742740] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.742741] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000
<4> [225.742743] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.742744] CR2: 00007d95c40663f8 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [225.742746] PKRU: 55555554
<4> [225.742747] Call Trace:
<4> [225.742748] <TASK>
<4> [225.742752] ? lock_sync+0x100/0x100
<4> [225.742756] ? lock_release+0xd0/0x2b0
<4> [225.742761] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.742767] process_one_work+0x239/0x760
<4> [225.742773] worker_thread+0x200/0x3f0
<4> [225.742776] ? __pfx_worker_thread+0x10/0x10
<4> [225.742779] kthread+0x10d/0x150
<4> [225.742782] ? __pfx_kthread+0x10/0x10
<4> [225.742785] ret_from_fork+0x3d4/0x480
<4> [225.742787] ? __pfx_kthread+0x10/0x10
<4> [225.742790] ret_from_fork_asm+0x1a/0x30
<4> [225.742798] </TASK>
<4> [225.742799] irq event stamp: 681107
<4> [225.742800] hardirqs last enabled at (681113): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.742803] hardirqs last disabled at (681118): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.742805] softirqs last enabled at (677472): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.742807] softirqs last disabled at (677467): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.742810] ---[ end trace 0000000000000000 ]---
<6> [225.743615] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.743688] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<7> [225.743709] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.743824] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<6> [225.743926] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.743979] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.744183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.744273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.744371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.744459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.744549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.744636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.744731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.744820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.744902] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.744997] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.745112] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.746128] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.756701] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.756975] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.758060] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.758139] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.758215] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.758292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.758368] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.758442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.758520] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.758595] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.758671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.758759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.758833] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.758907] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.758979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.759052] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.759125] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.759200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.759274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.759347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.759420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.759500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.759582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.759661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.759768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.759845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.759921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.759997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.760073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.760151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.760230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.760307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.760385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.760462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.760547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.760634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.760750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.760833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.760915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.760993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.761070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.761147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.761232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.761311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.761391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.761468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.761546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.761622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.761702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.761793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.761869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.761942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.762016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.762097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.762176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.762254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.762331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.762409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.762484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.762560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.762639] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.762766] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.762769] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44211, lrc_seqno=44211, guc_id=0, flags=0x73 in no process [-1]
<7> [225.762772] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.762830] ------------[ cut here ]------------
<4> [225.762831] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.762832] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:8/716
<4> [225.762904] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.762968] efi_pstore nfnetlink autofs4
<4> [225.762973] CPU: 11 UID: 0 PID: 716 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.762976] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.762977] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.762978] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.762983] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.763052] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.763054] RSP: 0018:ffffc9000293fca0 EFLAGS: 00010246
<4> [225.763056] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.763058] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.763059] RBP: ffffc9000293fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.763060] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.763062] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.763063] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [225.763064] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.763066] CR2: 00007d95ce1ad000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.763067] PKRU: 55555554
<4> [225.763069] Call Trace:
<4> [225.763070] <TASK>
<4> [225.763074] ? lock_sync+0x100/0x100
<4> [225.763078] ? lock_release+0xd0/0x2b0
<4> [225.763084] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.763089] process_one_work+0x239/0x760
<4> [225.763096] worker_thread+0x200/0x3f0
<4> [225.763098] ? __pfx_worker_thread+0x10/0x10
<4> [225.763101] kthread+0x10d/0x150
<4> [225.763104] ? __pfx_kthread+0x10/0x10
<4> [225.763107] ret_from_fork+0x3d4/0x480
<4> [225.763109] ? __pfx_kthread+0x10/0x10
<4> [225.763113] ret_from_fork_asm+0x1a/0x30
<4> [225.763120] </TASK>
<4> [225.763121] irq event stamp: 581415
<4> [225.763122] hardirqs last enabled at (581421): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.763125] hardirqs last disabled at (581426): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.763127] softirqs last enabled at (580574): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.763130] softirqs last disabled at (580517): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.763132] ---[ end trace 0000000000000000 ]---
<6> [225.763134] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.763204] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.763211] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.764468] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.764574] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [225.764681] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.764903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.764991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.765083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.765171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.765256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.765340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.765423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.765509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.765590] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.765684] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.765819] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.766828] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.777552] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.777800] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.778869] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.778941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.779009] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.779079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.779150] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.779219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.779289] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.779356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.779425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.779493] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.779561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.779627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.779700] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.779774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.779848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.779922] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.779995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.780067] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.780140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.780222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.780302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.780382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.780466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.780546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.780624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.780706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.780783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.780861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.780940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.781019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.781101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.781181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.781266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.781352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.781436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.781516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.781596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.781673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.781759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.781835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.781914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.781990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.782066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.782141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.782220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.782299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.782379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.782458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.782537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.782612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.782688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.782783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.782862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.782942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.783019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.783097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.783172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.783247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.783326] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.783442] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.783446] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44211, lrc_seqno=44211, guc_id=0, flags=0x73 in no process [-1]
<7> [225.783449] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.783509] ------------[ cut here ]------------
<4> [225.783510] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.783511] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/118
<4> [225.783583] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.783647] efi_pstore nfnetlink autofs4
<4> [225.783652] CPU: 10 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.783655] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.783656] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.783657] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.783663] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.783743] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.783745] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [225.783747] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.783749] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.783750] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.783752] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.783753] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.783754] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [225.783756] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.783758] CR2: 0000775911423058 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.783759] PKRU: 55555554
<4> [225.783761] Call Trace:
<4> [225.783762] <TASK>
<4> [225.783766] ? lock_sync+0x100/0x100
<4> [225.783770] ? lock_release+0xd0/0x2b0
<4> [225.783776] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.783781] process_one_work+0x239/0x760
<4> [225.783787] worker_thread+0x200/0x3f0
<4> [225.783790] ? __pfx_worker_thread+0x10/0x10
<4> [225.783793] kthread+0x10d/0x150
<4> [225.783795] ? __pfx_kthread+0x10/0x10
<4> [225.783799] ret_from_fork+0x3d4/0x480
<4> [225.783801] ? __pfx_kthread+0x10/0x10
<4> [225.783805] ret_from_fork_asm+0x1a/0x30
<4> [225.783812] </TASK>
<4> [225.783813] irq event stamp: 606563
<4> [225.783814] hardirqs last enabled at (606569): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.783817] hardirqs last disabled at (606574): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.783820] softirqs last enabled at (605666): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.783822] softirqs last disabled at (605655): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.783825] ---[ end trace 0000000000000000 ]---
<7> [225.785103] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.785245] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [225.785607] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44266, lrc_seqno=44266, guc_id=0, flags=0x73 in no process [-1]
<7> [225.785610] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.785669] ------------[ cut here ]------------
<4> [225.785670] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.785671] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:1/118
<4> [225.785758] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.785821] efi_pstore nfnetlink autofs4
<4> [225.785826] CPU: 11 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.785829] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.785830] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.785832] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.785837] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.785907] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.785909] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [225.785911] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.785912] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.785914] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.785915] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.785916] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.785917] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [225.785919] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.785920] CR2: 00007d95ce1ad000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.785922] PKRU: 55555554
<4> [225.785923] Call Trace:
<4> [225.785924] <TASK>
<4> [225.785928] ? lock_sync+0x100/0x100
<4> [225.785932] ? lock_release+0xd0/0x2b0
<4> [225.785937] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.785943] process_one_work+0x239/0x760
<4> [225.785949] worker_thread+0x200/0x3f0
<4> [225.785951] ? __pfx_worker_thread+0x10/0x10
<4> [225.785954] kthread+0x10d/0x150
<4> [225.785957] ? __pfx_kthread+0x10/0x10
<4> [225.785960] ret_from_fork+0x3d4/0x480
<4> [225.785962] ? __pfx_kthread+0x10/0x10
<4> [225.785966] ret_from_fork_asm+0x1a/0x30
<4> [225.785973] </TASK>
<4> [225.785974] irq event stamp: 609023
<4> [225.785975] hardirqs last enabled at (609029): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.785977] hardirqs last disabled at (609034): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.785980] softirqs last enabled at (608274): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.785982] softirqs last disabled at (608267): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.785984] ---[ end trace 0000000000000000 ]---
<6> [225.785986] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.786056] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.786063] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.786201] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.786414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.786509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.786604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.786698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.786813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.786901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.786992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.787084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.787168] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.787263] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.787381] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.788393] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.798701] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.798952] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.800000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.800078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.800156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.800234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.800311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.800388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.800462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.800535] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.800608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.800681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.800771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.800844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.800917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.800990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.801061] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.801133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.801205] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.801278] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.801350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.801432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.801515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.801597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.801677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.801769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.801845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.801921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.802001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.802082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.802163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.802242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.802321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.802399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.802483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.802568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.802656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.802751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.802831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.802911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.802989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.803066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.803145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.803223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.803301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.803376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.803455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.803531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.803608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.803683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.803777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.803857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.803936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.804018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.804096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.804172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.804246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.804322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.804396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.804470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.804548] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.804660] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.804664] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44266, lrc_seqno=44266, guc_id=0, flags=0x73 in no process [-1]
<7> [225.804666] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.805582] ------------[ cut here ]------------
<4> [225.805584] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.805585] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:12/2640
<4> [225.805658] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.805729] efi_pstore nfnetlink autofs4
<4> [225.805734] CPU: 3 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.805737] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.805739] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.805740] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.805745] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.805817] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.805819] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [225.805821] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.805822] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.805824] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.805825] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.805826] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.805827] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000
<4> [225.805829] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.805830] CR2: 00007d95c40663f8 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [225.805832] PKRU: 55555554
<4> [225.805833] Call Trace:
<4> [225.805834] <TASK>
<4> [225.805838] ? lock_sync+0x100/0x100
<4> [225.805843] ? lock_release+0xd0/0x2b0
<4> [225.805848] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.805854] process_one_work+0x239/0x760
<4> [225.805860] worker_thread+0x200/0x3f0
<4> [225.805863] ? __pfx_worker_thread+0x10/0x10
<4> [225.805865] kthread+0x10d/0x150
<4> [225.805868] ? __pfx_kthread+0x10/0x10
<4> [225.805872] ret_from_fork+0x3d4/0x480
<4> [225.805874] ? __pfx_kthread+0x10/0x10
<4> [225.805877] ret_from_fork_asm+0x1a/0x30
<4> [225.805884] </TASK>
<4> [225.805885] irq event stamp: 686741
<4> [225.805886] hardirqs last enabled at (686747): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.805889] hardirqs last disabled at (686752): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.805891] softirqs last enabled at (685820): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.805894] softirqs last disabled at (685813): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.805896] ---[ end trace 0000000000000000 ]---
<6> [225.805898] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.805969] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.805976] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.805990] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.806093] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [225.806386] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.806597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.806690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.806821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.806910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.806997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.807083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.807171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.807259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.807341] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.807436] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.807552] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.808574] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.818699] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.818946] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.820019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.820098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.820176] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.820254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.820331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.820406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.820480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.820554] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.820627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.820705] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.820779] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.820852] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.820925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.821000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.821077] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.821152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.821227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.821301] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.821375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.821456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.821535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.821614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.821699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.821779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.821858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.821935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.822011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.822091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.822169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.822247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.822330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.822411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.822495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.822579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.822663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.822762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.822847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.822930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.823010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.823088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.823169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.823247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.823324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.823400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.823480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.823555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.823633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.823714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.823792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.823868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.823944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.824025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.824103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.824180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.824256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.824333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.824411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.824491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.824573] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.824948] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.824953] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44266, lrc_seqno=44266, guc_id=0, flags=0x73 in no process [-1]
<7> [225.824956] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.825016] ------------[ cut here ]------------
<4> [225.825017] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.825018] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:8/716
<4> [225.825090] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.825153] efi_pstore nfnetlink autofs4
<4> [225.825158] CPU: 11 UID: 0 PID: 716 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.825161] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.825162] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.825163] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.825168] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.825238] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.825239] RSP: 0018:ffffc9000293fca0 EFLAGS: 00010246
<4> [225.825241] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.825243] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.825244] RBP: ffffc9000293fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.825245] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.825246] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.825248] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [225.825249] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.825251] CR2: 00007d95ce1ad000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.825252] PKRU: 55555554
<4> [225.825253] Call Trace:
<4> [225.825254] <TASK>
<4> [225.825258] ? lock_sync+0x100/0x100
<4> [225.825263] ? lock_release+0xd0/0x2b0
<4> [225.825268] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.825274] process_one_work+0x239/0x760
<4> [225.825280] worker_thread+0x200/0x3f0
<4> [225.825282] ? __pfx_worker_thread+0x10/0x10
<4> [225.825285] kthread+0x10d/0x150
<4> [225.825287] ? __pfx_kthread+0x10/0x10
<4> [225.825291] ret_from_fork+0x3d4/0x480
<4> [225.825293] ? __pfx_kthread+0x10/0x10
<4> [225.825296] ret_from_fork_asm+0x1a/0x30
<4> [225.825304] </TASK>
<4> [225.825305] irq event stamp: 585059
<4> [225.825306] hardirqs last enabled at (585065): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.825309] hardirqs last disabled at (585070): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.825311] softirqs last enabled at (584138): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.825313] softirqs last disabled at (584131): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.825315] ---[ end trace 0000000000000000 ]---
<7> [225.826705] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.826812] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [225.827122] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44321, lrc_seqno=44321, guc_id=0, flags=0x73 in no process [-1]
<7> [225.827124] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.827185] ------------[ cut here ]------------
<4> [225.827186] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.827188] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:12/2640
<4> [225.827257] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.827320] efi_pstore nfnetlink autofs4
<4> [225.827324] CPU: 3 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.827327] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.827328] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.827329] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.827334] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.827402] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.827403] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [225.827405] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.827407] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.827408] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.827409] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.827410] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.827412] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000
<4> [225.827413] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.827414] CR2: 00007d95c40663f8 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [225.827416] PKRU: 55555554
<4> [225.827417] Call Trace:
<4> [225.827418] <TASK>
<4> [225.827422] ? lock_sync+0x100/0x100
<4> [225.827426] ? lock_release+0xd0/0x2b0
<4> [225.827431] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.827437] process_one_work+0x239/0x760
<4> [225.827443] worker_thread+0x200/0x3f0
<4> [225.827446] ? __pfx_worker_thread+0x10/0x10
<4> [225.827448] kthread+0x10d/0x150
<4> [225.827451] ? __pfx_kthread+0x10/0x10
<4> [225.827454] ret_from_fork+0x3d4/0x480
<4> [225.827456] ? __pfx_kthread+0x10/0x10
<4> [225.827459] ret_from_fork_asm+0x1a/0x30
<4> [225.827467] </TASK>
<4> [225.827468] irq event stamp: 690439
<4> [225.827469] hardirqs last enabled at (690445): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.827471] hardirqs last disabled at (690450): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.827474] softirqs last enabled at (687514): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.827476] softirqs last disabled at (687509): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.827478] ---[ end trace 0000000000000000 ]---
<6> [225.827480] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.827550] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.827556] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.827709] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.827913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.828003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.828096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.828183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.828269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.828353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.828439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.828523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.828609] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.828709] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.828826] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.829836] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.839702] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.839952] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.841024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.841107] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.841184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.841262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.841339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.841413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.841487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.841561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.841635] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.841717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.841793] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.841870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.841945] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.842021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.842096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.842169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.842243] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.842317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.842389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.842471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.842550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.842628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.842722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.842801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.842879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.842957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.843033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.843113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.843193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.843270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.843347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.843426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.843508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.843591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.843673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.843767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.843847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.843925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.844006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.844086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.844168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.844246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.844323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.844399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.844479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.844555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.844630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.844706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.844784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.844859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.844935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.845013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.845088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.845163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.845237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.845313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.845387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.845462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.845541] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.845652] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.845656] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44321, lrc_seqno=44321, guc_id=0, flags=0x73 in no process [-1]
<7> [225.845658] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.845734] ------------[ cut here ]------------
<4> [225.845735] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.845737] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:12/2640
<4> [225.845809] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.845872] efi_pstore nfnetlink autofs4
<4> [225.845876] CPU: 3 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.845879] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.845880] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.845882] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.845886] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.845956] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.845958] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [225.845960] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.845961] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.845963] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.845964] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.845965] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.845966] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000
<4> [225.845968] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.845969] CR2: 00007d95c40663f8 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [225.845971] PKRU: 55555554
<4> [225.845972] Call Trace:
<4> [225.845973] <TASK>
<4> [225.845977] ? lock_sync+0x100/0x100
<4> [225.845981] ? lock_release+0xd0/0x2b0
<4> [225.845987] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.845992] process_one_work+0x239/0x760
<4> [225.845998] worker_thread+0x200/0x3f0
<4> [225.846001] ? __pfx_worker_thread+0x10/0x10
<4> [225.846003] kthread+0x10d/0x150
<4> [225.846006] ? __pfx_kthread+0x10/0x10
<4> [225.846010] ret_from_fork+0x3d4/0x480
<4> [225.846011] ? __pfx_kthread+0x10/0x10
<4> [225.846015] ret_from_fork_asm+0x1a/0x30
<4> [225.846022] </TASK>
<4> [225.846023] irq event stamp: 693623
<4> [225.846024] hardirqs last enabled at (693629): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.846027] hardirqs last disabled at (693634): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.846029] softirqs last enabled at (692856): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.846032] softirqs last disabled at (692845): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.846034] ---[ end trace 0000000000000000 ]---
<6> [225.846035] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.846106] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.846113] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.847350] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.847455] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [225.847561] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.847786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.847879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.847972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.848062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.848148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.848233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.848319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.848406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.848490] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.848583] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.848702] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.849712] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.860438] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.860690] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.861776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.861857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.861934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.862010] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.862086] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.862161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.862236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.862309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.862383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.862459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.862535] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.862610] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.862683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.862773] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.862846] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.862919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.862992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.863065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.863137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.863217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.863297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.863377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.863459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.863539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.863617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.863698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.863775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.863853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.863931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.864009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.864089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.864166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.864250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.864335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.864422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.864503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.864584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.864661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.864747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.864823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.864902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.864979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.865055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.865130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.865209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.865286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.865363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.865438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.865515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.865588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.865663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.865759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.865839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.865918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.865993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.866070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.866144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.866219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.866298] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.866409] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.866414] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44321, lrc_seqno=44321, guc_id=0, flags=0x73 in no process [-1]
<7> [225.866416] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.866474] ------------[ cut here ]------------
<4> [225.866475] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.866477] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:1/118
<4> [225.866548] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.866612] efi_pstore nfnetlink autofs4
<4> [225.866617] CPU: 8 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.866620] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.866621] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.866623] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.866628] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.866703] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.866706] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [225.866711] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.866713] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.866714] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.866716] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.866717] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.866719] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [225.866720] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.866722] CR2: 000077f8abad2008 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [225.866723] PKRU: 55555554
<4> [225.866724] Call Trace:
<4> [225.866725] <TASK>
<4> [225.866729] ? lock_sync+0x100/0x100
<4> [225.866734] ? lock_release+0xd0/0x2b0
<4> [225.866740] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.866745] process_one_work+0x239/0x760
<4> [225.866752] worker_thread+0x200/0x3f0
<4> [225.866754] ? __pfx_worker_thread+0x10/0x10
<4> [225.866757] kthread+0x10d/0x150
<4> [225.866760] ? __pfx_kthread+0x10/0x10
<4> [225.866763] ret_from_fork+0x3d4/0x480
<4> [225.866766] ? __pfx_kthread+0x10/0x10
<4> [225.866769] ret_from_fork_asm+0x1a/0x30
<4> [225.866776] </TASK>
<4> [225.866777] irq event stamp: 617755
<4> [225.866779] hardirqs last enabled at (617761): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.866781] hardirqs last disabled at (617766): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.866784] softirqs last enabled at (616858): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.866786] softirqs last disabled at (616853): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.866789] ---[ end trace 0000000000000000 ]---
<5> [225.868279] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44376, lrc_seqno=44376, guc_id=0, flags=0x73 in no process [-1]
<7> [225.868282] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.868344] ------------[ cut here ]------------
<4> [225.868345] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.868346] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:1/118
<4> [225.868415] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.868477] efi_pstore nfnetlink autofs4
<4> [225.868481] CPU: 8 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.868483] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.868485] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.868486] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.868491] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.868558] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.868559] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [225.868562] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.868563] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.868564] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.868565] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.868567] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.868568] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [225.868569] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.868571] CR2: 000077f8abad2008 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [225.868572] PKRU: 55555554
<4> [225.868573] Call Trace:
<4> [225.868574] <TASK>
<4> [225.868578] ? lock_sync+0x100/0x100
<4> [225.868582] ? lock_release+0xd0/0x2b0
<4> [225.868587] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.868593] process_one_work+0x239/0x760
<4> [225.868599] worker_thread+0x200/0x3f0
<4> [225.868601] ? __pfx_worker_thread+0x10/0x10
<4> [225.868604] kthread+0x10d/0x150
<4> [225.868607] ? __pfx_kthread+0x10/0x10
<4> [225.868610] ret_from_fork+0x3d4/0x480
<4> [225.868612] ? __pfx_kthread+0x10/0x10
<4> [225.868615] ret_from_fork_asm+0x1a/0x30
<4> [225.868622] </TASK>
<4> [225.868623] irq event stamp: 620429
<4> [225.868624] hardirqs last enabled at (620435): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.868627] hardirqs last disabled at (620440): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.868629] softirqs last enabled at (616858): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.868631] softirqs last disabled at (616853): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.868634] ---[ end trace 0000000000000000 ]---
<6> [225.868635] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<7> [225.868720] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.868824] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<6> [225.868924] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.868929] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.868976] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.869181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.869271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.869364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.869451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.869538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.869624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.869716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.869809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.869893] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.869988] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.870102] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.871110] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.881698] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.881948] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.883008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.883087] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.883164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.883242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.883316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.883389] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.883462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.883536] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.883608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.883681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.883781] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.883865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.883945] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.884022] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.884098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.884172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.884245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.884318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.884391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.884473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.884553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.884634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.884721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.884798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.884874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.884951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.885025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.885104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.885181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.885260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.885338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.885416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.885500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.885587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.885673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.885766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.885849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.885928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.886007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.886083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.886163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.886244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.886325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.886403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.886484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.886561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.886638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.886718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.886797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.886875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.886952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.887032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.887110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.887186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.887261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.887337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.887415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.887493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.887573] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.887689] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.887699] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44376, lrc_seqno=44376, guc_id=0, flags=0x73 in no process [-1]
<7> [225.887702] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.887762] ------------[ cut here ]------------
<4> [225.887763] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.887764] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/118
<4> [225.887836] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.887900] efi_pstore nfnetlink autofs4
<4> [225.887904] CPU: 10 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.887907] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.887908] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.887910] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.887915] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.887984] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.887985] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [225.887988] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.887989] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.887990] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.887991] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.887993] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.887994] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [225.887996] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.887997] CR2: 0000775911423058 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.887998] PKRU: 55555554
<4> [225.888000] Call Trace:
<4> [225.888001] <TASK>
<4> [225.888004] ? lock_sync+0x100/0x100
<4> [225.888009] ? lock_release+0xd0/0x2b0
<4> [225.888014] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.888020] process_one_work+0x239/0x760
<4> [225.888026] worker_thread+0x200/0x3f0
<4> [225.888028] ? __pfx_worker_thread+0x10/0x10
<4> [225.888031] kthread+0x10d/0x150
<4> [225.888034] ? __pfx_kthread+0x10/0x10
<4> [225.888037] ret_from_fork+0x3d4/0x480
<4> [225.888039] ? __pfx_kthread+0x10/0x10
<4> [225.888043] ret_from_fork_asm+0x1a/0x30
<4> [225.888050] </TASK>
<4> [225.888051] irq event stamp: 623573
<4> [225.888052] hardirqs last enabled at (623579): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.888055] hardirqs last disabled at (623584): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.888057] softirqs last enabled at (622564): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.888060] softirqs last disabled at (622557): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.888062] ---[ end trace 0000000000000000 ]---
<6> [225.888064] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.888136] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.888143] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.888557] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.888764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.888847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.888936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.889020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.889103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.889190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.889277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.889365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.889446] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.889542] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.889657] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.890669] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.901402] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.901651] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.902737] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.902817] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.902893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.902969] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.903047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.903123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.903197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.903271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.903346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.903420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.903494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.903567] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.903639] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.903720] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.903795] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.903869] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.903943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.904019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.904095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.904178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.904260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.904338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.904417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.904493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.904568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.904642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.904726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.904804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.904884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.904965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.905044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.905123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.905207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.905290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.905373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.905454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.905533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.905611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.905687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.905778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.905857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.905933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.906013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.906092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.906173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.906250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.906327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.906403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.906480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.906555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.906629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.906712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.906793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.906873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.906951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.907030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.907106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.907182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.907260] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.907374] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.907378] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44376, lrc_seqno=44376, guc_id=0, flags=0x73 in no process [-1]
<7> [225.907380] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.907438] ------------[ cut here ]------------
<4> [225.907439] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.907440] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/118
<4> [225.907511] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.907573] efi_pstore nfnetlink autofs4
<4> [225.907577] CPU: 10 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.907580] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.907582] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.907583] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.907588] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.907657] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.907659] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [225.907661] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.907662] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.907664] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.907665] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.907666] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.907668] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [225.907669] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.907671] CR2: 0000775911423058 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.907672] PKRU: 55555554
<4> [225.907673] Call Trace:
<4> [225.907674] <TASK>
<4> [225.907678] ? lock_sync+0x100/0x100
<4> [225.907683] ? lock_release+0xd0/0x2b0
<4> [225.907688] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.907699] process_one_work+0x239/0x760
<4> [225.907705] worker_thread+0x200/0x3f0
<4> [225.907708] ? __pfx_worker_thread+0x10/0x10
<4> [225.907711] kthread+0x10d/0x150
<4> [225.907714] ? __pfx_kthread+0x10/0x10
<4> [225.907718] ret_from_fork+0x3d4/0x480
<4> [225.907720] ? __pfx_kthread+0x10/0x10
<4> [225.907723] ret_from_fork_asm+0x1a/0x30
<4> [225.907730] </TASK>
<4> [225.907731] irq event stamp: 626701
<4> [225.907732] hardirqs last enabled at (626707): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.907735] hardirqs last disabled at (626712): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.907738] softirqs last enabled at (625722): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.907740] softirqs last disabled at (625715): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.907743] ---[ end trace 0000000000000000 ]---
<7> [225.909471] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.909575] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [225.909673] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44431, lrc_seqno=44431, guc_id=0, flags=0x73 in no process [-1]
<7> [225.909675] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.909770] ------------[ cut here ]------------
<4> [225.909772] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.909773] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/118
<4> [225.909847] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.909909] efi_pstore nfnetlink autofs4
<4> [225.909913] CPU: 10 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.909916] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.909917] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.909919] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.909924] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.909994] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.909996] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [225.909998] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.909999] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.910001] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.910002] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.910003] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.910004] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [225.910006] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.910007] CR2: 0000775911423058 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.910009] PKRU: 55555554
<4> [225.910010] Call Trace:
<4> [225.910011] <TASK>
<4> [225.910014] ? lock_sync+0x100/0x100
<4> [225.910018] ? lock_release+0xd0/0x2b0
<4> [225.910024] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.910029] process_one_work+0x239/0x760
<4> [225.910035] worker_thread+0x200/0x3f0
<4> [225.910038] ? __pfx_worker_thread+0x10/0x10
<4> [225.910040] kthread+0x10d/0x150
<4> [225.910043] ? __pfx_kthread+0x10/0x10
<4> [225.910047] ret_from_fork+0x3d4/0x480
<4> [225.910049] ? __pfx_kthread+0x10/0x10
<4> [225.910052] ret_from_fork_asm+0x1a/0x30
<4> [225.910059] </TASK>
<4> [225.910060] irq event stamp: 629551
<4> [225.910061] hardirqs last enabled at (629557): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.910064] hardirqs last disabled at (629562): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.910066] softirqs last enabled at (628784): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.910068] softirqs last disabled at (628777): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.910071] ---[ end trace 0000000000000000 ]---
<6> [225.910072] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.910143] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.910150] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.910249] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.910450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.910540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.910633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.910730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.910821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.910911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.911022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.911126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.911212] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.911308] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.911424] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.912439] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.922699] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.922976] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.924051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.924130] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.924207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.924283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.924362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.924439] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.924515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.924590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.924664] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.924752] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.924826] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.924898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.924971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.925044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.925118] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.925191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.925264] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.925339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.925414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.925496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.925576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.925655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.925744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.925823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.925903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.925982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.926061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.926142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.926222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.926300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.926379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.926457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.926543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.926628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.926719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.926800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.926905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.926995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.927084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.927164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.927247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.927328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.927406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.927484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.927571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.927652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.927743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.927821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.927903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.927985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.928062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.928140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.928216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.928292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.928367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.928443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.928517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.928592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.928669] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.928797] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.928801] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44431, lrc_seqno=44431, guc_id=0, flags=0x73 in no process [-1]
<7> [225.928803] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.928861] ------------[ cut here ]------------
<4> [225.928862] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.928864] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/118
<4> [225.928936] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.928999] efi_pstore nfnetlink autofs4
<4> [225.929003] CPU: 10 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.929006] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.929007] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.929009] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.929014] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.929084] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.929085] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [225.929087] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.929089] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.929090] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.929091] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.929092] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.929094] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [225.929095] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.929097] CR2: 0000775911423058 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.929098] PKRU: 55555554
<4> [225.929099] Call Trace:
<4> [225.929100] <TASK>
<4> [225.929104] ? lock_sync+0x100/0x100
<4> [225.929108] ? lock_release+0xd0/0x2b0
<4> [225.929114] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.929119] process_one_work+0x239/0x760
<4> [225.929125] worker_thread+0x200/0x3f0
<4> [225.929128] ? __pfx_worker_thread+0x10/0x10
<4> [225.929130] kthread+0x10d/0x150
<4> [225.929133] ? __pfx_kthread+0x10/0x10
<4> [225.929137] ret_from_fork+0x3d4/0x480
<4> [225.929139] ? __pfx_kthread+0x10/0x10
<4> [225.929142] ret_from_fork_asm+0x1a/0x30
<4> [225.929149] </TASK>
<4> [225.929150] irq event stamp: 632649
<4> [225.929151] hardirqs last enabled at (632655): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.929154] hardirqs last disabled at (632660): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.929156] softirqs last enabled at (631722): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.929159] softirqs last disabled at (631715): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.929161] ---[ end trace 0000000000000000 ]---
<6> [225.929163] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.929232] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.929239] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.930520] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.930625] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [225.930760] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.930964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.931053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.931144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.931233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.931319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.931403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.931487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.931574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.931657] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.931765] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.931883] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.932898] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.942701] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.942972] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.943994] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.944074] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.944150] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.944227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.944302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.944377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.944453] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.944527] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.944599] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.944672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.944759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.944832] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.944904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.944976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.945049] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.945122] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.945195] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.945267] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.945338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.945419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.945498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.945576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.945656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.945748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.945829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.945907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.945985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.946064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.946143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.946220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.946301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.946382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.946467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.946553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.946637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.946726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.946806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.946882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.946959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.947034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.947111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.947188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.947266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.947341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.947420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.947501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.947582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.947660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.947748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.947825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.947901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.947983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.948063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.948142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.948220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.948297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.948372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.948447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.948525] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.948638] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.948642] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44431, lrc_seqno=44431, guc_id=0, flags=0x73 in no process [-1]
<7> [225.948644] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.949559] ------------[ cut here ]------------
<4> [225.949561] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.949562] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:8/716
<4> [225.949652] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.949745] efi_pstore nfnetlink autofs4
<4> [225.949750] CPU: 11 UID: 0 PID: 716 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.949753] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.949754] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.949756] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.949761] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.949831] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.949832] RSP: 0018:ffffc9000293fca0 EFLAGS: 00010246
<4> [225.949835] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.949836] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.949837] RBP: ffffc9000293fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.949839] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.949840] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.949841] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [225.949843] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.949844] CR2: 00007d95ce1ad000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.949846] PKRU: 55555554
<4> [225.949847] Call Trace:
<4> [225.949848] <TASK>
<4> [225.949852] ? lock_sync+0x100/0x100
<4> [225.949856] ? lock_release+0xd0/0x2b0
<4> [225.949862] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.949867] process_one_work+0x239/0x760
<4> [225.949873] worker_thread+0x200/0x3f0
<4> [225.949876] ? __pfx_worker_thread+0x10/0x10
<4> [225.949879] kthread+0x10d/0x150
<4> [225.949882] ? __pfx_kthread+0x10/0x10
<4> [225.949885] ret_from_fork+0x3d4/0x480
<4> [225.949887] ? __pfx_kthread+0x10/0x10
<4> [225.949890] ret_from_fork_asm+0x1a/0x30
<4> [225.949898] </TASK>
<4> [225.949899] irq event stamp: 593533
<4> [225.949900] hardirqs last enabled at (593539): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.949903] hardirqs last disabled at (593544): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.949905] softirqs last enabled at (593080): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.949908] softirqs last disabled at (593057): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.949910] ---[ end trace 0000000000000000 ]---
<7> [225.950508] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.950613] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [225.950714] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44486, lrc_seqno=44486, guc_id=0, flags=0x73 in no process [-1]
<7> [225.950717] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.950777] ------------[ cut here ]------------
<4> [225.950778] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.950779] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:8/716
<4> [225.950851] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.950914] efi_pstore nfnetlink autofs4
<4> [225.950918] CPU: 11 UID: 0 PID: 716 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.950921] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.950922] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.950924] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.950928] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.951000] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.951002] RSP: 0018:ffffc9000293fca0 EFLAGS: 00010246
<4> [225.951004] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.951005] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.951007] RBP: ffffc9000293fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.951008] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.951009] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.951010] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [225.951012] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.951013] CR2: 00007d95ce1ad000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.951014] PKRU: 55555554
<4> [225.951015] Call Trace:
<4> [225.951016] <TASK>
<4> [225.951020] ? lock_sync+0x100/0x100
<4> [225.951024] ? lock_release+0xd0/0x2b0
<4> [225.951029] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.951035] process_one_work+0x239/0x760
<4> [225.951041] worker_thread+0x200/0x3f0
<4> [225.951043] ? __pfx_worker_thread+0x10/0x10
<4> [225.951045] kthread+0x10d/0x150
<4> [225.951048] ? __pfx_kthread+0x10/0x10
<4> [225.951052] ret_from_fork+0x3d4/0x480
<4> [225.951054] ? __pfx_kthread+0x10/0x10
<4> [225.951057] ret_from_fork_asm+0x1a/0x30
<4> [225.951064] </TASK>
<4> [225.951065] irq event stamp: 596201
<4> [225.951066] hardirqs last enabled at (596207): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.951069] hardirqs last disabled at (596212): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.951071] softirqs last enabled at (593080): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.951073] softirqs last disabled at (593057): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.951076] ---[ end trace 0000000000000000 ]---
<6> [225.951077] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.951146] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.951152] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.951199] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.951401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.951489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.951581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.951669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.951766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.951852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.951937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.952024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.952106] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.952199] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.952316] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.953326] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.963700] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.963952] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.964978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.965058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.965134] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.965211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.965288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.965363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.965437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.965513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.965590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.965666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.965752] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.965827] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.965901] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.965975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.966049] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.966123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.966197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.966271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.966343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.966424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.966504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.966585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.966667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.966753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.966832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.966910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.966988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.967066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.967144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.967221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.967300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.967378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.967462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.967545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.967632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.967721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.967802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.967879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.967957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.968033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.968112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.968190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.968271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.968350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.968431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.968509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.968587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.968665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.968755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.968831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.968908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.968987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.969064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.969141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.969217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.969293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.969368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.969443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.969520] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.969632] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.969636] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44486, lrc_seqno=44486, guc_id=0, flags=0x73 in no process [-1]
<7> [225.969638] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.970546] ------------[ cut here ]------------
<4> [225.970547] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.970549] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:8/716
<4> [225.970628] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.970697] efi_pstore nfnetlink autofs4
<4> [225.970702] CPU: 11 UID: 0 PID: 716 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.970704] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.970706] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.970707] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.970712] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.970782] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.970784] RSP: 0018:ffffc9000293fca0 EFLAGS: 00010246
<4> [225.970786] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.970788] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.970789] RBP: ffffc9000293fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.970790] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.970791] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.970793] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [225.970794] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.970796] CR2: 00007d95ce1ad000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [225.970797] PKRU: 55555554
<4> [225.970798] Call Trace:
<4> [225.970799] <TASK>
<4> [225.970803] ? lock_sync+0x100/0x100
<4> [225.970807] ? lock_release+0xd0/0x2b0
<4> [225.970813] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.970818] process_one_work+0x239/0x760
<4> [225.970824] worker_thread+0x200/0x3f0
<4> [225.970827] ? __pfx_worker_thread+0x10/0x10
<4> [225.970830] kthread+0x10d/0x150
<4> [225.970832] ? __pfx_kthread+0x10/0x10
<4> [225.970836] ret_from_fork+0x3d4/0x480
<4> [225.970838] ? __pfx_kthread+0x10/0x10
<4> [225.970841] ret_from_fork_asm+0x1a/0x30
<4> [225.970849] </TASK>
<4> [225.970850] irq event stamp: 599299
<4> [225.970851] hardirqs last enabled at (599305): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.970854] hardirqs last disabled at (599310): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.970856] softirqs last enabled at (598088): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.970858] softirqs last disabled at (598083): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.970860] ---[ end trace 0000000000000000 ]---
<6> [225.970862] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.970933] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.970939] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.970953] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.971055] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [225.971345] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.971553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.971647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.971759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.971869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.971956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.972041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.972127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.972217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.972303] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.972399] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.972516] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.973531] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [225.983700] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [225.983948] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [225.985000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [225.985080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [225.985157] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [225.985233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [225.985308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [225.985383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [225.985456] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [225.985530] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [225.985604] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [225.985678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [225.985767] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [225.985859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [225.985932] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [225.986006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [225.986082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [225.986158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [225.986232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [225.986306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [225.986379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [225.986460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [225.986541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [225.986619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [225.986704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [225.986804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [225.986885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [225.986963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [225.987040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [225.987119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [225.987199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [225.987278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [225.987356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [225.987434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [225.987521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [225.987608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [225.987698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [225.987798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [225.987878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [225.987955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [225.988033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [225.988109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [225.988192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [225.988272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [225.988350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [225.988427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [225.988507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [225.988584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [225.988660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [225.988754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [225.988852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [225.988927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [225.989001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [225.989081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [225.989161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [225.989242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [225.989319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [225.989398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [225.989475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [225.989550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [225.989629] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [225.989749] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [225.989756] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44486, lrc_seqno=44486, guc_id=0, flags=0x73 in no process [-1]
<7> [225.989760] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.989833] ------------[ cut here ]------------
<4> [225.989834] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.989835] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:12/2640
<4> [225.989907] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.989972] efi_pstore nfnetlink autofs4
<4> [225.989976] CPU: 3 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.989980] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.989981] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.989982] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.989988] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.990058] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.990060] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [225.990062] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.990064] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.990065] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.990066] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.990067] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.990069] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000
<4> [225.990070] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.990072] CR2: 00007d95c40663f8 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [225.990073] PKRU: 55555554
<4> [225.990074] Call Trace:
<4> [225.990075] <TASK>
<4> [225.990079] ? lock_sync+0x100/0x100
<4> [225.990084] ? lock_release+0xd0/0x2b0
<4> [225.990089] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.990095] process_one_work+0x239/0x760
<4> [225.990101] worker_thread+0x200/0x3f0
<4> [225.990104] ? __pfx_worker_thread+0x10/0x10
<4> [225.990106] kthread+0x10d/0x150
<4> [225.990109] ? __pfx_kthread+0x10/0x10
<4> [225.990113] ret_from_fork+0x3d4/0x480
<4> [225.990115] ? __pfx_kthread+0x10/0x10
<4> [225.990118] ret_from_fork_asm+0x1a/0x30
<4> [225.990125] </TASK>
<4> [225.990126] irq event stamp: 701775
<4> [225.990128] hardirqs last enabled at (701781): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.990130] hardirqs last disabled at (701786): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.990133] softirqs last enabled at (700934): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.990135] softirqs last disabled at (700927): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.990137] ---[ end trace 0000000000000000 ]---
<5> [225.991903] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44541, lrc_seqno=44541, guc_id=0, flags=0x73 in no process [-1]
<7> [225.991907] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [225.991970] ------------[ cut here ]------------
<4> [225.991971] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [225.991973] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:12/2640
<4> [225.992043] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [225.992105] efi_pstore nfnetlink autofs4
<4> [225.992109] CPU: 3 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [225.992112] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [225.992113] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [225.992114] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [225.992119] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [225.992188] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [225.992190] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [225.992192] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [225.992193] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [225.992195] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [225.992196] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [225.992197] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [225.992198] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000
<4> [225.992200] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [225.992201] CR2: 00007d95c40663f8 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [225.992202] PKRU: 55555554
<4> [225.992203] Call Trace:
<4> [225.992204] <TASK>
<4> [225.992208] ? lock_sync+0x100/0x100
<4> [225.992212] ? lock_release+0xd0/0x2b0
<4> [225.992218] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [225.992223] process_one_work+0x239/0x760
<4> [225.992229] worker_thread+0x200/0x3f0
<4> [225.992232] ? __pfx_worker_thread+0x10/0x10
<4> [225.992234] kthread+0x10d/0x150
<4> [225.992237] ? __pfx_kthread+0x10/0x10
<4> [225.992241] ret_from_fork+0x3d4/0x480
<4> [225.992243] ? __pfx_kthread+0x10/0x10
<4> [225.992246] ret_from_fork_asm+0x1a/0x30
<4> [225.992253] </TASK>
<4> [225.992254] irq event stamp: 704457
<4> [225.992256] hardirqs last enabled at (704463): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [225.992258] hardirqs last disabled at (704468): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [225.992260] softirqs last enabled at (700934): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.992263] softirqs last disabled at (700927): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [225.992265] ---[ end trace 0000000000000000 ]---
<6> [225.992267] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [225.992337] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [225.992343] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [225.992365] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [225.992501] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [225.992637] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [225.992853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [225.992943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [225.993035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [225.993123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [225.993209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [225.993296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [225.993387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [225.993478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [225.993563] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [225.993657] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [225.993783] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [225.994792] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.004699] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.004949] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.006040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.006119] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.006197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.006274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.006349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.006423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.006497] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.006570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.006643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.006724] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.006797] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.006870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.006944] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.007021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.007098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.007173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.007248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.007321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.007394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.007475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.007556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.007635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.007727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.007805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.007881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.007957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.008036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.008120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.008201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.008279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.008357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.008436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.008518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.008601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.008685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.008785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.008868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.008947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.009026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.009103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.009182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.009261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.009338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.009419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.009505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.009585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.009665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.009750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.009828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.009904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.009980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.010058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.010133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.010209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.010282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.010361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.010438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.010514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.010593] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.010711] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.010715] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44541, lrc_seqno=44541, guc_id=0, flags=0x73 in no process [-1]
<7> [226.010718] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.010777] ------------[ cut here ]------------
<4> [226.010778] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.010780] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/118
<4> [226.010851] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.010914] efi_pstore nfnetlink autofs4
<4> [226.010918] CPU: 10 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.010921] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.010922] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.010923] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.010928] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.010996] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.010998] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [226.011000] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.011001] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.011003] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.011004] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.011005] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.011006] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [226.011008] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.011009] CR2: 0000775911423058 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [226.011011] PKRU: 55555554
<4> [226.011012] Call Trace:
<4> [226.011013] <TASK>
<4> [226.011017] ? lock_sync+0x100/0x100
<4> [226.011021] ? lock_release+0xd0/0x2b0
<4> [226.011027] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.011032] process_one_work+0x239/0x760
<4> [226.011038] worker_thread+0x200/0x3f0
<4> [226.011041] ? __pfx_worker_thread+0x10/0x10
<4> [226.011043] kthread+0x10d/0x150
<4> [226.011046] ? __pfx_kthread+0x10/0x10
<4> [226.011050] ret_from_fork+0x3d4/0x480
<4> [226.011052] ? __pfx_kthread+0x10/0x10
<4> [226.011055] ret_from_fork_asm+0x1a/0x30
<4> [226.011062] </TASK>
<4> [226.011063] irq event stamp: 638041
<4> [226.011064] hardirqs last enabled at (638047): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.011067] hardirqs last disabled at (638052): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.011070] softirqs last enabled at (637032): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.011072] softirqs last disabled at (637023): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.011074] ---[ end trace 0000000000000000 ]---
<6> [226.011076] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.011146] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.011154] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.012399] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.012504] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [226.012611] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.012821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.012911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.013004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.013092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.013179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.013267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.013354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.013442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.013525] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.013621] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.013743] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.014755] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.025477] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.025724] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.026811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.026891] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.026967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.027043] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.027119] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.027194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.027268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.027342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.027416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.027490] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.027564] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.027637] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.027718] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.027791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.027863] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.027937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.028011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.028084] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.028159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.028243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.028325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.028404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.028483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.028558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.028635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.028718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.028794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.028873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.028951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.029028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.029106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.029187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.029274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.029359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.029444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.029525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.029603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.029680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.029771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.029848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.029927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.030004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.030081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.030160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.030255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.030356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.030448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.030524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.030601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.030675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.030765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.030847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.030927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.031007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.031084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.031163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.031239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.031315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.031395] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.031508] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.031512] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44541, lrc_seqno=44541, guc_id=0, flags=0x73 in no process [-1]
<7> [226.031515] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.031573] ------------[ cut here ]------------
<4> [226.031575] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.031576] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:8/716
<4> [226.031648] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.031735] efi_pstore nfnetlink autofs4
<4> [226.031739] CPU: 11 UID: 0 PID: 716 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.031742] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.031744] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.031745] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.031750] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.031819] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.031821] RSP: 0018:ffffc9000293fca0 EFLAGS: 00010246
<4> [226.031823] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.031824] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.031826] RBP: ffffc9000293fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.031827] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.031828] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.031829] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [226.031831] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.031832] CR2: 00007d95ce1ad000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [226.031834] PKRU: 55555554
<4> [226.031835] Call Trace:
<4> [226.031836] <TASK>
<4> [226.031840] ? lock_sync+0x100/0x100
<4> [226.031844] ? lock_release+0xd0/0x2b0
<4> [226.031850] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.031855] process_one_work+0x239/0x760
<4> [226.031861] worker_thread+0x200/0x3f0
<4> [226.031864] ? __pfx_worker_thread+0x10/0x10
<4> [226.031866] kthread+0x10d/0x150
<4> [226.031869] ? __pfx_kthread+0x10/0x10
<4> [226.031872] ret_from_fork+0x3d4/0x480
<4> [226.031874] ? __pfx_kthread+0x10/0x10
<4> [226.031878] ret_from_fork_asm+0x1a/0x30
<4> [226.031885] </TASK>
<4> [226.031886] irq event stamp: 602781
<4> [226.031887] hardirqs last enabled at (602787): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.031890] hardirqs last disabled at (602792): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.031892] softirqs last enabled at (601878): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.031895] softirqs last disabled at (601867): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.031897] ---[ end trace 0000000000000000 ]---
<5> [226.033291] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44596, lrc_seqno=44596, guc_id=0, flags=0x73 in no process [-1]
<7> [226.033294] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.033356] ------------[ cut here ]------------
<4> [226.033358] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.033366] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:8/716
<4> [226.033435] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.033497] efi_pstore nfnetlink autofs4
<4> [226.033501] CPU: 11 UID: 0 PID: 716 Comm: kworker/u64:8 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.033504] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.033505] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.033506] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.033511] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.033578] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.033579] RSP: 0018:ffffc9000293fca0 EFLAGS: 00010246
<4> [226.033581] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.033583] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.033584] RBP: ffffc9000293fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.033585] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.033586] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.033588] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [226.033589] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.033590] CR2: 00007d95ce1ad000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [226.033592] PKRU: 55555554
<4> [226.033593] Call Trace:
<4> [226.033594] <TASK>
<4> [226.033598] ? lock_sync+0x100/0x100
<4> [226.033602] ? lock_release+0xd0/0x2b0
<4> [226.033607] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.033612] process_one_work+0x239/0x760
<4> [226.033618] worker_thread+0x200/0x3f0
<4> [226.033621] ? __pfx_worker_thread+0x10/0x10
<4> [226.033623] kthread+0x10d/0x150
<4> [226.033626] ? __pfx_kthread+0x10/0x10
<4> [226.033630] ret_from_fork+0x3d4/0x480
<4> [226.033632] ? __pfx_kthread+0x10/0x10
<4> [226.033635] ret_from_fork_asm+0x1a/0x30
<4> [226.033642] </TASK>
<4> [226.033643] irq event stamp: 605507
<4> [226.033645] hardirqs last enabled at (605513): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.033647] hardirqs last disabled at (605518): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.033649] softirqs last enabled at (601878): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.033652] softirqs last disabled at (601867): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.033654] ---[ end trace 0000000000000000 ]---
<6> [226.033656] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<7> [226.033745] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.033848] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<6> [226.033948] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.033954] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.034002] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.034209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.034301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.034395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.034485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.034575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.034662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.034760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.034847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.034929] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.035023] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.035139] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.036161] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.046729] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.046979] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.047998] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.048079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.048156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.048232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.048308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.048384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.048458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.048532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.048609] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.048687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.048776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.048851] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.048925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.048999] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.049071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.049145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.049219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.049293] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.049368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.049450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.049530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.049610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.049695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.049772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.049849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.049926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.050006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.050089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.050171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.050249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.050328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.050411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.050499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.050584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.050669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.050759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.050838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.050916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.050993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.051069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.051146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.051224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.051299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.051374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.051454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.051529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.051606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.051686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.051781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.051859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.051938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.052018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.052095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.052172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.052247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.052326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.052406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.052483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.052564] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.052675] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.052680] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44596, lrc_seqno=44596, guc_id=0, flags=0x73 in no process [-1]
<7> [226.052682] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.053603] ------------[ cut here ]------------
<4> [226.053604] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.053605] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:12/2640
<4> [226.053678] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.053747] efi_pstore nfnetlink autofs4
<4> [226.053751] CPU: 3 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.053754] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.053755] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.053757] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.053762] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.053831] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.053833] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [226.053835] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.053836] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.053838] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.053839] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.053840] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.053841] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000
<4> [226.053843] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.053844] CR2: 00007d95c40663f8 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [226.053846] PKRU: 55555554
<4> [226.053847] Call Trace:
<4> [226.053848] <TASK>
<4> [226.053852] ? lock_sync+0x100/0x100
<4> [226.053856] ? lock_release+0xd0/0x2b0
<4> [226.053862] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.053867] process_one_work+0x239/0x760
<4> [226.053873] worker_thread+0x200/0x3f0
<4> [226.053876] ? __pfx_worker_thread+0x10/0x10
<4> [226.053878] kthread+0x10d/0x150
<4> [226.053881] ? __pfx_kthread+0x10/0x10
<4> [226.053885] ret_from_fork+0x3d4/0x480
<4> [226.053887] ? __pfx_kthread+0x10/0x10
<4> [226.053890] ret_from_fork_asm+0x1a/0x30
<4> [226.053897] </TASK>
<4> [226.053898] irq event stamp: 709839
<4> [226.053899] hardirqs last enabled at (709845): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.053902] hardirqs last disabled at (709850): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.053905] softirqs last enabled at (708918): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.053907] softirqs last disabled at (708911): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.053909] ---[ end trace 0000000000000000 ]---
<6> [226.053911] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.053982] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.053988] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.054002] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.054105] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [226.054437] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.054641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.054741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.054834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.054920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.055006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.055090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.055175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.055267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.055351] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.055447] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.055563] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.056570] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.066699] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.066948] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.068012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.068098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.068179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.068262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.068341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.068417] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.068491] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.068565] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.068639] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.068720] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.068793] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.068866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.068939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.069013] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.069085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.069158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.069231] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.069304] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.069377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.069458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.069538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.069617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.069704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.069782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.069859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.069933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.070008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.070087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.070165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.070244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.070322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.070400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.070483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.070568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.070656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.070753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.070834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.070911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.070988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.071064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.071146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.071227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.071304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.071380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.071461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.071538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.071615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.071697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.071774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.071850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.071925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.072002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.072078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.072154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.072231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.072309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.072384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.072462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.072546] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.072678] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.072682] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44596, lrc_seqno=44596, guc_id=0, flags=0x73 in no process [-1]
<7> [226.072685] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.072768] ------------[ cut here ]------------
<4> [226.072769] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.072771] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/118
<4> [226.072842] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.072905] efi_pstore nfnetlink autofs4
<4> [226.072910] CPU: 10 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.072913] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.072914] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.072915] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.072920] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.072990] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.072992] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [226.072994] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.072995] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.072997] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.072998] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.072999] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.073000] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [226.073002] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.073003] CR2: 0000775911423058 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [226.073005] PKRU: 55555554
<4> [226.073006] Call Trace:
<4> [226.073007] <TASK>
<4> [226.073011] ? lock_sync+0x100/0x100
<4> [226.073016] ? lock_release+0xd0/0x2b0
<4> [226.073021] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.073027] process_one_work+0x239/0x760
<4> [226.073033] worker_thread+0x200/0x3f0
<4> [226.073036] ? __pfx_worker_thread+0x10/0x10
<4> [226.073038] kthread+0x10d/0x150
<4> [226.073041] ? __pfx_kthread+0x10/0x10
<4> [226.073044] ret_from_fork+0x3d4/0x480
<4> [226.073046] ? __pfx_kthread+0x10/0x10
<4> [226.073050] ret_from_fork_asm+0x1a/0x30
<4> [226.073057] </TASK>
<4> [226.073058] irq event stamp: 641583
<4> [226.073059] hardirqs last enabled at (641589): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.073062] hardirqs last disabled at (641594): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.073064] softirqs last enabled at (640662): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.073067] softirqs last disabled at (640655): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.073069] ---[ end trace 0000000000000000 ]---
<5> [226.074501] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44651, lrc_seqno=44651, guc_id=0, flags=0x73 in no process [-1]
<7> [226.074503] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.074565] ------------[ cut here ]------------
<4> [226.074566] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.074568] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/118
<4> [226.074642] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.074710] efi_pstore nfnetlink autofs4
<4> [226.074714] CPU: 10 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.074717] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.074718] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.074719] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.074724] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.074793] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.074795] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [226.074797] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.074798] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.074799] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.074800] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.074802] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.074803] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [226.074804] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.074806] CR2: 0000775911423058 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [226.074807] PKRU: 55555554
<4> [226.074808] Call Trace:
<4> [226.074809] <TASK>
<4> [226.074813] ? lock_sync+0x100/0x100
<4> [226.074817] ? lock_release+0xd0/0x2b0
<4> [226.074822] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.074828] process_one_work+0x239/0x760
<4> [226.074834] worker_thread+0x200/0x3f0
<4> [226.074836] ? __pfx_worker_thread+0x10/0x10
<4> [226.074839] kthread+0x10d/0x150
<4> [226.074842] ? __pfx_kthread+0x10/0x10
<4> [226.074845] ret_from_fork+0x3d4/0x480
<4> [226.074847] ? __pfx_kthread+0x10/0x10
<4> [226.074850] ret_from_fork_asm+0x1a/0x30
<4> [226.074858] </TASK>
<4> [226.074859] irq event stamp: 644461
<4> [226.074860] hardirqs last enabled at (644467): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.074862] hardirqs last disabled at (644472): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.074864] softirqs last enabled at (640662): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.074867] softirqs last disabled at (640655): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.074869] ---[ end trace 0000000000000000 ]---
<7> [226.074883] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.074989] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<6> [226.075086] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.075159] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.075165] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.075214] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.075416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.075504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.075597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.075686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.075796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.075882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.075970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.076059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.076141] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.076234] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.076350] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.077363] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.087699] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.087975] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.089163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.089242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.089318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.089395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.089470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.089546] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.089620] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.089697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.089770] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.089843] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.089916] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.089990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.090062] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.090135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.090209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.090282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.090356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.090431] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.090509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.090592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.090672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.090762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.090844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.090924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.091001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.091077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.091153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.091232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.091312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.091389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.091468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.091550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.091637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.091729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.091814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.091895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.091976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.092054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.092132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.092207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.092287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.092363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.092440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.092520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.092604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.092682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.092773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.092849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.092926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.093002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.093077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.093155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.093231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.093308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.093384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.093465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.093545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.093622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.093705] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.093814] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.093818] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44651, lrc_seqno=44651, guc_id=0, flags=0x73 in no process [-1]
<7> [226.093820] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.093879] ------------[ cut here ]------------
<4> [226.093880] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.093881] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/118
<4> [226.093951] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.094014] efi_pstore nfnetlink autofs4
<4> [226.094019] CPU: 10 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.094021] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.094023] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.094024] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.094029] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.094097] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.094099] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [226.094101] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.094103] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.094104] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.094105] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.094106] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.094108] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [226.094109] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.094110] CR2: 0000775911423058 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [226.094112] PKRU: 55555554
<4> [226.094113] Call Trace:
<4> [226.094114] <TASK>
<4> [226.094118] ? lock_sync+0x100/0x100
<4> [226.094122] ? lock_release+0xd0/0x2b0
<4> [226.094128] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.094133] process_one_work+0x239/0x760
<4> [226.094139] worker_thread+0x200/0x3f0
<4> [226.094142] ? __pfx_worker_thread+0x10/0x10
<4> [226.094144] kthread+0x10d/0x150
<4> [226.094147] ? __pfx_kthread+0x10/0x10
<4> [226.094151] ret_from_fork+0x3d4/0x480
<4> [226.094153] ? __pfx_kthread+0x10/0x10
<4> [226.094156] ret_from_fork_asm+0x1a/0x30
<4> [226.094163] </TASK>
<4> [226.094164] irq event stamp: 647543
<4> [226.094165] hardirqs last enabled at (647549): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.094168] hardirqs last disabled at (647554): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.094170] softirqs last enabled at (644814): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.094173] softirqs last disabled at (644809): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.094175] ---[ end trace 0000000000000000 ]---
<6> [226.094176] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.094246] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.094252] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.094660] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.094874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.094957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.095046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.095130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.095214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.095301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.095388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.095476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.095558] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.095650] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.095774] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.096779] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.107501] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.107744] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.108820] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.108899] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.108976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.109052] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.109128] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.109204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.109278] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.109351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.109424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.109498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.109575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.109651] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.109736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.109812] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.109886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.109960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.110033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.110106] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.110178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.110259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.110341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.110422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.110501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.110578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.110654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.110740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.110815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.110894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.110972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.111051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.111134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.111214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.111298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.111382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.111467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.111551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.111632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.111714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.111792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.111869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.111948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.112025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.112101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.112177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.112256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.112331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.112408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.112482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.112559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.112638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.112719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.112800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.112878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.112955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.113032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.113114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.113192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.113270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.113349] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.113457] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.113461] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44651, lrc_seqno=44651, guc_id=0, flags=0x73 in no process [-1]
<7> [226.113463] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.113521] ------------[ cut here ]------------
<4> [226.113522] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.113523] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/118
<4> [226.113594] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.113656] efi_pstore nfnetlink autofs4
<4> [226.113660] CPU: 10 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.113663] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.113664] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.113666] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.113670] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.113750] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.113752] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [226.113754] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.113756] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.113758] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.113759] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.113760] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.113762] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [226.113763] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.113765] CR2: 0000775911423058 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [226.113767] PKRU: 55555554
<4> [226.113768] Call Trace:
<4> [226.113769] <TASK>
<4> [226.113773] ? lock_sync+0x100/0x100
<4> [226.113777] ? lock_release+0xd0/0x2b0
<4> [226.113782] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.113788] process_one_work+0x239/0x760
<4> [226.113794] worker_thread+0x200/0x3f0
<4> [226.113797] ? __pfx_worker_thread+0x10/0x10
<4> [226.113799] kthread+0x10d/0x150
<4> [226.113802] ? __pfx_kthread+0x10/0x10
<4> [226.113806] ret_from_fork+0x3d4/0x480
<4> [226.113808] ? __pfx_kthread+0x10/0x10
<4> [226.113811] ret_from_fork_asm+0x1a/0x30
<4> [226.113818] </TASK>
<4> [226.113820] irq event stamp: 650651
<4> [226.113821] hardirqs last enabled at (650657): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.113824] hardirqs last disabled at (650662): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.113826] softirqs last enabled at (649658): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.113829] softirqs last disabled at (649651): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.113831] ---[ end trace 0000000000000000 ]---
<7> [226.115368] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.115474] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [226.115574] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44706, lrc_seqno=44706, guc_id=0, flags=0x73 in no process [-1]
<7> [226.115577] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.115635] ------------[ cut here ]------------
<4> [226.115636] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.115638] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/118
<4> [226.115714] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.115777] efi_pstore nfnetlink autofs4
<4> [226.115781] CPU: 10 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.115784] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.115785] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.115786] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.115791] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.115859] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.115861] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [226.115863] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.115864] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.115865] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.115867] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.115868] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.115869] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [226.115871] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.115872] CR2: 0000775911423058 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [226.115873] PKRU: 55555554
<4> [226.115875] Call Trace:
<4> [226.115876] <TASK>
<4> [226.115879] ? lock_sync+0x100/0x100
<4> [226.115883] ? lock_release+0xd0/0x2b0
<4> [226.115889] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.115894] process_one_work+0x239/0x760
<4> [226.115900] worker_thread+0x200/0x3f0
<4> [226.115903] ? __pfx_worker_thread+0x10/0x10
<4> [226.115905] kthread+0x10d/0x150
<4> [226.115908] ? __pfx_kthread+0x10/0x10
<4> [226.115912] ret_from_fork+0x3d4/0x480
<4> [226.115914] ? __pfx_kthread+0x10/0x10
<4> [226.115917] ret_from_fork_asm+0x1a/0x30
<4> [226.115924] </TASK>
<4> [226.115926] irq event stamp: 653391
<4> [226.115927] hardirqs last enabled at (653397): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.115929] hardirqs last disabled at (653402): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.115932] softirqs last enabled at (649658): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.115934] softirqs last disabled at (649651): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.115937] ---[ end trace 0000000000000000 ]---
<6> [226.115938] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.116007] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.116013] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.116074] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.116279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.116371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.116466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.116553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.116640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.116731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.116815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.116901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.116982] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.117075] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.117191] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.118197] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.128697] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.128948] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.130035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.130113] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.130189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.130267] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.130344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.130420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.130497] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.130572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.130646] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.130729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.130802] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.130876] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.130949] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.131022] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.131095] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.131169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.131242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.131317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.131392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.131474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.131556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.131635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.131722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.131800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.131877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.131957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.132036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.132117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.132197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.132276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.132356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.132435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.132520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.132603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.132686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.132779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.132858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.132934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.133013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.133090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.133170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.133249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.133326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.133402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.133482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.133559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.133638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.133721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.133799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.133876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.133951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.134029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.134106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.134187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.134265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.134344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.134419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.134493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.134573] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.134683] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.134687] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44706, lrc_seqno=44706, guc_id=0, flags=0x73 in no process [-1]
<7> [226.134692] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.134751] ------------[ cut here ]------------
<4> [226.134752] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.134754] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:12/2640
<4> [226.134825] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.134888] efi_pstore nfnetlink autofs4
<4> [226.134893] CPU: 3 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.134896] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.134897] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.134898] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.134903] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.134973] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.134974] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [226.134977] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.134978] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.134980] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.134981] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.134982] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.134983] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000
<4> [226.134985] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.134986] CR2: 00007d95c40663f8 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [226.134988] PKRU: 55555554
<4> [226.134989] Call Trace:
<4> [226.134990] <TASK>
<4> [226.134994] ? lock_sync+0x100/0x100
<4> [226.134999] ? lock_release+0xd0/0x2b0
<4> [226.135004] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.135010] process_one_work+0x239/0x760
<4> [226.135016] worker_thread+0x200/0x3f0
<4> [226.135018] ? __pfx_worker_thread+0x10/0x10
<4> [226.135021] kthread+0x10d/0x150
<4> [226.135024] ? __pfx_kthread+0x10/0x10
<4> [226.135027] ret_from_fork+0x3d4/0x480
<4> [226.135029] ? __pfx_kthread+0x10/0x10
<4> [226.135033] ret_from_fork_asm+0x1a/0x30
<4> [226.135040] </TASK>
<4> [226.135041] irq event stamp: 715389
<4> [226.135042] hardirqs last enabled at (715395): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.135045] hardirqs last disabled at (715400): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.135047] softirqs last enabled at (714280): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.135050] softirqs last disabled at (714271): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.135052] ---[ end trace 0000000000000000 ]---
<6> [226.135054] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.135125] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.135130] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.136374] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.136476] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [226.136579] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.136794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.136885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.136978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.137065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.137152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.137239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.137328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.137417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.137500] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.137592] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.137711] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.138719] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.148706] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.148956] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.150039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.150118] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.150196] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.150273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.150350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.150425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.150502] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.150581] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.150657] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.150744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.150819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.150893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.150967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.151040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.151113] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.151186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.151257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.151329] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.151401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.151482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.151563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.151642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.151730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.151808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.151888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.151967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.152044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.152124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.152207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.152289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.152369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.152450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.152534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.152618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.152706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.152791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.152873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.152953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.153031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.153108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.153187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.153265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.153342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.153421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.153506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.153584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.153663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.153749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.153829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.153904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.153980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.154059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.154135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.154211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.154287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.154368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.154448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.154523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.154602] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.154717] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.154721] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44706, lrc_seqno=44706, guc_id=0, flags=0x73 in no process [-1]
<7> [226.154724] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.154784] ------------[ cut here ]------------
<4> [226.154786] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.154787] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/118
<4> [226.154860] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.154923] efi_pstore nfnetlink autofs4
<4> [226.154927] CPU: 10 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.154930] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.154932] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.154933] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.154938] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.155010] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.155012] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [226.155014] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.155015] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.155017] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.155018] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.155019] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.155020] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [226.155022] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.155023] CR2: 0000775911423058 CR3: 000000012e577002 CR4: 0000000000f72ef0
<4> [226.155025] PKRU: 55555554
<4> [226.155026] Call Trace:
<4> [226.155027] <TASK>
<4> [226.155031] ? lock_sync+0x100/0x100
<4> [226.155036] ? lock_release+0xd0/0x2b0
<4> [226.155041] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.155047] process_one_work+0x239/0x760
<4> [226.155053] worker_thread+0x200/0x3f0
<4> [226.155055] ? __pfx_worker_thread+0x10/0x10
<4> [226.155058] kthread+0x10d/0x150
<4> [226.155061] ? __pfx_kthread+0x10/0x10
<4> [226.155064] ret_from_fork+0x3d4/0x480
<4> [226.155066] ? __pfx_kthread+0x10/0x10
<4> [226.155070] ret_from_fork_asm+0x1a/0x30
<4> [226.155077] </TASK>
<4> [226.155078] irq event stamp: 656947
<4> [226.155079] hardirqs last enabled at (656953): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.155082] hardirqs last disabled at (656958): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.155084] softirqs last enabled at (655838): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.155086] softirqs last disabled at (655831): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.155089] ---[ end trace 0000000000000000 ]---
<5> [226.155669] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44761, lrc_seqno=44761, guc_id=0, flags=0x73 in no process [-1]
<7> [226.155672] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.156601] ------------[ cut here ]------------
<4> [226.156602] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.156604] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/118
<4> [226.156681] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.156747] efi_pstore nfnetlink autofs4
<4> [226.156752] CPU: 10 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.156754] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.156755] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.156756] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.156761] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.156831] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.156833] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [226.156835] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.156836] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.156837] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.156839] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.156840] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.156841] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [226.156842] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.156844] CR2: 0000775911423058 CR3: 000000012e577002 CR4: 0000000000f72ef0
<4> [226.156845] PKRU: 55555554
<4> [226.156846] Call Trace:
<4> [226.156847] <TASK>
<4> [226.156851] ? lock_sync+0x100/0x100
<4> [226.156855] ? lock_release+0xd0/0x2b0
<4> [226.156861] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.156866] process_one_work+0x239/0x760
<4> [226.156872] worker_thread+0x200/0x3f0
<4> [226.156875] ? __pfx_worker_thread+0x10/0x10
<4> [226.156877] kthread+0x10d/0x150
<4> [226.156880] ? __pfx_kthread+0x10/0x10
<4> [226.156883] ret_from_fork+0x3d4/0x480
<4> [226.156885] ? __pfx_kthread+0x10/0x10
<4> [226.156889] ret_from_fork_asm+0x1a/0x30
<4> [226.156896] </TASK>
<4> [226.156897] irq event stamp: 659661
<4> [226.156898] hardirqs last enabled at (659667): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.156901] hardirqs last disabled at (659672): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.156903] softirqs last enabled at (658888): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.156905] softirqs last disabled at (658857): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.156907] ---[ end trace 0000000000000000 ]---
<7> [226.156921] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.157025] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<6> [226.157123] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.157194] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.157200] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.157265] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.157474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.157565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.157659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.157784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.157890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.157979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.158066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.158153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.158235] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.158333] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.158450] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.159462] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.169698] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.169950] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.171054] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.171135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.171213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.171290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.171365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.171441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.171515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.171590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.171664] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.171750] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.171843] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.171921] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.171997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.172072] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.172145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.172219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.172292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.172367] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.172442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.172526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.172607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.172685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.172783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.172882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.172965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.173044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.173122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.173203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.173284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.173365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.173444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.173523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.173606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.173695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.173803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.173888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.173971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.174049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.174127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.174203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.174285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.174366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.174445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.174521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.174602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.174679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.174770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.174860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.174937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.175014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.175094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.175176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.175254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.175332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.175408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.175488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.175563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.175640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.175732] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.175884] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.175888] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44761, lrc_seqno=44761, guc_id=0, flags=0x73 in no process [-1]
<7> [226.175891] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.175950] ------------[ cut here ]------------
<4> [226.175951] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.175952] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:12/2640
<4> [226.176023] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.176087] efi_pstore nfnetlink autofs4
<4> [226.176091] CPU: 3 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.176094] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.176095] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.176097] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.176102] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.176171] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.176173] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [226.176175] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.176177] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.176178] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.176179] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.176180] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.176182] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000
<4> [226.176183] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.176184] CR2: 00007d95c40663f8 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [226.176186] PKRU: 55555554
<4> [226.176187] Call Trace:
<4> [226.176188] <TASK>
<4> [226.176192] ? lock_sync+0x100/0x100
<4> [226.176197] ? lock_release+0xd0/0x2b0
<4> [226.176202] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.176207] process_one_work+0x239/0x760
<4> [226.176213] worker_thread+0x200/0x3f0
<4> [226.176216] ? __pfx_worker_thread+0x10/0x10
<4> [226.176219] kthread+0x10d/0x150
<4> [226.176221] ? __pfx_kthread+0x10/0x10
<4> [226.176225] ret_from_fork+0x3d4/0x480
<4> [226.176227] ? __pfx_kthread+0x10/0x10
<4> [226.176230] ret_from_fork_asm+0x1a/0x30
<4> [226.176238] </TASK>
<4> [226.176239] irq event stamp: 720771
<4> [226.176240] hardirqs last enabled at (720777): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.176243] hardirqs last disabled at (720782): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.176245] softirqs last enabled at (719922): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.176247] softirqs last disabled at (719899): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.176250] ---[ end trace 0000000000000000 ]---
<6> [226.176251] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.176321] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.176327] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.176734] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.176964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.177052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.177145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.177234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.177321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.177408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.177494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.177581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.177664] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.177769] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.177903] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.178920] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.189645] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.189920] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.191194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.191274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.191350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.191426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.191501] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.191577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.191651] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.191739] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.191828] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.191906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.191983] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.192057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.192132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.192206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.192279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.192356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.192456] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.192555] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.192654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.192779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.192885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.192987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.193092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.193195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.193297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.193380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.193460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.193540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.193621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.193708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.193807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.193886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.193969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.194056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.194144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.194225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.194305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.194383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.194460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.194538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.194618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.194702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.194794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.194869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.194949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.195025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.195103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.195177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.195258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.195337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.195414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.195493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.195571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.195647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.195734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.195833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.195913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.195991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.196073] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.196182] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.196186] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44761, lrc_seqno=44761, guc_id=0, flags=0x73 in no process [-1]
<7> [226.196189] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.196248] ------------[ cut here ]------------
<4> [226.196249] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.196250] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:12/2640
<4> [226.196324] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.196387] efi_pstore nfnetlink autofs4
<4> [226.196391] CPU: 3 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.196394] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.196395] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.196397] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.196402] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.196473] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.196475] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [226.196477] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.196479] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.196480] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.196481] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.196482] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.196484] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000
<4> [226.196485] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.196487] CR2: 00007d95c40663f8 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [226.196488] PKRU: 55555554
<4> [226.196489] Call Trace:
<4> [226.196490] <TASK>
<4> [226.196494] ? lock_sync+0x100/0x100
<4> [226.196499] ? lock_release+0xd0/0x2b0
<4> [226.196504] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.196510] process_one_work+0x239/0x760
<4> [226.196516] worker_thread+0x200/0x3f0
<4> [226.196518] ? __pfx_worker_thread+0x10/0x10
<4> [226.196521] kthread+0x10d/0x150
<4> [226.196523] ? __pfx_kthread+0x10/0x10
<4> [226.196527] ret_from_fork+0x3d4/0x480
<4> [226.196529] ? __pfx_kthread+0x10/0x10
<4> [226.196532] ret_from_fork_asm+0x1a/0x30
<4> [226.196540] </TASK>
<4> [226.196541] irq event stamp: 723889
<4> [226.196542] hardirqs last enabled at (723895): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.196545] hardirqs last disabled at (723900): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.196547] softirqs last enabled at (722826): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.196549] softirqs last disabled at (722817): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.196552] ---[ end trace 0000000000000000 ]---
<7> [226.197847] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.197956] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [226.198256] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44816, lrc_seqno=44816, guc_id=0, flags=0x73 in no process [-1]
<7> [226.198263] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.198368] ------------[ cut here ]------------
<4> [226.198370] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.198372] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#14: kworker/u64:0/12
<4> [226.198488] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.198579] efi_pstore nfnetlink autofs4
<4> [226.198585] CPU: 14 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.198589] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.198591] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.198593] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.198601] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.198717] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.198720] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [226.198724] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.198726] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.198728] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.198730] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.198732] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.198734] FS: 0000000000000000(0000) GS:ffff8888db397000(0000) knlGS:0000000000000000
<4> [226.198737] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.198739] CR2: 00007759114201a0 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [226.198741] PKRU: 55555554
<4> [226.198743] Call Trace:
<4> [226.198745] <TASK>
<4> [226.198751] ? lock_sync+0x100/0x100
<4> [226.198759] ? lock_release+0xd0/0x2b0
<4> [226.198767] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.198777] process_one_work+0x239/0x760
<4> [226.198786] worker_thread+0x200/0x3f0
<4> [226.198791] ? __pfx_worker_thread+0x10/0x10
<4> [226.198794] kthread+0x10d/0x150
<4> [226.198798] ? __pfx_kthread+0x10/0x10
<4> [226.198803] ret_from_fork+0x3d4/0x480
<4> [226.198806] ? __pfx_kthread+0x10/0x10
<4> [226.198811] ret_from_fork_asm+0x1a/0x30
<4> [226.198822] </TASK>
<4> [226.198824] irq event stamp: 972983
<4> [226.198826] hardirqs last enabled at (972989): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.198830] hardirqs last disabled at (972994): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.198833] softirqs last enabled at (971030): [<ffffffff8133ac33>] kernel_fpu_end+0x53/0x70
<4> [226.198836] softirqs last disabled at (971028): [<ffffffff8133b344>] kernel_fpu_begin_mask+0xc4/0x120
<4> [226.198840] ---[ end trace 0000000000000000 ]---
<6> [226.198842] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.198954] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.198961] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.199010] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.199260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.199392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.199529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.199660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.199821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.199952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.200083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.200217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.200345] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.200486] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.200649] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.201972] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.212699] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.213009] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.214215] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.214335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.214452] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.214571] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.214698] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.214817] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.214936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.215055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.215173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.215292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.215410] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.215529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.215648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.215784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.215874] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.215957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.216035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.216111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.216187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.216271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.216353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.216432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.216512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.216592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.216670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.216764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.216843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.216923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.217003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.217082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.217162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.217244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.217332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.217418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.217503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.217584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.217665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.217758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.217840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.217918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.218002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.218082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.218160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.218236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.218316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.218391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.218467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.218541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.218616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.218694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.218771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.218850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.218925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.219001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.219075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.219153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.219231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.219309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.219389] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.219503] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.219508] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44816, lrc_seqno=44816, guc_id=0, flags=0x73 in no process [-1]
<7> [226.219510] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.219570] ------------[ cut here ]------------
<4> [226.219571] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.219572] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:0/12
<4> [226.219645] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.219714] efi_pstore nfnetlink autofs4
<4> [226.219719] CPU: 0 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.219722] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.219723] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.219725] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.219730] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.219800] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.219802] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [226.219804] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.219806] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.219807] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.219808] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.219809] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.219811] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [226.219812] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.219814] CR2: 00007d95ce1b7000 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [226.219815] PKRU: 55555554
<4> [226.219816] Call Trace:
<4> [226.219818] <TASK>
<4> [226.219822] ? lock_sync+0x100/0x100
<4> [226.219826] ? lock_release+0xd0/0x2b0
<4> [226.219832] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.219837] process_one_work+0x239/0x760
<4> [226.219844] worker_thread+0x200/0x3f0
<4> [226.219846] ? __pfx_worker_thread+0x10/0x10
<4> [226.219849] kthread+0x10d/0x150
<4> [226.219851] ? __pfx_kthread+0x10/0x10
<4> [226.219855] ret_from_fork+0x3d4/0x480
<4> [226.219857] ? __pfx_kthread+0x10/0x10
<4> [226.219860] ret_from_fork_asm+0x1a/0x30
<4> [226.219868] </TASK>
<4> [226.219869] irq event stamp: 976183
<4> [226.219870] hardirqs last enabled at (976189): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.219873] hardirqs last disabled at (976194): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.219875] softirqs last enabled at (975788): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.219877] softirqs last disabled at (975783): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.219879] ---[ end trace 0000000000000000 ]---
<6> [226.219881] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.219951] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.219958] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.221212] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.221317] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [226.221423] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.221631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.221730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.221823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.221910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.221995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.222084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.222172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.222259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.222341] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.222436] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.222553] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.223560] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.233697] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.233947] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.235030] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.235109] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.235184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.235260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.235335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.235411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.235488] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.235566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.235641] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.235724] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.235798] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.235871] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.235945] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.236019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.236092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.236168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.236246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.236322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.236396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.236477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.236558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.236636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.236721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.236799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.236880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.236958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.237034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.237113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.237193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.237271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.237349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.237427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.237510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.237594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.237677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.237768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.237846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.237922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.237999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.238075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.238159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.238240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.238317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.238393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.238472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.238549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.238626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.238706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.238784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.238861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.238936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.239013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.239090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.239165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.239240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.239316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.239391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.239467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.239550] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.239665] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.239669] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44816, lrc_seqno=44816, guc_id=0, flags=0x73 in no process [-1]
<7> [226.239671] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.239749] ------------[ cut here ]------------
<4> [226.239750] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.239751] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:12/2640
<4> [226.239824] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.239888] efi_pstore nfnetlink autofs4
<4> [226.239893] CPU: 2 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.239896] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.239897] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.239899] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.239904] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.239975] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.239977] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [226.239979] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.239980] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.239982] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.239983] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.239984] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.239985] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [226.239987] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.239988] CR2: 000000c0004d2000 CR3: 000000012e577006 CR4: 0000000000f72ef0
<4> [226.239990] PKRU: 55555554
<4> [226.239991] Call Trace:
<4> [226.239992] <TASK>
<4> [226.239996] ? lock_sync+0x100/0x100
<4> [226.240000] ? lock_release+0xd0/0x2b0
<4> [226.240006] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.240011] process_one_work+0x239/0x760
<4> [226.240017] worker_thread+0x200/0x3f0
<4> [226.240020] ? __pfx_worker_thread+0x10/0x10
<4> [226.240022] kthread+0x10d/0x150
<4> [226.240025] ? __pfx_kthread+0x10/0x10
<4> [226.240029] ret_from_fork+0x3d4/0x480
<4> [226.240031] ? __pfx_kthread+0x10/0x10
<4> [226.240034] ret_from_fork_asm+0x1a/0x30
<4> [226.240042] </TASK>
<4> [226.240043] irq event stamp: 727421
<4> [226.240044] hardirqs last enabled at (727427): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.240047] hardirqs last disabled at (727432): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.240049] softirqs last enabled at (726654): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.240052] softirqs last disabled at (726647): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.240054] ---[ end trace 0000000000000000 ]---
<5> [226.241554] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44871, lrc_seqno=44871, guc_id=0, flags=0x73 in no process [-1]
<7> [226.241557] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.241619] ------------[ cut here ]------------
<4> [226.241620] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.241622] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:12/2640
<4> [226.241695] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.241758] efi_pstore nfnetlink autofs4
<4> [226.241763] CPU: 2 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.241765] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.241766] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.241768] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.241773] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.241842] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.241843] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [226.241846] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.241847] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.241848] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.241849] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.241851] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.241852] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [226.241853] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.241855] CR2: 000000c0004d2000 CR3: 000000012e577006 CR4: 0000000000f72ef0
<4> [226.241856] PKRU: 55555554
<4> [226.241857] Call Trace:
<4> [226.241858] <TASK>
<4> [226.241862] ? lock_sync+0x100/0x100
<4> [226.241866] ? lock_release+0xd0/0x2b0
<4> [226.241872] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.241877] process_one_work+0x239/0x760
<4> [226.241883] worker_thread+0x200/0x3f0
<4> [226.241886] ? __pfx_worker_thread+0x10/0x10
<4> [226.241888] kthread+0x10d/0x150
<4> [226.241891] ? __pfx_kthread+0x10/0x10
<4> [226.241895] ret_from_fork+0x3d4/0x480
<4> [226.241897] ? __pfx_kthread+0x10/0x10
<4> [226.241900] ret_from_fork_asm+0x1a/0x30
<4> [226.241907] </TASK>
<4> [226.241909] irq event stamp: 730163
<4> [226.241910] hardirqs last enabled at (730169): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.241912] hardirqs last disabled at (730174): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.241914] softirqs last enabled at (726654): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.241917] softirqs last disabled at (726647): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.241919] ---[ end trace 0000000000000000 ]---
<7> [226.241934] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.242036] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<6> [226.242134] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.242207] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.242212] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.242260] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.242463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.242551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.242643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.242744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.242833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.242920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.243007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.243093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.243176] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.243271] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.243386] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.244394] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.254696] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.254946] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.256010] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.256089] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.256165] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.256242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.256317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.256391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.256466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.256539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.256612] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.256686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.256778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.256854] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.256929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.257003] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.257076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.257149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.257222] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.257295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.257367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.257448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.257528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.257608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.257693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.257772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.257848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.257925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.258002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.258081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.258162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.258245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.258327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.258407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.258491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.258574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.258658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.258749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.258828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.258905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.258981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.259056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.259134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.259211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.259286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.259365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.259448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.259527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.259604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.259680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.259770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.259846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.259920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.259998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.260074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.260151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.260225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.260304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.260384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.260461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.260541] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.260651] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.260655] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44871, lrc_seqno=44871, guc_id=0, flags=0x73 in no process [-1]
<7> [226.260658] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.261569] ------------[ cut here ]------------
<4> [226.261571] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.261572] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:12/2640
<4> [226.261645] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.261713] efi_pstore nfnetlink autofs4
<4> [226.261717] CPU: 2 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.261720] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.261721] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.261723] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.261729] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.261797] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.261799] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [226.261801] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.261802] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.261804] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.261805] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.261806] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.261807] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [226.261809] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.261810] CR2: 000000c0004d2000 CR3: 000000012e577006 CR4: 0000000000f72ef0
<4> [226.261812] PKRU: 55555554
<4> [226.261813] Call Trace:
<4> [226.261814] <TASK>
<4> [226.261818] ? lock_sync+0x100/0x100
<4> [226.261822] ? lock_release+0xd0/0x2b0
<4> [226.261828] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.261834] process_one_work+0x239/0x760
<4> [226.261839] worker_thread+0x200/0x3f0
<4> [226.261842] ? __pfx_worker_thread+0x10/0x10
<4> [226.261845] kthread+0x10d/0x150
<4> [226.261848] ? __pfx_kthread+0x10/0x10
<4> [226.261851] ret_from_fork+0x3d4/0x480
<4> [226.261853] ? __pfx_kthread+0x10/0x10
<4> [226.261857] ret_from_fork_asm+0x1a/0x30
<4> [226.261864] </TASK>
<4> [226.261865] irq event stamp: 733291
<4> [226.261866] hardirqs last enabled at (733297): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.261869] hardirqs last disabled at (733302): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.261871] softirqs last enabled at (732370): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.261874] softirqs last disabled at (732363): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.261876] ---[ end trace 0000000000000000 ]---
<6> [226.261878] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.261949] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.261954] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.262371] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.262470] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [226.262578] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.262792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.262881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.262973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.263059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.263145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.263230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.263316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.263406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.263489] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.263584] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.263704] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.264712] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.274696] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.274946] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.275995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.276076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.276151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.276228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.276303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.276378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.276452] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.276526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.276601] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.276674] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.276761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.276836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.276910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.276984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.277057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.277131] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.277205] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.277281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.277356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.277437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.277517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.277595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.277674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.277761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.277838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.277913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.277989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.278071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.278153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.278231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.278310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.278388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.278471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.278553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.278636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.278722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.278801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.278877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.278953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.279028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.279106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.279186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.279265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.279342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.279421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.279499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.279575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.279650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.279737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.279812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.279887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.279965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.280041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.280117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.280193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.280271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.280350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.280428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.280508] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.280617] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.280621] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44871, lrc_seqno=44871, guc_id=0, flags=0x73 in no process [-1]
<7> [226.280624] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.280681] ------------[ cut here ]------------
<4> [226.280682] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.280683] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:12/2640
<4> [226.280769] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.280833] efi_pstore nfnetlink autofs4
<4> [226.280838] CPU: 2 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.280840] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.280842] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.280843] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.280848] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.280918] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.280919] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [226.280922] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.280923] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.280924] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.280925] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.280927] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.280928] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [226.280929] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.280931] CR2: 000000c0004d2000 CR3: 000000012e577006 CR4: 0000000000f72ef0
<4> [226.280932] PKRU: 55555554
<4> [226.280933] Call Trace:
<4> [226.280934] <TASK>
<4> [226.280938] ? lock_sync+0x100/0x100
<4> [226.280943] ? lock_release+0xd0/0x2b0
<4> [226.280948] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.280954] process_one_work+0x239/0x760
<4> [226.280960] worker_thread+0x200/0x3f0
<4> [226.280962] ? __pfx_worker_thread+0x10/0x10
<4> [226.280965] kthread+0x10d/0x150
<4> [226.280968] ? __pfx_kthread+0x10/0x10
<4> [226.280972] ret_from_fork+0x3d4/0x480
<4> [226.280973] ? __pfx_kthread+0x10/0x10
<4> [226.280977] ret_from_fork_asm+0x1a/0x30
<4> [226.280984] </TASK>
<4> [226.280985] irq event stamp: 736461
<4> [226.280986] hardirqs last enabled at (736467): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.280989] hardirqs last disabled at (736472): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.280991] softirqs last enabled at (735546): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.280994] softirqs last disabled at (735535): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.280996] ---[ end trace 0000000000000000 ]---
<5> [226.281644] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44926, lrc_seqno=44926, guc_id=0, flags=0x73 in no process [-1]
<7> [226.281650] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.281866] ------------[ cut here ]------------
<4> [226.281868] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.281871] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:0/12
<4> [226.282024] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.282149] efi_pstore nfnetlink autofs4
<4> [226.282160] CPU: 0 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.282166] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.282169] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.282171] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.282183] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.282355] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.282360] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [226.282364] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.282367] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.282369] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.282371] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.282373] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.282375] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [226.282379] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.282382] CR2: 00007d95ce1b7000 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [226.282385] PKRU: 55555554
<4> [226.282387] Call Trace:
<4> [226.282389] <TASK>
<4> [226.282396] ? lock_sync+0x100/0x100
<4> [226.282406] ? lock_release+0xd0/0x2b0
<4> [226.282415] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.282427] process_one_work+0x239/0x760
<4> [226.282438] worker_thread+0x200/0x3f0
<4> [226.282444] ? __pfx_worker_thread+0x10/0x10
<4> [226.282448] kthread+0x10d/0x150
<4> [226.282452] ? __pfx_kthread+0x10/0x10
<4> [226.282458] ret_from_fork+0x3d4/0x480
<4> [226.282461] ? __pfx_kthread+0x10/0x10
<4> [226.282467] ret_from_fork_asm+0x1a/0x30
<4> [226.282481] </TASK>
<4> [226.282483] irq event stamp: 978309
<4> [226.282485] hardirqs last enabled at (978315): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.282489] hardirqs last disabled at (978320): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.282493] softirqs last enabled at (977542): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.282497] softirqs last disabled at (977537): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.282501] ---[ end trace 0000000000000000 ]---
<6> [226.282504] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<7> [226.282542] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<6> [226.282611] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.282623] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.282645] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [226.282841] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.283089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.283215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.283351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.283482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.283611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.283748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.283875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.284003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.284124] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.284258] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.284419] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.285523] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.295699] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.295961] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.296964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.297044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.297121] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.297198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.297275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.297350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.297424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.297498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.297572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.297650] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.297737] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.297813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.297886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.297959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.298032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.298102] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.298174] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.298246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.298317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.298399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.298481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.298563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.298645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.298737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.298816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.298895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.298972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.299051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.299129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.299209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.299292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.299374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.299461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.299547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.299631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.299722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.299802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.299880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.299958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.300035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.300119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.300199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.300279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.300358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.300441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.300520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.300600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.300677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.300767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.300843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.300918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.301000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.301080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.301159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.301236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.301315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.301390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.301466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.301547] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.301659] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.301664] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44926, lrc_seqno=44926, guc_id=0, flags=0x73 in no process [-1]
<7> [226.301666] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.301745] ------------[ cut here ]------------
<4> [226.301746] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.301747] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:0/12
<4> [226.301819] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.301883] efi_pstore nfnetlink autofs4
<4> [226.301887] CPU: 0 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.301890] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.301891] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.301893] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.301898] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.301968] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.301970] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [226.301972] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.301974] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.301975] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.301976] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.301978] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.301979] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [226.301980] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.301982] CR2: 00007d95ce1b7000 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [226.301983] PKRU: 55555554
<4> [226.301985] Call Trace:
<4> [226.301986] <TASK>
<4> [226.301990] ? lock_sync+0x100/0x100
<4> [226.301994] ? lock_release+0xd0/0x2b0
<4> [226.301999] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.302005] process_one_work+0x239/0x760
<4> [226.302011] worker_thread+0x200/0x3f0
<4> [226.302014] ? __pfx_worker_thread+0x10/0x10
<4> [226.302016] kthread+0x10d/0x150
<4> [226.302019] ? __pfx_kthread+0x10/0x10
<4> [226.302023] ret_from_fork+0x3d4/0x480
<4> [226.302025] ? __pfx_kthread+0x10/0x10
<4> [226.302028] ret_from_fork_asm+0x1a/0x30
<4> [226.302035] </TASK>
<4> [226.302036] irq event stamp: 981425
<4> [226.302037] hardirqs last enabled at (981431): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.302040] hardirqs last disabled at (981436): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.302042] softirqs last enabled at (980416): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.302045] softirqs last disabled at (980409): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.302047] ---[ end trace 0000000000000000 ]---
<6> [226.302049] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.302118] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.302124] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.303363] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.303466] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [226.303571] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.303785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.303877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.303977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.304068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.304157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.304244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.304331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.304419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.304501] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.304599] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.304722] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.305752] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.315696] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.315970] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.317040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.317120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.317199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.317275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.317351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.317425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.317500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.317576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.317650] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.317742] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.317819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.317895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.317971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.318045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.318119] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.318191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.318263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.318338] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.318414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.318495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.318576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.318653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.318739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.318816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.318894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.318971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.319047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.319126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.319205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.319283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.319362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.319441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.319526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.319615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.319706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.319790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.319872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.319950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.320028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.320106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.320185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.320262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.320340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.320419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.320502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.320581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.320660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.320745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.320823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.320899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.320973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.321052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.321128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.321209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.321289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.321369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.321445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.321521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.321599] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.321717] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.321739] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44926, lrc_seqno=44926, guc_id=0, flags=0x73 in no process [-1]
<7> [226.321741] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.321800] ------------[ cut here ]------------
<4> [226.321801] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.321803] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/118
<4> [226.321874] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.321941] efi_pstore nfnetlink autofs4
<4> [226.321945] CPU: 10 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.321948] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.321949] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.321951] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.321956] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.322026] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.322028] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [226.322030] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.322031] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.322033] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.322034] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.322035] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.322036] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [226.322038] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.322039] CR2: 0000775911423058 CR3: 000000012e577002 CR4: 0000000000f72ef0
<4> [226.322041] PKRU: 55555554
<4> [226.322042] Call Trace:
<4> [226.322043] <TASK>
<4> [226.322047] ? lock_sync+0x100/0x100
<4> [226.322052] ? lock_release+0xd0/0x2b0
<4> [226.322057] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.322063] process_one_work+0x239/0x760
<4> [226.322069] worker_thread+0x200/0x3f0
<4> [226.322072] ? __pfx_worker_thread+0x10/0x10
<4> [226.322074] kthread+0x10d/0x150
<4> [226.322077] ? __pfx_kthread+0x10/0x10
<4> [226.322081] ret_from_fork+0x3d4/0x480
<4> [226.322083] ? __pfx_kthread+0x10/0x10
<4> [226.322086] ret_from_fork_asm+0x1a/0x30
<4> [226.322093] </TASK>
<4> [226.322095] irq event stamp: 667997
<4> [226.322096] hardirqs last enabled at (668003): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.322099] hardirqs last disabled at (668008): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.322101] softirqs last enabled at (667186): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.322103] softirqs last disabled at (667179): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.322105] ---[ end trace 0000000000000000 ]---
<5> [226.323580] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44981, lrc_seqno=44981, guc_id=0, flags=0x73 in no process [-1]
<7> [226.323582] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.323643] ------------[ cut here ]------------
<4> [226.323644] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.323646] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/118
<4> [226.323739] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.323803] efi_pstore nfnetlink autofs4
<4> [226.323807] CPU: 10 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.323810] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.323811] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.323812] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.323817] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.323886] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.323888] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [226.323890] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.323891] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.323892] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.323894] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.323896] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.323897] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [226.323899] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.323900] CR2: 0000775911423058 CR3: 000000012e577002 CR4: 0000000000f72ef0
<4> [226.323901] PKRU: 55555554
<4> [226.323903] Call Trace:
<4> [226.323904] <TASK>
<4> [226.323907] ? lock_sync+0x100/0x100
<4> [226.323911] ? lock_release+0xd0/0x2b0
<4> [226.323917] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.323922] process_one_work+0x239/0x760
<4> [226.323928] worker_thread+0x200/0x3f0
<4> [226.323931] ? __pfx_worker_thread+0x10/0x10
<4> [226.323933] kthread+0x10d/0x150
<4> [226.323936] ? __pfx_kthread+0x10/0x10
<4> [226.323940] ret_from_fork+0x3d4/0x480
<4> [226.323942] ? __pfx_kthread+0x10/0x10
<4> [226.323945] ret_from_fork_asm+0x1a/0x30
<4> [226.323952] </TASK>
<4> [226.323953] irq event stamp: 670593
<4> [226.323954] hardirqs last enabled at (670599): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.323957] hardirqs last disabled at (670604): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.323959] softirqs last enabled at (667186): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.323962] softirqs last disabled at (667179): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.323964] ---[ end trace 0000000000000000 ]---
<7> [226.323978] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.324080] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<6> [226.324179] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.324252] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.324258] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.324305] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.324511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.324601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.324701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.324806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.324891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.324976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.325065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.325153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.325236] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.325329] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.325444] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.326490] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.336695] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.336947] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.337995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.338075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.338150] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.338226] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.338301] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.338376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.338452] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.338528] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.338603] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.338678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.338764] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.338838] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.338911] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.338983] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.339057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.339131] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.339207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.339283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.339357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.339439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.339519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.339599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.339679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.339770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.339847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.339923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.340001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.340079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.340158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.340236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.340316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.340399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.340487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.340572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.340655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.340752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.340833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.340911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.340990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.341068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.341147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.341226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.341308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.341388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.341472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.341551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.341630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.341731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.341812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.341888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.341964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.342042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.342120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.342196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.342271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.342347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.342422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.342500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.342581] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.343543] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.343548] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44981, lrc_seqno=44981, guc_id=0, flags=0x73 in no process [-1]
<7> [226.343550] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.343613] ------------[ cut here ]------------
<4> [226.343614] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.343615] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:12/2640
<4> [226.343686] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.343759] efi_pstore nfnetlink autofs4
<4> [226.343764] CPU: 2 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.343768] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.343769] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.343770] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.343776] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.343845] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.343846] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [226.343849] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.343850] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.343851] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.343852] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.343854] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.343855] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [226.343856] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.343858] CR2: 000000c0004d2000 CR3: 000000012e577006 CR4: 0000000000f72ef0
<4> [226.343859] PKRU: 55555554
<4> [226.343860] Call Trace:
<4> [226.343862] <TASK>
<4> [226.343865] ? lock_sync+0x100/0x100
<4> [226.343870] ? lock_release+0xd0/0x2b0
<4> [226.343875] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.343881] process_one_work+0x239/0x760
<4> [226.343887] worker_thread+0x200/0x3f0
<4> [226.343890] ? __pfx_worker_thread+0x10/0x10
<4> [226.343892] kthread+0x10d/0x150
<4> [226.343895] ? __pfx_kthread+0x10/0x10
<4> [226.343899] ret_from_fork+0x3d4/0x480
<4> [226.343901] ? __pfx_kthread+0x10/0x10
<4> [226.343904] ret_from_fork_asm+0x1a/0x30
<4> [226.343911] </TASK>
<4> [226.343913] irq event stamp: 744295
<4> [226.343914] hardirqs last enabled at (744301): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.343917] hardirqs last disabled at (744306): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.343919] softirqs last enabled at (743366): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.343921] softirqs last disabled at (743339): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.343924] ---[ end trace 0000000000000000 ]---
<6> [226.343925] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.343996] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.344002] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.344017] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.344117] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [226.344410] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.344615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.344707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.344802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.344892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.344980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.345067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.345154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.345240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.345322] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.345416] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.345531] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.346554] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.356699] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.356950] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.358034] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.358112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.358187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.358262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.358338] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.358416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.358492] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.358567] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.358640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.358723] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.358797] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.358870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.358942] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.359016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.359091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.359167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.359241] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.359314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.359388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.359468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.359550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.359631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.359715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.359792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.359868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.359945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.360020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.360098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.360177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.360258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.360340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.360419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.360505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.360590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.360674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.360765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.360844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.360920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.360997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.361073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.361151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.361228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.361308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.361389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.361472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.361550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.361628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.361706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.361784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.361859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.361934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.362012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.362089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.362167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.362248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.362329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.362407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.362484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.362564] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.362674] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.362679] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44981, lrc_seqno=44981, guc_id=0, flags=0x73 in no process [-1]
<7> [226.362681] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.362760] ------------[ cut here ]------------
<4> [226.362762] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.362763] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/118
<4> [226.362835] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.362899] efi_pstore nfnetlink autofs4
<4> [226.362903] CPU: 10 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.362906] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.362907] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.362909] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.362914] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.362984] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.362986] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [226.362988] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.362989] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.362990] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.362992] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.362993] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.362994] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [226.362996] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.362997] CR2: 0000775911423058 CR3: 000000012e577002 CR4: 0000000000f72ef0
<4> [226.362999] PKRU: 55555554
<4> [226.363000] Call Trace:
<4> [226.363001] <TASK>
<4> [226.363005] ? lock_sync+0x100/0x100
<4> [226.363009] ? lock_release+0xd0/0x2b0
<4> [226.363015] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.363020] process_one_work+0x239/0x760
<4> [226.363027] worker_thread+0x200/0x3f0
<4> [226.363029] ? __pfx_worker_thread+0x10/0x10
<4> [226.363032] kthread+0x10d/0x150
<4> [226.363035] ? __pfx_kthread+0x10/0x10
<4> [226.363038] ret_from_fork+0x3d4/0x480
<4> [226.363040] ? __pfx_kthread+0x10/0x10
<4> [226.363044] ret_from_fork_asm+0x1a/0x30
<4> [226.363051] </TASK>
<4> [226.363052] irq event stamp: 674111
<4> [226.363053] hardirqs last enabled at (674117): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.363056] hardirqs last disabled at (674122): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.363058] softirqs last enabled at (673002): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.363061] softirqs last disabled at (672995): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.363063] ---[ end trace 0000000000000000 ]---
<5> [226.364807] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45036, lrc_seqno=45036, guc_id=0, flags=0x73 in no process [-1]
<7> [226.364810] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.364870] ------------[ cut here ]------------
<4> [226.364871] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.364873] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/118
<4> [226.364946] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.365008] efi_pstore nfnetlink autofs4
<4> [226.365012] CPU: 10 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.365014] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.365015] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.365017] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.365021] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.365091] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.365093] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [226.365095] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.365096] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.365097] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.365099] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.365100] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.365101] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [226.365102] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.365104] CR2: 0000775911423058 CR3: 000000012e577002 CR4: 0000000000f72ef0
<4> [226.365105] PKRU: 55555554
<4> [226.365106] Call Trace:
<4> [226.365107] <TASK>
<4> [226.365111] ? lock_sync+0x100/0x100
<4> [226.365115] ? lock_release+0xd0/0x2b0
<4> [226.365120] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.365126] process_one_work+0x239/0x760
<4> [226.365131] worker_thread+0x200/0x3f0
<4> [226.365134] ? __pfx_worker_thread+0x10/0x10
<4> [226.365136] kthread+0x10d/0x150
<4> [226.365139] ? __pfx_kthread+0x10/0x10
<4> [226.365143] ret_from_fork+0x3d4/0x480
<4> [226.365145] ? __pfx_kthread+0x10/0x10
<4> [226.365148] ret_from_fork_asm+0x1a/0x30
<4> [226.365155] </TASK>
<4> [226.365156] irq event stamp: 676785
<4> [226.365158] hardirqs last enabled at (676791): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.365160] hardirqs last disabled at (676796): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.365162] softirqs last enabled at (673002): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.365165] softirqs last disabled at (672995): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.365167] ---[ end trace 0000000000000000 ]---
<6> [226.365168] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.365238] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.365245] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.365258] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.365362] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [226.365659] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.365882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.365974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.366068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.366157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.366244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.366328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.366414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.366501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.366587] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.366683] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.366816] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.367828] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.377695] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.377949] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.379025] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.379105] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.379182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.379260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.379337] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.379414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.379489] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.379564] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.379638] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.379722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.379796] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.379871] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.379944] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.380017] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.380094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.380170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.380247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.380322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.380396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.380478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.380559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.380638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.380729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.380807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.380884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.380961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.381037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.381116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.381196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.381275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.381358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.381441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.381529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.381615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.381706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.381788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.381867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.381943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.382020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.382097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.382176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.382254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.382331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.382407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.382487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.382566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.382647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.382736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.382814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.382890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.382968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.383048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.383125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.383201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.383277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.383353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.383431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.383510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.383590] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.383708] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.383712] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45036, lrc_seqno=45036, guc_id=0, flags=0x73 in no process [-1]
<7> [226.383715] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.383774] ------------[ cut here ]------------
<4> [226.383775] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.383777] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:0/12
<4> [226.383847] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.383911] efi_pstore nfnetlink autofs4
<4> [226.383916] CPU: 0 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.383919] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.383920] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.383922] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.383927] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.383997] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.383999] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [226.384001] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.384002] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.384004] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.384005] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.384006] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.384008] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [226.384009] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.384010] CR2: 00007d95ce1b7000 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [226.384012] PKRU: 55555554
<4> [226.384013] Call Trace:
<4> [226.384014] <TASK>
<4> [226.384018] ? lock_sync+0x100/0x100
<4> [226.384023] ? lock_release+0xd0/0x2b0
<4> [226.384028] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.384034] process_one_work+0x239/0x760
<4> [226.384040] worker_thread+0x200/0x3f0
<4> [226.384043] ? __pfx_worker_thread+0x10/0x10
<4> [226.384045] kthread+0x10d/0x150
<4> [226.384048] ? __pfx_kthread+0x10/0x10
<4> [226.384052] ret_from_fork+0x3d4/0x480
<4> [226.384054] ? __pfx_kthread+0x10/0x10
<4> [226.384057] ret_from_fork_asm+0x1a/0x30
<4> [226.384064] </TASK>
<4> [226.384066] irq event stamp: 986981
<4> [226.384067] hardirqs last enabled at (986987): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.384070] hardirqs last disabled at (986992): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.384072] softirqs last enabled at (985872): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.384074] softirqs last disabled at (985867): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.384076] ---[ end trace 0000000000000000 ]---
<6> [226.384078] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.384150] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.384156] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.385391] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.385494] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [226.385599] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.385803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.385893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.385988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.386078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.386165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.386250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.386336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.386423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.386506] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.386603] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.386726] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.387739] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.398463] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.398720] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.399719] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.399799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.399873] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.399945] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.400017] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.400086] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.400155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.400224] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.400293] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.400362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.400430] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.400498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.400566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.400633] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.400704] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.400778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.400851] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.400928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.401005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.401086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.401166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.401245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.401324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.401402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.401481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.401559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.401635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.401721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.401801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.401877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.401955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.402032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.402116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.402198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.402281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.402361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.402439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.402515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.402593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.402668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.402755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.402833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.402908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.402987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.403069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.403149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.403227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.403303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.403381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.403456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.403532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.403610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.403689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.403766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.403844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.403924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.404001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.404077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.404157] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.404268] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.404272] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45036, lrc_seqno=45036, guc_id=0, flags=0x73 in no process [-1]
<7> [226.404274] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.404332] ------------[ cut here ]------------
<4> [226.404333] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.404335] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:12/2640
<4> [226.404405] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.404468] efi_pstore nfnetlink autofs4
<4> [226.404472] CPU: 2 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.404475] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.404476] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.404478] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.404483] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.404552] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.404554] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [226.404556] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.404557] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.404559] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.404560] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.404561] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.404562] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [226.404564] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.404565] CR2: 000000c0004d2000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [226.404567] PKRU: 55555554
<4> [226.404568] Call Trace:
<4> [226.404569] <TASK>
<4> [226.404573] ? lock_sync+0x100/0x100
<4> [226.404577] ? lock_release+0xd0/0x2b0
<4> [226.404583] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.404588] process_one_work+0x239/0x760
<4> [226.404594] worker_thread+0x200/0x3f0
<4> [226.404597] ? __pfx_worker_thread+0x10/0x10
<4> [226.404599] kthread+0x10d/0x150
<4> [226.404602] ? __pfx_kthread+0x10/0x10
<4> [226.404606] ret_from_fork+0x3d4/0x480
<4> [226.404608] ? __pfx_kthread+0x10/0x10
<4> [226.404611] ret_from_fork_asm+0x1a/0x30
<4> [226.404618] </TASK>
<4> [226.404619] irq event stamp: 747645
<4> [226.404620] hardirqs last enabled at (747651): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.404623] hardirqs last disabled at (747656): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.404625] softirqs last enabled at (746674): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.404628] softirqs last disabled at (746667): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.404630] ---[ end trace 0000000000000000 ]---
<5> [226.406372] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45091, lrc_seqno=45091, guc_id=0, flags=0x73 in no process [-1]
<7> [226.406375] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.406434] ------------[ cut here ]------------
<4> [226.406435] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.406437] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:12/2640
<4> [226.406506] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.406568] efi_pstore nfnetlink autofs4
<4> [226.406572] CPU: 2 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.406575] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.406576] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.406577] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.406582] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.406650] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.406652] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [226.406654] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.406655] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.406656] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.406657] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.406659] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.406660] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [226.406661] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.406663] CR2: 000000c0004d2000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [226.406664] PKRU: 55555554
<4> [226.406665] Call Trace:
<4> [226.406666] <TASK>
<4> [226.406670] ? lock_sync+0x100/0x100
<4> [226.406674] ? lock_release+0xd0/0x2b0
<4> [226.406679] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.406685] process_one_work+0x239/0x760
<4> [226.406695] worker_thread+0x200/0x3f0
<4> [226.406698] ? __pfx_worker_thread+0x10/0x10
<4> [226.406701] kthread+0x10d/0x150
<4> [226.406704] ? __pfx_kthread+0x10/0x10
<4> [226.406707] ret_from_fork+0x3d4/0x480
<4> [226.406709] ? __pfx_kthread+0x10/0x10
<4> [226.406713] ret_from_fork_asm+0x1a/0x30
<4> [226.406720] </TASK>
<4> [226.406721] irq event stamp: 750349
<4> [226.406723] hardirqs last enabled at (750355): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.406726] hardirqs last disabled at (750360): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.406728] softirqs last enabled at (750296): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.406730] softirqs last disabled at (750289): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.406732] ---[ end trace 0000000000000000 ]---
<6> [226.406734] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.406803] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.406809] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.407226] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.407324] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [226.407428] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.407631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.407723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.407815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.407903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.407988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.408071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.408156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.408245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.408330] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.408426] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.408540] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.409547] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.419696] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.419944] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.421005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.421083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.421158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.421235] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.421312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.421388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.421462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.421537] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.421610] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.421683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.421772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.421845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.421919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.421995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.422072] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.422148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.422221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.422295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.422369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.422450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.422530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.422609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.422692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.422770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.422847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.422926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.423005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.423085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.423165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.423243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.423321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.423398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.423481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.423563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.423645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.423733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.423813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.423892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.423971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.424048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.424127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.424204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.424282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.424358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.424438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.424515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.424592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.424669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.424759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.424838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.424915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.424995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.425072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.425149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.425226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.425307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.425387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.425466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.425547] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.425657] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.425661] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45091, lrc_seqno=45091, guc_id=0, flags=0x73 in no process [-1]
<7> [226.425663] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.426579] ------------[ cut here ]------------
<4> [226.426581] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.426582] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:12/2640
<4> [226.426653] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.426723] efi_pstore nfnetlink autofs4
<4> [226.426727] CPU: 2 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.426730] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.426731] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.426732] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.426737] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.426807] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.426809] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [226.426811] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.426812] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.426813] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.426815] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.426816] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.426817] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [226.426819] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.426820] CR2: 000000c0004d2000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [226.426821] PKRU: 55555554
<4> [226.426823] Call Trace:
<4> [226.426824] <TASK>
<4> [226.426827] ? lock_sync+0x100/0x100
<4> [226.426832] ? lock_release+0xd0/0x2b0
<4> [226.426837] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.426842] process_one_work+0x239/0x760
<4> [226.426848] worker_thread+0x200/0x3f0
<4> [226.426851] ? __pfx_worker_thread+0x10/0x10
<4> [226.426853] kthread+0x10d/0x150
<4> [226.426856] ? __pfx_kthread+0x10/0x10
<4> [226.426860] ret_from_fork+0x3d4/0x480
<4> [226.426862] ? __pfx_kthread+0x10/0x10
<4> [226.426865] ret_from_fork_asm+0x1a/0x30
<4> [226.426872] </TASK>
<4> [226.426873] irq event stamp: 753483
<4> [226.426874] hardirqs last enabled at (753489): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.426877] hardirqs last disabled at (753494): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.426879] softirqs last enabled at (753006): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.426882] softirqs last disabled at (752995): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.426884] ---[ end trace 0000000000000000 ]---
<6> [226.426886] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.426957] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.426963] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.426977] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.427079] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [226.427410] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.427614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.427706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.427798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.427887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.427978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.428066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.428154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.428240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.428322] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.428416] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.428532] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.429540] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.439693] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.439938] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.441005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.441083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.441160] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.441237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.441314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.441391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.441466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.441544] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.441622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.441700] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.441774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.441848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.441922] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.441995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.442070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.442147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.442223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.442298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.442372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.442453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.442534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.442612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.442698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.442779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.442860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.442937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.443013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.443092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.443170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.443248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.443327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.443405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.443489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.443572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.443655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.443747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.443829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.443906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.443982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.444057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.444135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.444213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.444288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.444362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.444441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.444517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.444594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.444669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.444756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.444831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.444909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.444991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.445070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.445147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.445224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.445302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.445378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.445454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.445538] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.445649] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.445653] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45091, lrc_seqno=45091, guc_id=0, flags=0x73 in no process [-1]
<7> [226.445655] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.446572] ------------[ cut here ]------------
<4> [226.446574] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.446575] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/118
<4> [226.446649] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.446720] efi_pstore nfnetlink autofs4
<4> [226.446724] CPU: 10 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.446727] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.446728] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.446729] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.446734] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.446804] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.446806] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [226.446808] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.446810] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.446811] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.446812] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.446813] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.446815] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [226.446816] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.446818] CR2: 0000775911423058 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [226.446819] PKRU: 55555554
<4> [226.446820] Call Trace:
<4> [226.446821] <TASK>
<4> [226.446825] ? lock_sync+0x100/0x100
<4> [226.446830] ? lock_release+0xd0/0x2b0
<4> [226.446835] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.446841] process_one_work+0x239/0x760
<4> [226.446847] worker_thread+0x200/0x3f0
<4> [226.446850] ? __pfx_worker_thread+0x10/0x10
<4> [226.446852] kthread+0x10d/0x150
<4> [226.446855] ? __pfx_kthread+0x10/0x10
<4> [226.446858] ret_from_fork+0x3d4/0x480
<4> [226.446860] ? __pfx_kthread+0x10/0x10
<4> [226.446864] ret_from_fork_asm+0x1a/0x30
<4> [226.446871] </TASK>
<4> [226.446872] irq event stamp: 682277
<4> [226.446873] hardirqs last enabled at (682283): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.446876] hardirqs last disabled at (682288): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.446878] softirqs last enabled at (681836): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.446881] softirqs last disabled at (681819): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.446883] ---[ end trace 0000000000000000 ]---
<7> [226.447474] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.447576] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [226.447674] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45146, lrc_seqno=45146, guc_id=0, flags=0x73 in no process [-1]
<7> [226.447676] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.447754] ------------[ cut here ]------------
<4> [226.447756] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.447757] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/118
<4> [226.447829] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.447891] efi_pstore nfnetlink autofs4
<4> [226.447895] CPU: 10 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.447898] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.447899] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.447900] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.447905] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.447975] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.447976] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [226.447979] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.447980] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.447981] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.447982] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.447983] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.447985] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [226.447986] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.447987] CR2: 0000775911423058 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [226.447989] PKRU: 55555554
<4> [226.447990] Call Trace:
<4> [226.447991] <TASK>
<4> [226.447995] ? lock_sync+0x100/0x100
<4> [226.447999] ? lock_release+0xd0/0x2b0
<4> [226.448004] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.448010] process_one_work+0x239/0x760
<4> [226.448015] worker_thread+0x200/0x3f0
<4> [226.448018] ? __pfx_worker_thread+0x10/0x10
<4> [226.448020] kthread+0x10d/0x150
<4> [226.448023] ? __pfx_kthread+0x10/0x10
<4> [226.448027] ret_from_fork+0x3d4/0x480
<4> [226.448029] ? __pfx_kthread+0x10/0x10
<4> [226.448032] ret_from_fork_asm+0x1a/0x30
<4> [226.448039] </TASK>
<4> [226.448040] irq event stamp: 684963
<4> [226.448042] hardirqs last enabled at (684969): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.448044] hardirqs last disabled at (684974): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.448046] softirqs last enabled at (684196): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.448049] softirqs last disabled at (684189): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.448051] ---[ end trace 0000000000000000 ]---
<6> [226.448052] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.448122] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.448128] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.448533] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.448756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.448845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.448935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.449025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.449113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.449199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.449285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.449372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.449454] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.449548] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.449663] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.450678] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.460694] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.460942] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.462023] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.462103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.462180] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.462258] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.462335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.462410] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.462486] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.462561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.462636] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.462717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.462791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.462864] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.462936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.463009] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.463082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.463155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.463229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.463305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.463383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.463466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.463546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.463624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.463707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.463784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.463860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.463937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.464014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.464095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.464177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.464256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.464334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.464413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.464498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.464581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.464665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.464753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.464837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.464919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.464999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.465075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.465155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.465232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.465308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.465385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.465466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.465543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.465620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.465698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.465776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.465853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.465934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.466016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.466096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.466173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.466250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.466328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.466404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.466479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.466558] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.466668] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.466672] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45146, lrc_seqno=45146, guc_id=0, flags=0x73 in no process [-1]
<7> [226.466674] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.466756] ------------[ cut here ]------------
<4> [226.466757] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.466758] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:12/2640
<4> [226.466830] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.466893] efi_pstore nfnetlink autofs4
<4> [226.466897] CPU: 2 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.466900] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.466901] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.466903] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.466908] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.466977] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.466979] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [226.466981] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.466982] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.466984] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.466985] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.466986] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.466987] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [226.466989] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.466990] CR2: 000000c0004d2000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [226.466991] PKRU: 55555554
<4> [226.466993] Call Trace:
<4> [226.466994] <TASK>
<4> [226.466997] ? lock_sync+0x100/0x100
<4> [226.467002] ? lock_release+0xd0/0x2b0
<4> [226.467007] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.467012] process_one_work+0x239/0x760
<4> [226.467018] worker_thread+0x200/0x3f0
<4> [226.467021] ? __pfx_worker_thread+0x10/0x10
<4> [226.467023] kthread+0x10d/0x150
<4> [226.467026] ? __pfx_kthread+0x10/0x10
<4> [226.467030] ret_from_fork+0x3d4/0x480
<4> [226.467032] ? __pfx_kthread+0x10/0x10
<4> [226.467035] ret_from_fork_asm+0x1a/0x30
<4> [226.467042] </TASK>
<4> [226.467043] irq event stamp: 758773
<4> [226.467044] hardirqs last enabled at (758779): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.467047] hardirqs last disabled at (758784): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.467049] softirqs last enabled at (758006): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.467052] softirqs last disabled at (757989): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.467054] ---[ end trace 0000000000000000 ]---
<6> [226.467056] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.467125] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.467131] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.468369] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.468472] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [226.468579] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.468788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.468878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.468970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.469056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.469140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.469223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.469307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.469393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.469476] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.469571] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.469692] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.470702] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.480694] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.480939] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.482009] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.482089] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.482167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.482244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.482321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.482398] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.482476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.482552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.482628] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.482709] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.482783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.482856] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.482930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.483003] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.483076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.483148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.483221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.483294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.483367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.483448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.483529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.483608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.483692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.483770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.483847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.483922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.483998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.484076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.484158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.484239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.484320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.484400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.484485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.484568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.484651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.484741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.484823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.484903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.484981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.485058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.485138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.485216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.485296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.485375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.485457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.485534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.485612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.485692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.485773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.485848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.485923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.486000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.486077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.486157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.486236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.486315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.486392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.486468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.486547] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.486658] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.486662] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45146, lrc_seqno=45146, guc_id=0, flags=0x73 in no process [-1]
<7> [226.486664] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.486743] ------------[ cut here ]------------
<4> [226.486744] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.486745] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:0/12
<4> [226.486815] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.486879] efi_pstore nfnetlink autofs4
<4> [226.486883] CPU: 0 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.486886] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.486887] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.486888] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.486894] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.486963] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.486964] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [226.486967] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.486968] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.486969] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.486971] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.486972] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.486973] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [226.486975] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.486976] CR2: 00007d95ce1b7000 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [226.486978] PKRU: 55555554
<4> [226.486979] Call Trace:
<4> [226.486980] <TASK>
<4> [226.486984] ? lock_sync+0x100/0x100
<4> [226.486988] ? lock_release+0xd0/0x2b0
<4> [226.486994] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.486999] process_one_work+0x239/0x760
<4> [226.487005] worker_thread+0x200/0x3f0
<4> [226.487008] ? __pfx_worker_thread+0x10/0x10
<4> [226.487011] kthread+0x10d/0x150
<4> [226.487013] ? __pfx_kthread+0x10/0x10
<4> [226.487017] ret_from_fork+0x3d4/0x480
<4> [226.487019] ? __pfx_kthread+0x10/0x10
<4> [226.487022] ret_from_fork_asm+0x1a/0x30
<4> [226.487030] </TASK>
<4> [226.487031] irq event stamp: 990331
<4> [226.487032] hardirqs last enabled at (990337): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.487035] hardirqs last disabled at (990342): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.487037] softirqs last enabled at (989410): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.487039] softirqs last disabled at (989403): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.487042] ---[ end trace 0000000000000000 ]---
<5> [226.487630] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45201, lrc_seqno=45201, guc_id=0, flags=0x73 in no process [-1]
<7> [226.487632] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.488699] ------------[ cut here ]------------
<4> [226.488701] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.488703] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:0/12
<4> [226.488839] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.488903] efi_pstore nfnetlink autofs4
<4> [226.488907] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.488910] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.488911] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.488913] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.488918] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.488991] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.488992] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [226.488995] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.488996] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.488997] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<7> [226.488949] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<4> [226.488999] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.489000] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.489001] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [226.489003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.489004] CR2: 00007d95ce1b2000 CR3: 000000011b2a9006 CR4: 0000000000f72ef0
<4> [226.489005] PKRU: 55555554
<4> [226.489006] Call Trace:
<4> [226.489007] <TASK>
<4> [226.489011] ? lock_sync+0x100/0x100
<4> [226.489015] ? lock_release+0xd0/0x2b0
<4> [226.489020] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.489026] process_one_work+0x239/0x760
<4> [226.489032] worker_thread+0x200/0x3f0
<4> [226.489034] ? __pfx_worker_thread+0x10/0x10
<4> [226.489037] kthread+0x10d/0x150
<4> [226.489039] ? __pfx_kthread+0x10/0x10
<4> [226.489043] ret_from_fork+0x3d4/0x480
<4> [226.489044] ? __pfx_kthread+0x10/0x10
<4> [226.489047] ret_from_fork_asm+0x1a/0x30
<4> [226.489055] </TASK>
<4> [226.489056] irq event stamp: 993051
<4> [226.489057] hardirqs last enabled at (993057): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.489060] hardirqs last disabled at (993062): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.489062] softirqs last enabled at (992278): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.489065] softirqs last disabled at (992267): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.489067] ---[ end trace 0000000000000000 ]---
<7> [226.489055] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<6> [226.489069] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.489141] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.489148] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.489331] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.489535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.489625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.489723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.489812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.489899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.489988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.490078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.490167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.490250] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.490346] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.490462] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.491470] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.501699] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.501950] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.502934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.503012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.503087] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.503163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.503239] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.503313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.503388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.503461] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.503536] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.503613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.503691] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.503765] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.503838] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.503911] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.503984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.504058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.504130] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.504203] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.504276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.504357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.504439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.504518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.504598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.504676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.504769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.504850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.504931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.505012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.505093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.505172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.505250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.505330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.505415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.505504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.505591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.505674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.505767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.505845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.505924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.506000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.506080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.506157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.506233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.506309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.506393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.506472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.506550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.506628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.506709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.506785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.506859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.506937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.507013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.507089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.507164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.507241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.507316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.507391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.507470] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.507583] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.507587] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45201, lrc_seqno=45201, guc_id=0, flags=0x73 in no process [-1]
<7> [226.507590] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.507649] ------------[ cut here ]------------
<4> [226.507650] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.507652] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:0/12
<4> [226.507732] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.507796] efi_pstore nfnetlink autofs4
<4> [226.507800] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.507803] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.507804] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.507805] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.507810] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.507881] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.507882] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [226.507885] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.507886] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.507887] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.507888] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.507890] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.507891] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [226.507892] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.507894] CR2: 00007d95ce1b2000 CR3: 000000011b2a9006 CR4: 0000000000f72ef0
<4> [226.507895] PKRU: 55555554
<4> [226.507896] Call Trace:
<4> [226.507898] <TASK>
<4> [226.507901] ? lock_sync+0x100/0x100
<4> [226.507906] ? lock_release+0xd0/0x2b0
<4> [226.507911] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.507917] process_one_work+0x239/0x760
<4> [226.507923] worker_thread+0x200/0x3f0
<4> [226.507925] ? __pfx_worker_thread+0x10/0x10
<4> [226.507928] kthread+0x10d/0x150
<4> [226.507931] ? __pfx_kthread+0x10/0x10
<4> [226.507934] ret_from_fork+0x3d4/0x480
<4> [226.507936] ? __pfx_kthread+0x10/0x10
<4> [226.507939] ret_from_fork_asm+0x1a/0x30
<4> [226.507947] </TASK>
<4> [226.507948] irq event stamp: 996153
<4> [226.507949] hardirqs last enabled at (996159): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.507952] hardirqs last disabled at (996164): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.507954] softirqs last enabled at (995152): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.507956] softirqs last disabled at (995145): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.507959] ---[ end trace 0000000000000000 ]---
<6> [226.507961] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.508029] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.508035] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.509277] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.509380] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [226.509485] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.509692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.509781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.509876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.509967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.510054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.510138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.510226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.510314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.510396] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.510492] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.510607] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.511610] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.521693] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.521939] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.522940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.523020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.523097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.523174] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.523251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.523327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.523403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.523481] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.523556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.523631] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.523710] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.523785] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.523860] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.523933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.524007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.524079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.524152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.524226] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.524302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.524385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.524467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.524545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.524625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.524704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.524781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.524857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.524934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.525012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.525093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.525170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.525248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.525326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.525409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.525497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.525587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.525671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.525772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.525850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.525929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.526005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.526086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.526165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.526240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.526315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.526395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.526474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.526556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.526634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.526718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.526795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.526872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.526951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.527028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.527104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.527178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.527254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.527329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.527404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.527482] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.527592] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.527596] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45201, lrc_seqno=45201, guc_id=0, flags=0x73 in no process [-1]
<7> [226.527598] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.527656] ------------[ cut here ]------------
<4> [226.527657] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.527658] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/118
<4> [226.527738] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.527802] efi_pstore nfnetlink autofs4
<4> [226.527806] CPU: 10 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.527809] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.527810] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.527812] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.527816] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.527885] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.527887] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [226.527889] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.527890] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.527891] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.527893] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.527894] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.527895] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [226.527897] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.527898] CR2: 0000775911423058 CR3: 0000000111124001 CR4: 0000000000f72ef0
<4> [226.527900] PKRU: 55555554
<4> [226.527901] Call Trace:
<4> [226.527902] <TASK>
<4> [226.527906] ? lock_sync+0x100/0x100
<4> [226.527910] ? lock_release+0xd0/0x2b0
<4> [226.527915] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.527921] process_one_work+0x239/0x760
<4> [226.527927] worker_thread+0x200/0x3f0
<4> [226.527930] ? __pfx_worker_thread+0x10/0x10
<4> [226.527932] kthread+0x10d/0x150
<4> [226.527935] ? __pfx_kthread+0x10/0x10
<4> [226.527939] ret_from_fork+0x3d4/0x480
<4> [226.527941] ? __pfx_kthread+0x10/0x10
<4> [226.527944] ret_from_fork_asm+0x1a/0x30
<4> [226.527951] </TASK>
<4> [226.527952] irq event stamp: 690427
<4> [226.527953] hardirqs last enabled at (690433): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.527956] hardirqs last disabled at (690438): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.527958] softirqs last enabled at (689512): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.527961] softirqs last disabled at (689505): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.527963] ---[ end trace 0000000000000000 ]---
<5> [226.530027] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45256, lrc_seqno=45256, guc_id=0, flags=0x73 in no process [-1]
<7> [226.530033] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<7> [226.530036] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<4> [226.530105] ------------[ cut here ]------------
<4> [226.530106] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.530107] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:12/2640
<4> [226.530188] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy
<7> [226.530143] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<4> [226.530193] mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4
<4> [226.530264] CPU: 2 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.530267] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.530268] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.530269] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.530275] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.530351] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.530353] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [226.530356] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.530357] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.530358] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.530360] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.530361] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.530362] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [226.530364] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.530365] CR2: 000000c0004d2000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [226.530367] PKRU: 55555554
<4> [226.530368] Call Trace:
<4> [226.530369] <TASK>
<4> [226.530373] ? lock_sync+0x100/0x100
<4> [226.530378] ? lock_release+0xd0/0x2b0
<4> [226.530384] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.530390] process_one_work+0x239/0x760
<4> [226.530396] worker_thread+0x200/0x3f0
<4> [226.530398] ? __pfx_worker_thread+0x10/0x10
<4> [226.530401] kthread+0x10d/0x150
<4> [226.530404] ? __pfx_kthread+0x10/0x10
<4> [226.530407] ret_from_fork+0x3d4/0x480
<4> [226.530409] ? __pfx_kthread+0x10/0x10
<4> [226.530413] ret_from_fork_asm+0x1a/0x30
<4> [226.530420] </TASK>
<4> [226.530421] irq event stamp: 768409
<4> [226.530422] hardirqs last enabled at (768415): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.530425] hardirqs last disabled at (768420): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.530427] softirqs last enabled at (759626): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.530430] softirqs last disabled at (759621): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.530432] ---[ end trace 0000000000000000 ]---
<6> [226.530434] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.530509] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.530515] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.531054] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.531259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.531348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.531444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.531533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.531621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.531711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.531797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.531883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.531966] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.532059] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.532176] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.533182] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.543724] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.543973] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.545297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.545376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.545451] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.545529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.545605] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.545679] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.545769] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.545843] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.545916] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.545988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.546061] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.546133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.546205] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.546278] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.546351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.546428] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.546505] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.546581] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.546655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.546744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.546825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.546903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.546985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.547064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.547143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.547220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.547296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.547375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.547454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.547532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.547616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.547701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.547787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.547872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.547956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.548037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.548117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.548194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.548273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.548353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.548435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.548513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.548591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.548666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.548754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.548831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.548910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.548989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.549069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.549147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.549223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.549302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.549379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.549454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.549529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.549606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.549681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.549769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.549848] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.549957] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.549966] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45256, lrc_seqno=45256, guc_id=0, flags=0x73 in no process [-1]
<7> [226.549971] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.550161] ------------[ cut here ]------------
<4> [226.550163] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.550165] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:12/2640
<4> [226.550259] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.550329] efi_pstore nfnetlink autofs4
<4> [226.550334] CPU: 2 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.550338] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.550339] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.550341] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.550348] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.550429] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.550431] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [226.550433] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.550435] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.550436] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.550437] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.550439] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.550440] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [226.550441] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.550443] CR2: 000000c0004d2000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [226.550444] PKRU: 55555554
<4> [226.550446] Call Trace:
<4> [226.550447] <TASK>
<4> [226.550452] ? lock_sync+0x100/0x100
<4> [226.550457] ? lock_release+0xd0/0x2b0
<4> [226.550463] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.550469] process_one_work+0x239/0x760
<4> [226.550475] worker_thread+0x200/0x3f0
<4> [226.550477] ? __pfx_worker_thread+0x10/0x10
<4> [226.550480] kthread+0x10d/0x150
<4> [226.550484] ? __pfx_kthread+0x10/0x10
<4> [226.550487] ret_from_fork+0x3d4/0x480
<4> [226.550489] ? __pfx_kthread+0x10/0x10
<4> [226.550493] ret_from_fork_asm+0x1a/0x30
<4> [226.550501] </TASK>
<4> [226.550503] irq event stamp: 769455
<4> [226.550504] hardirqs last enabled at (769461): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.550508] hardirqs last disabled at (769466): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.550510] softirqs last enabled at (759626): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.550513] softirqs last disabled at (759621): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.550515] ---[ end trace 0000000000000000 ]---
<6> [226.550517] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.550602] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.550612] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.550901] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.551004] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [226.551109] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.551311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.551401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.551493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.551579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.551664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.551757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.551842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.551927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.552009] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.552102] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.552219] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.553226] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.563697] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.563946] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.564992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.565069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.565144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.565219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.565294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.565368] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.565443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.565519] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.565594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.565671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.565758] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.565834] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.565909] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.565984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.566058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.566132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.566206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.566280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.566354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.566434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.566514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.566591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.566672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.566764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.566844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.566921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.566997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.567076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.567155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.567232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.567308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.567386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.567469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.567552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.567634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.567719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.567798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.567874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.567953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.568033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.568114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.568192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.568270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.568346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.568425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.568500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.568577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.568653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.568738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.568812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.568887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.568965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.569042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.569117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.569191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.569269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.569343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.569417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.569495] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.569604] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.569608] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45256, lrc_seqno=45256, guc_id=0, flags=0x73 in no process [-1]
<7> [226.569610] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.569668] ------------[ cut here ]------------
<4> [226.569669] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.569670] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:0/12
<4> [226.569753] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.569818] efi_pstore nfnetlink autofs4
<4> [226.569822] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.569825] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.569826] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.569828] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.569832] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.569903] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.569904] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [226.569906] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.569908] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.569909] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.569910] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.569911] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.569913] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [226.569914] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.569916] CR2: 00007d95ce1b2000 CR3: 000000011b2a9006 CR4: 0000000000f72ef0
<4> [226.569917] PKRU: 55555554
<4> [226.569918] Call Trace:
<4> [226.569919] <TASK>
<4> [226.569923] ? lock_sync+0x100/0x100
<4> [226.569927] ? lock_release+0xd0/0x2b0
<4> [226.569933] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.569938] process_one_work+0x239/0x760
<4> [226.569944] worker_thread+0x200/0x3f0
<4> [226.569947] ? __pfx_worker_thread+0x10/0x10
<4> [226.569950] kthread+0x10d/0x150
<4> [226.569952] ? __pfx_kthread+0x10/0x10
<4> [226.569956] ret_from_fork+0x3d4/0x480
<4> [226.569958] ? __pfx_kthread+0x10/0x10
<4> [226.569962] ret_from_fork_asm+0x1a/0x30
<4> [226.569969] </TASK>
<4> [226.569970] irq event stamp: 999505
<4> [226.569971] hardirqs last enabled at (999511): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.569974] hardirqs last disabled at (999516): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.569976] softirqs last enabled at (998496): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.569979] softirqs last disabled at (998489): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.569981] ---[ end trace 0000000000000000 ]---
<5> [226.571720] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45311, lrc_seqno=45311, guc_id=0, flags=0x73 in no process [-1]
<7> [226.571723] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.571782] ------------[ cut here ]------------
<4> [226.571784] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.571785] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:0/12
<4> [226.571854] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.571915] efi_pstore nfnetlink autofs4
<4> [226.571920] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.571922] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.571923] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.571924] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.571929] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.571996] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.571998] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [226.572000] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.572001] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.572002] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.572004] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.572005] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.572006] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [226.572007] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.572009] CR2: 00007d95ce1b2000 CR3: 000000011b2a9006 CR4: 0000000000f72ef0
<4> [226.572010] PKRU: 55555554
<4> [226.572011] Call Trace:
<4> [226.572012] <TASK>
<4> [226.572016] ? lock_sync+0x100/0x100
<4> [226.572020] ? lock_release+0xd0/0x2b0
<4> [226.572026] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.572031] process_one_work+0x239/0x760
<4> [226.572037] worker_thread+0x200/0x3f0
<4> [226.572039] ? __pfx_worker_thread+0x10/0x10
<4> [226.572042] kthread+0x10d/0x150
<4> [226.572045] ? __pfx_kthread+0x10/0x10
<4> [226.572048] ret_from_fork+0x3d4/0x480
<4> [226.572050] ? __pfx_kthread+0x10/0x10
<4> [226.572053] ret_from_fork_asm+0x1a/0x30
<4> [226.572060] </TASK>
<4> [226.572062] irq event stamp: 1002185
<4> [226.572063] hardirqs last enabled at (1002191): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.572065] hardirqs last disabled at (1002196): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.572067] softirqs last enabled at (998496): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.572070] softirqs last disabled at (998489): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.572072] ---[ end trace 0000000000000000 ]---
<6> [226.572074] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.572143] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.572148] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.572562] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.572665] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [226.572780] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.572982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.573070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.573163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.573250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.573337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.573423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.573509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.573597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.573682] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.573796] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.573913] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.574920] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.584693] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.584940] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.586036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.586115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.586190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.586268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.586346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.586423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.586499] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.586573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.586648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.586736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.586813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.586889] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.586964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.587039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.587114] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.587187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.587260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.587333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.587407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.587490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.587573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.587652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.587741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.587820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.587900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.587978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.588056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.588136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.588216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.588294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.588372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.588451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.588535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.588618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.588705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.588791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.588875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.588954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.589032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.589108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.589188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.589265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.589340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.589415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.589498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.589576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.589654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.589737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.589814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.589889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.589964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.590042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.590117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.590193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.590267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.590348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.590425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.590501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.590581] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.591533] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.591537] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45311, lrc_seqno=45311, guc_id=0, flags=0x73 in no process [-1]
<7> [226.591539] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.591597] ------------[ cut here ]------------
<4> [226.591599] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.591600] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:0/12
<4> [226.591671] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.591740] efi_pstore nfnetlink autofs4
<4> [226.591744] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.591747] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.591748] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.591749] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.591754] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.591824] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.591826] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [226.591828] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.591829] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.591831] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.591832] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.591833] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.591834] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [226.591836] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.591837] CR2: 00007d95ce1b2000 CR3: 000000011b2a9006 CR4: 0000000000f72ef0
<4> [226.591839] PKRU: 55555554
<4> [226.591840] Call Trace:
<4> [226.591841] <TASK>
<4> [226.591845] ? lock_sync+0x100/0x100
<4> [226.591849] ? lock_release+0xd0/0x2b0
<4> [226.591854] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.591860] process_one_work+0x239/0x760
<4> [226.591866] worker_thread+0x200/0x3f0
<4> [226.591868] ? __pfx_worker_thread+0x10/0x10
<4> [226.591871] kthread+0x10d/0x150
<4> [226.591874] ? __pfx_kthread+0x10/0x10
<4> [226.591877] ret_from_fork+0x3d4/0x480
<4> [226.591879] ? __pfx_kthread+0x10/0x10
<4> [226.591883] ret_from_fork_asm+0x1a/0x30
<4> [226.591890] </TASK>
<4> [226.591891] irq event stamp: 1005321
<4> [226.591892] hardirqs last enabled at (1005327): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.591895] hardirqs last disabled at (1005332): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.591897] softirqs last enabled at (1004684): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.591900] softirqs last disabled at (1004679): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.591902] ---[ end trace 0000000000000000 ]---
<6> [226.591904] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.591975] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.591981] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.591995] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.592098] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [226.592390] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.592615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.592717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.592815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.592907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.592999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.593092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.593185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.593278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.593365] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.593466] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.593589] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.594598] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.604693] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.604945] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.605997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.606082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.606162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.606245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.606327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.606407] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.606487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.606566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.606644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.606731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.606812] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.606889] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.606968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.607049] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.607129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.607208] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.607288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.607366] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.607443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.607528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.607613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.607701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.607788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.607870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.607952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.608032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.608111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.608196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.608280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.608362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.608446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.608531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.608622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.608716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.608806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.608893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.608977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.609059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.609140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.609224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.609313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.609397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.609481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.609563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.609651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.609745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.609831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.609914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.609997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.610078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.610159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.610243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.610327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.610410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.610491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.610574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.610654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.610749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.610834] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.610950] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.610954] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45311, lrc_seqno=45311, guc_id=0, flags=0x73 in no process [-1]
<7> [226.610956] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.611017] ------------[ cut here ]------------
<4> [226.611019] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.611020] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:12/2640
<4> [226.611097] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.611159] efi_pstore nfnetlink autofs4
<4> [226.611164] CPU: 2 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.611166] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.611168] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.611169] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.611174] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.611249] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.611251] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [226.611253] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.611254] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.611256] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.611257] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.611258] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.611259] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [226.611261] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.611262] CR2: 000000c0004d2000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [226.611264] PKRU: 55555554
<4> [226.611265] Call Trace:
<4> [226.611266] <TASK>
<4> [226.611270] ? lock_sync+0x100/0x100
<4> [226.611275] ? lock_release+0xd0/0x2b0
<4> [226.611280] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.611286] process_one_work+0x239/0x760
<4> [226.611292] worker_thread+0x200/0x3f0
<4> [226.611295] ? __pfx_worker_thread+0x10/0x10
<4> [226.611298] kthread+0x10d/0x150
<4> [226.611301] ? __pfx_kthread+0x10/0x10
<4> [226.611304] ret_from_fork+0x3d4/0x480
<4> [226.611306] ? __pfx_kthread+0x10/0x10
<4> [226.611310] ret_from_fork_asm+0x1a/0x30
<4> [226.611317] </TASK>
<4> [226.611318] irq event stamp: 772803
<4> [226.611319] hardirqs last enabled at (772809): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.611322] hardirqs last disabled at (772814): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.611324] softirqs last enabled at (771948): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.611327] softirqs last disabled at (771915): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.611329] ---[ end trace 0000000000000000 ]---
<5> [226.613067] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45366, lrc_seqno=45366, guc_id=0, flags=0x73 in no process [-1]
<7> [226.613070] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.613133] ------------[ cut here ]------------
<4> [226.613134] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.613136] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:12/2640
<4> [226.613209] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.613271] efi_pstore nfnetlink autofs4
<4> [226.613275] CPU: 2 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.613277] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.613279] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.613280] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.613285] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.613357] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.613358] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [226.613360] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.613362] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.613363] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.613364] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.613365] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.613366] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [226.613368] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.613369] CR2: 000000c0004d2000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [226.613370] PKRU: 55555554
<4> [226.613372] Call Trace:
<4> [226.613373] <TASK>
<4> [226.613376] ? lock_sync+0x100/0x100
<4> [226.613380] ? lock_release+0xd0/0x2b0
<4> [226.613386] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.613391] process_one_work+0x239/0x760
<4> [226.613397] worker_thread+0x200/0x3f0
<4> [226.613400] ? __pfx_worker_thread+0x10/0x10
<4> [226.613402] kthread+0x10d/0x150
<4> [226.613405] ? __pfx_kthread+0x10/0x10
<4> [226.613409] ret_from_fork+0x3d4/0x480
<4> [226.613411] ? __pfx_kthread+0x10/0x10
<4> [226.613414] ret_from_fork_asm+0x1a/0x30
<4> [226.613422] </TASK>
<4> [226.613423] irq event stamp: 775479
<4> [226.613424] hardirqs last enabled at (775485): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.613426] hardirqs last disabled at (775490): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.613429] softirqs last enabled at (771948): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.613431] softirqs last disabled at (771915): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.613433] ---[ end trace 0000000000000000 ]---
<6> [226.613435] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.613509] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.613514] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.613931] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.614041] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [226.614153] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.614359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.614451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.614549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.614641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.614742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.614833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.614927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.615020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.615108] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.615206] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.615326] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.616339] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.626692] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.626945] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.628006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.628091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.628172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.628254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.628334] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.628414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.628493] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.628572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.628654] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.628748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.628830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.628909] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.628988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.629066] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.629144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.629223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.629302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.629383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.629466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.629553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.629638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.629730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.629819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.629902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.629985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.630067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.630148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.630233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.630321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.630407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.630492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.630576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.630664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.630760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.630849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.630936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.631022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.631108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.631192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.631272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.631356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.631438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.631519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.631603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.631696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.631779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.631861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.631942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.632025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.632105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.632186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.632268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.632354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.632439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.632523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.632607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.632690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.632771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.632854] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.632969] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.632973] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45366, lrc_seqno=45366, guc_id=0, flags=0x73 in no process [-1]
<7> [226.632975] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.633036] ------------[ cut here ]------------
<4> [226.633037] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.633038] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:12/2640
<4> [226.633115] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.633177] efi_pstore nfnetlink autofs4
<4> [226.633181] CPU: 2 UID: 0 PID: 2640 Comm: kworker/u64:12 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.633184] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.633185] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.633186] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.633192] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.633266] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.633268] RSP: 0018:ffffc900045d7ca0 EFLAGS: 00010246
<4> [226.633270] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.633271] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.633272] RBP: ffffc900045d7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.633274] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.633275] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.633276] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [226.633278] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.633279] CR2: 000000c0004d2000 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [226.633281] PKRU: 55555554
<4> [226.633282] Call Trace:
<4> [226.633283] <TASK>
<4> [226.633287] ? lock_sync+0x100/0x100
<4> [226.633291] ? lock_release+0xd0/0x2b0
<4> [226.633296] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.633302] process_one_work+0x239/0x760
<4> [226.633308] worker_thread+0x200/0x3f0
<4> [226.633311] ? __pfx_worker_thread+0x10/0x10
<4> [226.633313] kthread+0x10d/0x150
<4> [226.633316] ? __pfx_kthread+0x10/0x10
<4> [226.633319] ret_from_fork+0x3d4/0x480
<4> [226.633321] ? __pfx_kthread+0x10/0x10
<4> [226.633325] ret_from_fork_asm+0x1a/0x30
<4> [226.633332] </TASK>
<4> [226.633333] irq event stamp: 778611
<4> [226.633334] hardirqs last enabled at (778617): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.633337] hardirqs last disabled at (778622): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.633339] softirqs last enabled at (777496): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.633342] softirqs last disabled at (777489): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.633344] ---[ end trace 0000000000000000 ]---
<6> [226.633345] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.633419] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.633425] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.634668] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.634791] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [226.634901] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.635106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.635196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.635289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.635376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.635463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.635548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.635632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.635726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.635807] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.635900] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.636017] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.637025] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.647692] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.647939] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.649019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.649100] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.649176] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.649253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.649328] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.649403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.649477] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.649551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.649625] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.649702] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.649779] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.649855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.649930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.650003] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.650079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.650153] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.650226] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.650300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.650374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.650454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.650534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.650615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.650701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.650778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.650854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.650929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.651004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.651083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.651162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.651241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.651321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.651400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.651484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.651567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.651650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.651739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.651819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.651896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.651974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.652053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.652134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.652212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.652289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.652365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.652446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.652521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.652599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.652677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.652769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.652846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.652921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.652999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.653075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.653151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.653227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.653305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.653380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.653455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.653532] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.653642] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.653646] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45366, lrc_seqno=45366, guc_id=0, flags=0x73 in no process [-1]
<7> [226.653649] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.653718] ------------[ cut here ]------------
<4> [226.653719] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.653721] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:0/12
<4> [226.653793] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.653855] efi_pstore nfnetlink autofs4
<4> [226.653860] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.653863] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.653864] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.653865] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.653871] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.653941] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.653942] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [226.653945] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.653946] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.653947] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.653949] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.653950] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.653951] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [226.653953] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.653954] CR2: 00007d95ce1b2000 CR3: 000000012e577002 CR4: 0000000000f72ef0
<4> [226.653956] PKRU: 55555554
<4> [226.653957] Call Trace:
<4> [226.653958] <TASK>
<4> [226.653962] ? lock_sync+0x100/0x100
<4> [226.653966] ? lock_release+0xd0/0x2b0
<4> [226.653971] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.653977] process_one_work+0x239/0x760
<4> [226.653983] worker_thread+0x200/0x3f0
<4> [226.653986] ? __pfx_worker_thread+0x10/0x10
<4> [226.653988] kthread+0x10d/0x150
<4> [226.653991] ? __pfx_kthread+0x10/0x10
<4> [226.653994] ret_from_fork+0x3d4/0x480
<4> [226.653996] ? __pfx_kthread+0x10/0x10
<4> [226.654000] ret_from_fork_asm+0x1a/0x30
<4> [226.654007] </TASK>
<4> [226.654008] irq event stamp: 1008661
<4> [226.654009] hardirqs last enabled at (1008667): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.654012] hardirqs last disabled at (1008672): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.654014] softirqs last enabled at (1007894): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.654016] softirqs last disabled at (1007887): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.654019] ---[ end trace 0000000000000000 ]---
<5> [226.654601] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45421, lrc_seqno=45421, guc_id=0, flags=0x73 in no process [-1]
<7> [226.654604] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.654663] ------------[ cut here ]------------
<4> [226.654664] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.654665] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:0/12
<4> [226.654745] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.654808] efi_pstore nfnetlink autofs4
<4> [226.654812] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.654815] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.654816] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.654817] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.654821] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.654889] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.654891] RSP: 0018:ffffc900000b7ca0 EFLAGS: 00010246
<4> [226.654893] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.654894] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.654895] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.654897] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.654898] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.654899] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [226.654900] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.654902] CR2: 00007d95ce1b2000 CR3: 000000012e577002 CR4: 0000000000f72ef0
<4> [226.654903] PKRU: 55555554
<4> [226.654904] Call Trace:
<4> [226.654905] <TASK>
<4> [226.654909] ? lock_sync+0x100/0x100
<4> [226.654913] ? lock_release+0xd0/0x2b0
<4> [226.654918] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.654923] process_one_work+0x239/0x760
<4> [226.654929] worker_thread+0x200/0x3f0
<4> [226.654932] ? __pfx_worker_thread+0x10/0x10
<4> [226.654934] kthread+0x10d/0x150
<4> [226.654937] ? __pfx_kthread+0x10/0x10
<4> [226.654940] ret_from_fork+0x3d4/0x480
<4> [226.654942] ? __pfx_kthread+0x10/0x10
<4> [226.654946] ret_from_fork_asm+0x1a/0x30
<4> [226.654953] </TASK>
<4> [226.654954] irq event stamp: 1011409
<4> [226.654955] hardirqs last enabled at (1011415): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.654957] hardirqs last disabled at (1011420): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.654959] softirqs last enabled at (1007894): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.654962] softirqs last disabled at (1007887): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.654964] ---[ end trace 0000000000000000 ]---
<6> [226.656391] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.656464] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.656470] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.656485] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.656589] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [226.656885] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.657091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.657182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.657275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.657362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.657447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.657534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.657622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.657714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.657797] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.657892] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.658008] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.659013] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.669700] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.669955] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.671033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.671112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.671187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.671263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.671338] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.671414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.671491] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.671569] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.671644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.671727] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.671802] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.671875] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.671948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.672021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.672095] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.672171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.672246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.672319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [226.672394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [226.672476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [226.672558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [226.672636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [226.672724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [226.672804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [226.672884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [226.672962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [226.673038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [226.673118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [226.673197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [226.673275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [226.673352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [226.673430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [226.673514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [226.673598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [226.673682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [226.673787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [226.673872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [226.673951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [226.674030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [226.674110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [226.674192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [226.674270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [226.674347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [226.674422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [226.674502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [226.674580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [226.674657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [226.674741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [226.674818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [226.674894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [226.674973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [226.675055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [226.675133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [226.675211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [226.675288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [226.675365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [226.675440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [226.675515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [226.675593] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [226.675707] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [226.675711] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45421, lrc_seqno=45421, guc_id=0, flags=0x73 in no process [-1]
<7> [226.675714] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [226.675773] ------------[ cut here ]------------
<4> [226.675774] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [226.675775] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/118
<4> [226.675847] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common binfmt_misc intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal hid_generic intel_powerclamp cmdlinepart eeepc_wmi spi_nor mei_hdcp mei_pxp asus_wmi sparse_keymap coretemp mtd platform_profile wmi_bmof kvm_intel usbhid hid snd_hda_intel kvm snd_intel_dspcfg r8169 irqbypass snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core rapl intel_cstate snd_hwdep video snd_pcm realtek nls_iso8859_1 snd_timer i2c_i801 i2c_mux mei_me idma64 spi_intel_pci snd i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec wmi acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse
<4> [226.675911] efi_pstore nfnetlink autofs4
<4> [226.675915] CPU: 10 UID: 0 PID: 118 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4888-b6fce504bb100219c-debug+ #1 PREEMPT(lazy)
<4> [226.675918] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [226.675920] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [226.675921] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [226.675926] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [226.675997] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 36 d5 5e e1 48 89 c6 48 8d 3d 6c 95 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [226.675999] RSP: 0018:ffffc9000054bca0 EFLAGS: 00010246
<4> [226.676001] RAX: ffffffffa120304b RBX: 0000000000000000 RCX: 0000000000000000
<4> [226.676002] RDX: ffff888102a1a110 RSI: ffffffffa120304b RDI: ffffffffa1003ee0
<4> [226.676004] RBP: ffffc9000054bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [226.676005] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [226.676006] R13: ffff888102a1a110 R14: ffff888122813818 R15: 00000000ffffffc2
<4> [226.676007] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [226.676009] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [226.676010] CR2: 0000775911423058 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [226.676012] PKRU: 55555554
<4> [226.676013] Call Trace:
<4> [226.676014] <TASK>
<4> [226.676018] ? lock_sync+0x100/0x100
<4> [226.676023] ? lock_release+0xd0/0x2b0
<4> [226.676028] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [226.676034] process_one_work+0x239/0x760
<4> [226.676040] worker_thread+0x200/0x3f0
<4> [226.676043] ? __pfx_worker_thread+0x10/0x10
<4> [226.676045] kthread+0x10d/0x150
<4> [226.676048] ? __pfx_kthread+0x10/0x10
<4> [226.676051] ret_from_fork+0x3d4/0x480
<4> [226.676053] ? __pfx_kthread+0x10/0x10
<4> [226.676057] ret_from_fork_asm+0x1a/0x30
<4> [226.676064] </TASK>
<4> [226.676065] irq event stamp: 704627
<4> [226.676066] hardirqs last enabled at (704633): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [226.676069] hardirqs last disabled at (704638): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [226.676071] softirqs last enabled at (703618): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.676074] softirqs last disabled at (703573): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [226.676076] ---[ end trace 0000000000000000 ]---
<6> [226.676078] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [226.676148] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [226.676154] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [226.677396] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [226.677503] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [226.677607] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [226.677824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [226.677921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [226.678019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [226.678112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [226.678204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [226.678295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [226.678385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [226.678478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [226.678567] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [226.678667] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [226.678798] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [226.679808] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [226.690534] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [226.690792] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [226.691791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [226.691875] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [226.691957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [226.692038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [226.692117] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [226.692197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [226.692275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [226.692354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [226.692435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [226.692516] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [226.692596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [226.692675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [226.692767] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [226.692845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [226.692923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [226.693000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [226.693078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [226.693157] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
|