igt@kms_big_fb@4-tiled-32bpp-rotate-0 on shard-bmg@xe-pw-164212v2 Test details

Detail	Value
Duration	unknown
Hostname	shard-bmg-2
Igt-Version	IGT-Version: 2.4-g0a8f2f8f5 (x86_64) (Linux: 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ x86_64)
Out	Using IGT_SRANDOM=1775539441 for randomisation Opened device: /dev/dri/card0 Max driver framebuffer size 16384x16384 RAM: 31752 MiB, GPU address space: 268435456 MiB, GGTT mappable size: 16384 MiB Starting subtest: 4-tiled-32bpp-rotate-0 Max usable framebuffer size for format XR24(0x34325258) / modifier 0x100000000000009: 16384x16384 Using (pipe A + DP-2) to run the subtest. runner: This test was killed due to a kernel taint (0x4244). runner: This test was killed due to exceeding disk usage limit. (Used 10567352 bytes, limit 10485760) This test caused an abort condition: Kernel badly tainted (0x4244, 0x200) (check dmesg for details): TAINT_WARN: WARN_ON has happened.
Err	Starting subtest: 4-tiled-32bpp-rotate-0 Received signal SIGQUIT. Stack trace: #0 [fatal_sig_handler+0x17b] #1 [__sigaction+0x50] #2 [__nss_database_lookup+0xd47] #3 [__xe_bb_exec+0x13f] #4 [intel_bb_exec+0x11f] #5 [_gen9_render_op+0x248d] #6 [xe2_render_copyfunc+0x29] #7 [copy_pattern.constprop.0+0xb7] #8 [generate_pattern.constprop.0+0xa7] #9 [test_pipe.constprop.0+0x410] #10 [test_scanout.constprop.0+0x4ed] #11 [__igt_unique____real_main977+0x8b1] #12 [main+0x2d] #13 [__libc_init_first+0x8a] #14 [__libc_start_main+0x8b] #15 [_start+0x25]
Dmesg Scroll to first warning	<6> [232.025889] Console: switching to colour dummy device 80x25 <6> [232.026202] [IGT] kms_big_fb: executing <7> [232.040458] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:508:DP-1] <7> [232.040467] xe 0000:03:00.0: [drm:intel_dp_detect [xe]] [CONNECTOR:508:DP-1] <7> [232.044712] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:508:DP-1] disconnected <7> [232.045004] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:521:HDMI-A-1] <7> [232.045008] xe 0000:03:00.0: [drm:intel_hdmi_detect [xe]] [CONNECTOR:521:HDMI-A-1] <7> [232.049137] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:521:HDMI-A-1] disconnected <7> [232.049544] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:535:HDMI-A-2] <7> [232.049549] xe 0000:03:00.0: [drm:intel_hdmi_detect [xe]] [CONNECTOR:535:HDMI-A-2] <7> [232.050016] xe 0000:03:00.0: [drm:do_gmbus_xfer [xe]] GMBUS [i915 gmbus tc2] NAK for addr: 0050 w(1) <7> [232.050111] xe 0000:03:00.0: [drm:do_gmbus_xfer [xe]] GMBUS [i915 gmbus tc2] NAK on first message, retry <7> [232.050558] xe 0000:03:00.0: [drm:do_gmbus_xfer [xe]] GMBUS [i915 gmbus tc2] NAK for addr: 0050 w(1) <7> [232.050640] [drm:drm_do_probe_ddc_edid] drm: skipping non-existent adapter i915 gmbus tc2 <7> [232.050644] xe 0000:03:00.0: [drm:intel_hdmi_set_edid [xe]] HDMI GMBUS EDID read failed, retry using GPIO bit-banging <7> [232.050722] xe 0000:03:00.0: [drm:intel_gmbus_force_bit [xe]] enabling bit-banging on i915 gmbus tc2. force bit now 1 <7> [232.052061] [drm:drm_do_probe_ddc_edid] drm: skipping non-existent adapter i915 gmbus tc2 <7> [232.052064] xe 0000:03:00.0: [drm:intel_gmbus_force_bit [xe]] disabling bit-banging on i915 gmbus tc2. force bit now 0 <7> [232.052139] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:535:HDMI-A-2] disconnected <7> [232.052561] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:543:DP-3] <7> [232.052564] xe 0000:03:00.0: [drm:intel_dp_detect [xe]] [CONNECTOR:543:DP-3] <7> [232.056659] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:543:DP-3] disconnected <7> [232.056985] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:551:HDMI-A-4] <7> [232.056989] xe 0000:03:00.0: [drm:intel_hdmi_detect [xe]] [CONNECTOR:551:HDMI-A-4] <7> [232.061131] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:551:HDMI-A-4] disconnected <7> [232.061534] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:508:DP-1] <7> [232.061537] xe 0000:03:00.0: [drm:intel_dp_detect [xe]] [CONNECTOR:508:DP-1] <7> [232.065647] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:508:DP-1] disconnected <7> [232.065661] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:521:HDMI-A-1] <7> [232.065665] xe 0000:03:00.0: [drm:intel_hdmi_detect [xe]] [CONNECTOR:521:HDMI-A-1] <7> [232.069830] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:521:HDMI-A-1] disconnected <7> [232.069847] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:527:DP-2] <7> [232.069855] xe 0000:03:00.0: [drm:intel_dp_detect [xe]] [CONNECTOR:527:DP-2] <7> [232.070269] xe 0000:03:00.0: [drm:intel_power_well_enable [xe]] enabling AUX_TC2 <7> [232.073528] xe 0000:03:00.0: [drm:drm_dp_read_dpcd_caps [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: DPCD: 12 14 c4 01 01 15 01 81 02 01 04 01 0f 00 01 <7> [232.080329] xe 0000:03:00.0: [drm:intel_dp_init_lttpr_and_dprx_caps [xe]] [CONNECTOR:527:DP-2][ENCODER:526:DDI TC2/PHY G][DPRX] LTTPR common capabilities: 00 00 00 00 00 00 00 00 <7> [232.081644] xe 0000:03:00.0: [drm:drm_dp_read_dpcd_caps [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: DPCD: 12 14 c4 01 01 15 01 81 02 01 04 01 0f 00 01 <7> [232.082667] xe 0000:03:00.0: [drm:drm_dp_dump_desc [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: DP branch: OUI 00-1c-f8 dev-ID 176GB0 HW-rev 1.0 SW-rev 7.38 quirks 0x0000 <7> [232.085376] xe 0000:03:00.0: [drm:drm_dp_read_downstream_info [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: DPCD DFP: 0b f0 02 11 <7> [232.086285] xe 0000:03:00.0: [drm:intel_dp_detect [xe]] [ENCODER:526:DDI TC2/PHY G] MST support: port: yes, sink: SST, modparam: yes -> enable: SST <7> [232.092687] xe 0000:03:00.0: [drm:intel_dp_print_rates [xe]] source rates: 162000, 216000, 243000, 270000, 324000, 432000, 540000, 675000, 810000, 1000000 <7> [232.092981] xe 0000:03:00.0: [drm:intel_dp_print_rates [xe]] sink rates: 162000, 270000, 540000 <7> [232.093267] xe 0000:03:00.0: [drm:intel_dp_print_rates [xe]] common rates: 162000, 270000, 540000 <7> [232.099938] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer <7> [232.101964] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer <7> [232.104089] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer <7> [232.106199] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer <7> [232.108273] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer <7> [232.110615] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer <7> [232.112494] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer <7> [232.114743] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer <7> [232.118789] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer <7> [232.120730] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer <7> [232.122668] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer <7> [232.124601] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer <7> [232.126584] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer <7> [232.128574] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer <7> [232.130612] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer <7> [232.132555] xe 0000:03:00.0: [drm:drm_dp_i2c_do_msg [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: native defer <7> [232.134286] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] HDMI: DVI dual 0, max TMDS clock 300000 kHz <7> [232.134301] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] HDMI sink does deep color 30. <7> [232.134310] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] HDMI sink does deep color 36. <7> [232.134318] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] HDMI sink does deep color 48. <7> [232.134326] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] Assigning HDMI sink color depth as 16 bpc. <7> [232.134335] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] HDMI sink does YCRCB444 in deep color. <7> [232.134345] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] ELD monitor DPF90435 <7> [232.134355] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] HDMI: latency present 0 0, video latency 0 0, audio latency 0 0 <7> [232.134365] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:527:DP-2] ELD size 40, SAD count 3 <7> [232.134404] xe 0000:03:00.0: [drm:intel_dp_set_edid [xe]] [CONNECTOR:527:DP-2] VRR capable: no <7> [232.134675] xe 0000:03:00.0: [drm:intel_dp_set_edid [xe]] [CONNECTOR:527:DP-2] DFP max bpc 12, max dotclock 0, TMDS clock 25000-600000, PCON Max FRL BW 0Gbps <7> [232.135711] xe 0000:03:00.0: [drm:intel_dp_set_edid [xe]] PCON ENCODER DSC DPCD: 00 00 00 00 00 00 00 00 00 00 00 00 00 <7> [232.135978] xe 0000:03:00.0: [drm:intel_dp_set_edid [xe]] [CONNECTOR:527:DP-2] RGB->YcbCr conversion? no, YCbCr 4:2:0 allowed? no, YCbCr 4:4:4->4:2:0 conversion? no <7> [232.137930] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "2880x1800": 60 390000 2880 3056 3400 3440 1800 1808 1818 1890 0x40 0x5 (CLOCK_HIGH) <7> [232.137937] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080i": 60 74250 1920 2008 2052 2200 1080 1084 1094 1125 0x40 0x15 (NO_INTERLACE) <7> [232.137943] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080i": 50 74250 1920 2448 2492 2640 1080 1084 1094 1125 0x40 0x15 (NO_INTERLACE) <7> [232.137948] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "720x576i": 50 13500 720 732 795 864 576 580 586 625 0x40 0x101a (NO_INTERLACE) <7> [232.137953] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1280x720": 60 74250 1280 1390 1430 1650 720 725 730 750 0x40 0x1c005 (NO_STEREO) <7> [232.137959] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1280x720": 60 74250 1280 1390 1430 1650 720 725 730 750 0x40 0x4005 (NO_STEREO) <7> [232.137963] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080i": 60 74250 1920 2008 2052 2200 1080 1084 1094 1125 0x40 0x20015 (NO_INTERLACE) <7> [232.137968] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1280x720": 50 74250 1280 1720 1760 1980 720 725 730 750 0x40 0x1c005 (NO_STEREO) <7> [232.137973] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1280x720": 50 74250 1280 1720 1760 1980 720 725 730 750 0x40 0x4005 (NO_STEREO) <7> [232.137978] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080i": 50 74250 1920 2448 2492 2640 1080 1084 1094 1125 0x40 0x20015 (NO_INTERLACE) <7> [232.137983] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080": 24 74250 1920 2558 2602 2750 1080 1084 1089 1125 0x40 0x1c005 (NO_STEREO) <7> [232.137988] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080": 24 74250 1920 2558 2602 2750 1080 1084 1089 1125 0x40 0x4005 (NO_STEREO) <7> [232.137998] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "3840x2160": 50 594000 3840 4896 4984 5280 2160 2168 2178 2250 0x40 0x5 (NO_420) <7> [232.138004] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "3840x2160": 60 594000 3840 4016 4104 4400 2160 2168 2178 2250 0x40 0x5 (NO_420) <7> [232.138009] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "4096x2160": 50 594000 4096 5064 5152 5280 2160 2168 2178 2250 0x40 0x5 (NO_420) <7> [232.138014] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "4096x2160": 60 594000 4096 4184 4272 4400 2160 2168 2178 2250 0x40 0x5 (NO_420) <7> [232.138019] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080i": 60 74176 1920 2008 2052 2200 1080 1084 1094 1125 0x40 0x15 (NO_INTERLACE) <7> [232.138024] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1280x720": 60 74176 1280 1390 1430 1650 720 725 730 750 0x40 0x1c005 (NO_STEREO) <7> [232.138030] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1280x720": 60 74176 1280 1390 1430 1650 720 725 730 750 0x40 0x4005 (NO_STEREO) <7> [232.138035] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080i": 60 74176 1920 2008 2052 2200 1080 1084 1094 1125 0x40 0x20015 (NO_INTERLACE) <7> [232.138040] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080": 24 74176 1920 2558 2602 2750 1080 1084 1089 1125 0x40 0x1c005 (NO_STEREO) <7> [232.138045] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080": 24 74176 1920 2558 2602 2750 1080 1084 1089 1125 0x40 0x4005 (NO_STEREO) <7> [232.138050] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "3840x2160": 60 593407 3840 4016 4104 4400 2160 2168 2178 2250 0x40 0x5 (NO_420) <7> [232.138056] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "4096x2160": 60 593407 4096 4184 4272 4400 2160 2168 2178 2250 0x40 0x5 (NO_420) <7> [232.138063] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:527:DP-2] probed modes: <7> [232.138067] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 60 148500 1920 2008 2052 2200 1080 1084 1089 1125 0x48 0x5 <7> [232.138070] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "4096x2160": 30 297000 4096 4184 4272 4400 2160 2168 2178 2250 0x40 0x5 <7> [232.138073] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "4096x2160": 30 296703 4096 4184 4272 4400 2160 2168 2178 2250 0x40 0x5 <7> [232.138076] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "4096x2160": 24 297000 4096 5116 5204 5500 2160 2168 2178 2250 0x40 0x5 <7> [232.138079] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "4096x2160": 24 296703 4096 5116 5204 5500 2160 2168 2178 2250 0x40 0x5 <7> [232.138082] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 30 297000 3840 4016 4104 4400 2160 2168 2178 2250 0x40 0x5 <7> [232.138086] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 30 296703 3840 4016 4104 4400 2160 2168 2178 2250 0x40 0x5 <7> [232.138089] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 25 297000 3840 4896 4984 5280 2160 2168 2178 2250 0x40 0x5 <7> [232.138092] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 24 297000 3840 5116 5204 5500 2160 2168 2178 2250 0x40 0x5 <7> [232.138095] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 24 296703 3840 5116 5204 5500 2160 2168 2178 2250 0x40 0x5 <7> [232.138098] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "2560x1600": 60 268500 2560 2608 2640 2720 1600 1603 1609 1646 0x40 0x5 <7> [232.138101] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "2224x1668": 60 245000 2224 2270 2302 2382 1668 1671 1677 1714 0x40 0x5 <7> [232.138104] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "2560x1440": 60 241500 2560 2608 2640 2720 1440 1443 1449 1481 0x40 0x5 <7> [232.138107] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1200": 60 154000 1920 1968 2000 2080 1200 1203 1209 1235 0x40 0x9 <7> [232.138110] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 120 297000 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5 <7> [232.138113] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 120 296703 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5 <7> [232.138117] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 60 148500 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5 <7> [232.138119] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 60 148352 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5 <7> [232.138123] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 50 148500 1920 2448 2492 2640 1080 1084 1089 1125 0x40 0x5 <7> [232.138126] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 30 74250 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5 <7> [232.138129] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 30 74176 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5 <7> [232.138132] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 25 74250 1920 2448 2492 2640 1080 1084 1089 1125 0x40 0x5 <7> [232.138135] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 24 74250 1920 2558 2602 2750 1080 1084 1089 1125 0x40 0x5 <7> [232.138138] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 24 74176 1920 2558 2602 2750 1080 1084 1089 1125 0x40 0x5 <7> [232.138141] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1600x1200": 60 162000 1600 1664 1856 2160 1200 1201 1204 1250 0x40 0x5 <7> [232.138144] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1680x1050": 60 119000 1680 1728 1760 1840 1050 1053 1059 1080 0x40 0x9 <7> [232.138147] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1600x900": 60 108000 1600 1624 1704 1800 900 901 904 1000 0x40 0x5 <7> [232.138151] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x1024": 60 108000 1280 1328 1440 1688 1024 1025 1028 1066 0x40 0x5 <7> [232.138154] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1440x900": 60 88750 1440 1488 1520 1600 900 903 909 926 0x40 0x9 <7> [232.138157] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1366x768": 60 85500 1366 1436 1579 1792 768 771 774 798 0x40 0x5 <7> [232.138160] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x800": 60 71000 1280 1328 1360 1440 800 803 809 823 0x40 0x9 <7> [232.138163] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x720": 60 74250 1280 1390 1430 1650 720 725 730 750 0x40 0x5 <7> [232.138166] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x720": 60 74176 1280 1390 1430 1650 720 725 730 750 0x40 0x5 <7> [232.138169] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x720": 50 74250 1280 1720 1760 1980 720 725 730 750 0x40 0x5 <7> [232.138172] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1024x768": 60 65000 1024 1048 1184 1344 768 771 777 806 0x40 0xa <7> [232.138175] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "800x600": 60 40000 800 840 968 1056 600 601 605 628 0x40 0x5 <7> [232.138178] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "720x576": 50 27000 720 732 796 864 576 581 586 625 0x40 0xa <7> [232.138181] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "720x480": 60 27027 720 736 798 858 480 489 495 525 0x40 0xa <7> [232.138184] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "720x480": 60 27000 720 736 798 858 480 489 495 525 0x40 0xa <7> [232.138187] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "640x480": 60 25200 640 656 752 800 480 490 492 525 0x40 0xa <7> [232.138190] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "640x480": 60 25175 640 656 752 800 480 490 492 525 0x40 0xa <7> [232.138222] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:535:HDMI-A-2] <7> [232.138227] xe 0000:03:00.0: [drm:intel_hdmi_detect [xe]] [CONNECTOR:535:HDMI-A-2] <7> [232.138700] xe 0000:03:00.0: [drm:do_gmbus_xfer [xe]] GMBUS [i915 gmbus tc2] NAK for addr: 0050 w(1) <7> [232.138789] xe 0000:03:00.0: [drm:do_gmbus_xfer [xe]] GMBUS [i915 gmbus tc2] NAK on first message, retry <7> [232.139224] xe 0000:03:00.0: [drm:do_gmbus_xfer [xe]] GMBUS [i915 gmbus tc2] NAK for addr: 0050 w(1) <7> [232.139309] [drm:drm_do_probe_ddc_edid] drm: skipping non-existent adapter i915 gmbus tc2 <7> [232.139312] xe 0000:03:00.0: [drm:intel_hdmi_set_edid [xe]] HDMI GMBUS EDID read failed, retry using GPIO bit-banging <7> [232.139396] xe 0000:03:00.0: [drm:intel_gmbus_force_bit [xe]] enabling bit-banging on i915 gmbus tc2. force bit now 1 <7> [232.140732] [drm:drm_do_probe_ddc_edid] drm: skipping non-existent adapter i915 gmbus tc2 <7> [232.140735] xe 0000:03:00.0: [drm:intel_gmbus_force_bit [xe]] disabling bit-banging on i915 gmbus tc2. force bit now 0 <7> [232.140819] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:535:HDMI-A-2] disconnected <7> [232.140834] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:539:HDMI-A-3] <7> [232.140840] xe 0000:03:00.0: [drm:intel_hdmi_detect [xe]] [CONNECTOR:539:HDMI-A-3] <7> [232.165821] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:539:HDMI-A-3] HDMI: DVI dual 0, max TMDS clock 590000 kHz <7> [232.165825] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:539:HDMI-A-3] HDMI sink does deep color 30. <7> [232.165828] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:539:HDMI-A-3] HDMI sink does deep color 36. <7> [232.165831] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:539:HDMI-A-3] HDMI sink does deep color 48. <7> [232.165834] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:539:HDMI-A-3] Assigning HDMI sink color depth as 16 bpc. <7> [232.165837] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:539:HDMI-A-3] HDMI sink does YCRCB444 in deep color. <7> [232.165840] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:539:HDMI-A-3] ELD monitor Mi TV <7> [232.165843] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:539:HDMI-A-3] HDMI: latency present 0 0, video latency 0 0, audio latency 0 0 <7> [232.165847] xe 0000:03:00.0: [drm:update_display_info.part.0] [CONNECTOR:539:HDMI-A-3] ELD size 36, SAD count 3 <7> [232.166212] xe 0000:03:00.0: [drm:do_gmbus_xfer [xe]] GMBUS [i915 gmbus tc3] NAK for addr: 0040 w(1) <7> [232.166301] xe 0000:03:00.0: [drm:do_gmbus_xfer [xe]] GMBUS [i915 gmbus tc3] NAK on first message, retry <7> [232.166735] xe 0000:03:00.0: [drm:do_gmbus_xfer [xe]] GMBUS [i915 gmbus tc3] NAK for addr: 0040 w(1) <7> [232.166818] xe 0000:03:00.0: [drm:drm_dp_dual_mode_detect [drm_display_helper]] DP dual mode HDMI ID: (err -6) <7> [232.167289] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080i": 60 74250 1920 2008 2052 2200 1080 1084 1094 1125 0x40 0x15 (NO_INTERLACE) <7> [232.167296] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080i": 50 74250 1920 2448 2492 2640 1080 1084 1094 1125 0x40 0x15 (NO_INTERLACE) <7> [232.167302] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "720x576i": 50 13500 720 732 795 864 576 580 586 625 0x40 0x101a (NO_INTERLACE) <7> [232.167307] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080i": 60 74250 1920 2008 2052 2200 1080 1084 1094 1125 0x40 0x20015 (NO_INTERLACE) <7> [232.167312] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080i": 50 74250 1920 2448 2492 2640 1080 1084 1094 1125 0x40 0x20015 (NO_INTERLACE) <7> [232.167316] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080i": 60 74176 1920 2008 2052 2200 1080 1084 1094 1125 0x40 0x15 (NO_INTERLACE) <7> [232.167322] xe 0000:03:00.0: [drm:drm_mode_prune_invalid] Rejected mode: "1920x1080i": 60 74176 1920 2008 2052 2200 1080 1084 1094 1125 0x40 0x20015 (NO_INTERLACE) <7> [232.167329] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:539:HDMI-A-3] probed modes: <7> [232.167332] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 60 148500 1920 2008 2052 2200 1080 1084 1089 1125 0x48 0x5 <7> [232.167335] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "4096x2160": 60 594000 4096 4184 4272 4400 2160 2168 2178 2250 0x40 0x5 <7> [232.167338] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "4096x2160": 60 593407 4096 4184 4272 4400 2160 2168 2178 2250 0x40 0x5 <7> [232.167341] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "4096x2160": 50 594000 4096 5064 5152 5280 2160 2168 2178 2250 0x40 0x5 <7> [232.167344] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "4096x2160": 30 297000 4096 4184 4272 4400 2160 2168 2178 2250 0x40 0x5 <7> [232.167346] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "4096x2160": 30 296703 4096 4184 4272 4400 2160 2168 2178 2250 0x40 0x5 <7> [232.167349] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "4096x2160": 24 297000 4096 5116 5204 5500 2160 2168 2178 2250 0x40 0x5 <7> [232.167352] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "4096x2160": 24 296703 4096 5116 5204 5500 2160 2168 2178 2250 0x40 0x5 <7> [232.167355] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 60 594000 3840 4016 4104 4400 2160 2168 2178 2250 0x40 0x5 <7> [232.167357] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 60 593407 3840 4016 4104 4400 2160 2168 2178 2250 0x40 0x5 <7> [232.167360] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 50 594000 3840 4896 4984 5280 2160 2168 2178 2250 0x40 0x5 <7> [232.167363] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 30 297000 3840 4016 4104 4400 2160 2168 2178 2250 0x40 0x5 <7> [232.167366] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 30 296703 3840 4016 4104 4400 2160 2168 2178 2250 0x40 0x5 <7> [232.167368] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 25 297000 3840 4896 4984 5280 2160 2168 2178 2250 0x40 0x5 <7> [232.167371] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 24 297000 3840 5116 5204 5500 2160 2168 2178 2250 0x40 0x5 <7> [232.167374] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "3840x2160": 24 296703 3840 5116 5204 5500 2160 2168 2178 2250 0x40 0x5 <7> [232.167377] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "2880x1800": 30 167000 2880 2910 2920 3030 1800 1820 1828 1836 0x40 0x5 <7> [232.167379] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "2560x1600": 60 268500 2560 2608 2640 2720 1600 1603 1609 1646 0x40 0x5 <7> [232.167382] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "2560x1440": 60 241500 2560 2608 2640 2720 1440 1443 1449 1481 0x40 0x5 <7> [232.167385] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1200": 60 154000 1920 1968 2000 2080 1200 1203 1209 1235 0x40 0x9 <7> [232.167388] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 120 297000 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5 <7> [232.167391] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 120 296703 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5 <7> [232.167394] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 60 148500 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5 <7> [232.167396] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 60 148352 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5 <7> [232.167399] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 50 148500 1920 2448 2492 2640 1080 1084 1089 1125 0x40 0x5 <7> [232.167402] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 30 74250 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5 <7> [232.167405] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 30 74176 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5 <7> [232.167407] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 25 74250 1920 2448 2492 2640 1080 1084 1089 1125 0x40 0x5 <7> [232.167410] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 24 74250 1920 2558 2602 2750 1080 1084 1089 1125 0x40 0x5 <7> [232.167413] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 24 74250 1920 2558 2602 2750 1080 1084 1089 1125 0x40 0x1c005 <7> [232.167416] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 24 74250 1920 2558 2602 2750 1080 1084 1089 1125 0x40 0x4005 <7> [232.167419] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 24 74176 1920 2558 2602 2750 1080 1084 1089 1125 0x40 0x5 <7> [232.167421] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 24 74176 1920 2558 2602 2750 1080 1084 1089 1125 0x40 0x1c005 <7> [232.167424] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1920x1080": 24 74176 1920 2558 2602 2750 1080 1084 1089 1125 0x40 0x4005 <7> [232.167427] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1600x1200": 60 162000 1600 1664 1856 2160 1200 1201 1204 1250 0x40 0x5 <7> [232.167430] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1680x1050": 60 119000 1680 1728 1760 1840 1050 1053 1059 1080 0x40 0x9 <7> [232.167433] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1600x900": 60 108000 1600 1624 1704 1800 900 901 904 1000 0x40 0x5 <7> [232.167435] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x1024": 60 108000 1280 1328 1440 1688 1024 1025 1028 1066 0x40 0x5 <7> [232.167438] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1440x900": 60 88750 1440 1488 1520 1600 900 903 909 926 0x40 0x9 <7> [232.167441] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1366x768": 60 85500 1366 1436 1579 1792 768 771 774 798 0x40 0x5 <7> [232.167444] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x800": 60 71000 1280 1328 1360 1440 800 803 809 823 0x40 0x9 <7> [232.167446] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x720": 60 74250 1280 1390 1430 1650 720 725 730 750 0x40 0x5 <7> [232.167449] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x720": 60 74250 1280 1390 1430 1650 720 725 730 750 0x40 0x1c005 <7> [232.167452] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x720": 60 74250 1280 1390 1430 1650 720 725 730 750 0x40 0x4005 <7> [232.167455] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x720": 60 74176 1280 1390 1430 1650 720 725 730 750 0x40 0x5 <7> [232.167458] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x720": 60 74176 1280 1390 1430 1650 720 725 730 750 0x40 0x1c005 <7> [232.167460] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x720": 60 74176 1280 1390 1430 1650 720 725 730 750 0x40 0x4005 <7> [232.167463] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x720": 50 74250 1280 1720 1760 1980 720 725 730 750 0x40 0x5 <7> [232.167466] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x720": 50 74250 1280 1720 1760 1980 720 725 730 750 0x40 0x1c005 <7> [232.167469] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1280x720": 50 74250 1280 1720 1760 1980 720 725 730 750 0x40 0x4005 <7> [232.167471] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "1024x768": 60 65000 1024 1048 1184 1344 768 771 777 806 0x40 0xa <7> [232.167474] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "800x600": 60 40000 800 840 968 1056 600 601 605 628 0x40 0x5 <7> [232.167477] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "720x576": 50 27000 720 732 796 864 576 581 586 625 0x40 0xa <7> [232.167480] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "720x480": 60 27027 720 736 798 858 480 489 495 525 0x40 0xa <7> [232.167482] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "720x480": 60 27000 720 736 798 858 480 489 495 525 0x40 0xa <7> [232.167485] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "640x480": 60 25200 640 656 752 800 480 490 492 525 0x40 0xa <7> [232.167488] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] Probed mode: "640x480": 60 25175 640 656 752 800 480 490 492 525 0x40 0xa <7> [232.167516] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:543:DP-3] <7> [232.167520] xe 0000:03:00.0: [drm:intel_dp_detect [xe]] [CONNECTOR:543:DP-3] <7> [232.171844] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:543:DP-3] disconnected <7> [232.171857] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:551:HDMI-A-4] <7> [232.171860] xe 0000:03:00.0: [drm:intel_hdmi_detect [xe]] [CONNECTOR:551:HDMI-A-4] <7> [232.176034] xe 0000:03:00.0: [drm:drm_helper_probe_single_connector_modes] [CONNECTOR:551:HDMI-A-4] disconnected <6> [232.184662] [IGT] kms_big_fb: starting subtest 4-tiled-32bpp-rotate-0 <7> [232.186895] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:560] <7> [232.187828] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.enable (expected yes, found no) <7> [232.187937] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.active (expected yes, found no) <7> [232.188093] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in cpu_transcoder (expected 1, found -1) <7> [232.188192] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in lane_count (expected 4, found 0) <7> [232.188287] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in output_types (expected 0x00000040, found 0x00000000) <7> [232.188382] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in framestart_delay (expected 1, found 0) <7> [232.188473] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.pipe_mode.crtc_hdisplay (expected 1920, found 0) <7> [232.188563] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.pipe_mode.crtc_htotal (expected 2200, found 0) <7> [232.188655] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.pipe_mode.crtc_hblank_start (expected 1920, found 0) <7> [232.188746] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.pipe_mode.crtc_hblank_end (expected 2200, found 0) <7> [232.188836] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.pipe_mode.crtc_hsync_start (expected 2008, found 0) <7> [232.188927] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.pipe_mode.crtc_hsync_end (expected 2052, found 0) <7> [232.189209] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.pipe_mode.crtc_vdisplay (expected 1080, found 0) <7> [232.189299] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.pipe_mode.crtc_vblank_start (expected 1080, found 0) <7> [232.189389] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.pipe_mode.crtc_vsync_start (expected 1084, found 0) <7> [232.189479] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.pipe_mode.crtc_vsync_end (expected 1089, found 0) <7> [232.189568] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.pipe_mode.crtc_vtotal (expected 1125, found 0) <7> [232.189657] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.pipe_mode.crtc_vblank_end (expected 1125, found 0) <7> [232.189744] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.adjusted_mode.crtc_hdisplay (expected 1920, found 0) <7> [232.189832] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.adjusted_mode.crtc_htotal (expected 2200, found 0) <7> [232.189921] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.adjusted_mode.crtc_hblank_start (expected 1920, found 0) <7> [232.190015] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.adjusted_mode.crtc_hblank_end (expected 2200, found 0) <7> [232.190103] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.adjusted_mode.crtc_hsync_start (expected 2008, found 0) <7> [232.190192] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.adjusted_mode.crtc_hsync_end (expected 2052, found 0) <7> [232.190281] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.adjusted_mode.crtc_vdisplay (expected 1080, found 0) <7> [232.190369] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.adjusted_mode.crtc_vblank_start (expected 1080, found 0) <7> [232.190457] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.adjusted_mode.crtc_vsync_start (expected 1084, found 0) <7> [232.190546] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.adjusted_mode.crtc_vsync_end (expected 1089, found 0) <7> [232.190635] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.adjusted_mode.crtc_vtotal (expected 1125, found 0) <7> [232.190723] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.adjusted_mode.crtc_vblank_end (expected 1125, found 0) <7> [232.190811] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in pixel_multiplier (expected 1, found 0) <7> [232.190900] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.adjusted_mode.flags (1) (expected 1, found 0) <7> [232.190990] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.adjusted_mode.flags (4) (expected 4, found 0) <7> [232.191078] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in has_hdmi_sink (expected yes, found no) <7> [232.191167] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in has_infoframe (expected yes, found no) <7> [232.191256] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in pipe_bpp (expected 36, found 0) <7> [232.191345] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.pipe_mode.crtc_clock (expected 148500, found 0) <7> [232.191434] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hw.adjusted_mode.crtc_clock (expected 148500, found 0) <7> [232.191524] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in port_clock (expected 222750, found 0) <7> [232.191613] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in infoframes.enable (expected 0x00000071, found 0x00000000) <7> [232.191704] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in infoframes.gcp (expected 0x00000006, found 0x00000000) <7> [232.191793] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in avi infoframe <7> [232.191881] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] expected: <7> [232.191969] xe 0000:03:00.0: HDMI infoframe: Auxiliary Video Information (AVI), version 2, length 13 <7> [232.191971] xe 0000:03:00.0: colorspace: RGB <7> [232.191973] xe 0000:03:00.0: scan mode: Underscan <7> [232.191974] xe 0000:03:00.0: colorimetry: No Data <7> [232.191975] xe 0000:03:00.0: picture aspect: 16:9 <7> [232.191976] xe 0000:03:00.0: active aspect: Same as Picture <7> [232.191978] xe 0000:03:00.0: itc: No Data <7> [232.191979] xe 0000:03:00.0: extended colorimetry: xvYCC 601 <7> [232.191980] xe 0000:03:00.0: quantization range: Default <7> [232.191982] xe 0000:03:00.0: nups: Unknown Non-uniform Scaling <7> [232.191983] xe 0000:03:00.0: video code: 16 <7> [232.191984] xe 0000:03:00.0: ycc quantization range: Full <7> [232.191985] xe 0000:03:00.0: hdmi content type: Graphics <7> [232.191986] xe 0000:03:00.0: pixel repeat: 0 <7> [232.191991] xe 0000:03:00.0: bar top 0, bottom 0, left 0, right 0 <7> [232.191992] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] found: <7> [232.192081] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in spd infoframe <7> [232.192170] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] expected: <7> [232.192258] xe 0000:03:00.0: HDMI infoframe: Source Product Description (SPD), version 1, length 25 <7> [232.192259] xe 0000:03:00.0: vendor: Intel <7> [232.192261] xe 0000:03:00.0: product: Discrete gfx <7> [232.192262] xe 0000:03:00.0: source device information: PC General (0x9) <7> [232.192263] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] found: <7> [232.192353] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:269:pipe B] fastset requirement not met in hdmi infoframe <7> [232.192441] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] expected: <7> [232.192528] xe 0000:03:00.0: HDMI infoframe: Vendor, version 1, length 4 <7> [232.192530] xe 0000:03:00.0: empty frame <7> [232.192531] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] found: <7> [232.192618] xe 0000:03:00.0: [drm:intel_atomic_check [xe]] [CRTC:269:pipe B] fastset requirement not met, forcing full modeset <7> [232.192707] xe 0000:03:00.0: [drm:intel_dpll_crtc_put [xe]] [CRTC:269:pipe B] releasing TC PLL 3 <7> [232.192840] xe 0000:03:00.0: [drm:skl_compute_wm [xe]] Enabled dbuf slices 0xf -> 0xf (total dbuf slices 0xf), mbus joined? no->yes <7> [232.192921] xe 0000:03:00.0: [drm:skl_compute_wm [xe]] [CRTC:151:pipe A] dbuf slices 0x3 -> 0xf, ddb (0 - 2048) -> (0 - 4096), active pipes 0x3 -> 0x1 <7> [232.193049] xe 0000:03:00.0: [drm:skl_compute_wm [xe]] [CRTC:269:pipe B] dbuf slices 0xc -> 0x0, ddb (0 - 2048) -> (0 - 0), active pipes 0x3 -> 0x1 <7> [232.193129] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:35:plane 1A] ddb ( 0 - 1989) -> ( 0 - 0), size 1989 -> 0 <7> [232.193205] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:145:cursor A] ddb (1989 - 2048) -> (4037 - 4096), size 59 -> 59 <7> [232.193279] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [232.193350] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 1, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [232.193420] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 16, 49, 145, 145, 273, 273, 273, 273, 30, 241, 255 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [232.193489] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 19, 55, 161, 161, 302, 302, 0, 0, 31, 267, 267 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [232.193559] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1B] ddb ( 0 - 1989) -> ( 0 - 0), size 1989 -> 0 <7> [232.193627] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:263:cursor B] ddb (1989 - 2048) -> ( 0 - 0), size 59 -> 0 <7> [232.193695] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:153:plane 1B] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [232.193763] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:153:plane 1B] lines 1, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [232.193833] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:153:plane 1B] blocks 16, 49, 145, 145, 273, 273, 273, 273, 30, 241, 255 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [232.193901] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:153:plane 1B] min_ddb 19, 55, 161, 161, 302, 302, 0, 0, 31, 267, 267 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [232.193987] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:151:pipe A] data rate 0 num active planes 0 <7> [232.194320] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe B] data rate 0 num active planes 0 <7> [232.194417] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 0 qgv_peak_bw: 48000 <7> [232.194512] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 0 qgv_peak_bw: 48000 <7> [232.194605] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 0 <7> [232.194700] xe 0000:03:00.0: [drm:intel_cdclk_atomic_check [xe]] [CRTC:269:pipe B] min cdclk: 192000 kHz -> 0 kHz <7> [232.194812] xe 0000:03:00.0: [drm:intel_cdclk_update_dbuf_bw_min_cdclk [xe]] dbuf bandwidth min cdclk: 18563 kHz -> 0 kHz <7> [232.194925] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [CRTC:269:pipe B] enable: no [modeset] <7> [232.195029] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:153:plane 1B] fb: [NOFB], visible: no <7> [232.195124] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:183:plane 2B] fb: [NOFB], visible: no <7> [232.195218] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:213:plane 3B] fb: [NOFB], visible: no <7> [232.195311] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:243:plane 4B] fb: [NOFB], visible: no <7> [232.195401] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:253:plane 5B] fb: [NOFB], visible: no <7> [232.195491] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:263:cursor B] fb: [NOFB], visible: no <7> [232.196003] xe 0000:03:00.0: [drm:intel_audio_codec_disable [xe]] [CONNECTOR:539:HDMI-A-3][ENCODER:538:DDI TC3/PHY H] Disable audio codec on [CRTC:269:pipe B] <7> [232.229628] xe 0000:03:00.0: [drm:intel_disable_transcoder [xe]] disabling pipe B <7> [232.242117] xe 0000:03:00.0: [drm:intel_power_well_disable [xe]] disabling AUX_TC2 <7> [232.247150] xe 0000:03:00.0: [drm:intel_dpll_disable [xe]] disable TC PLL 3 (active 0x2, on? 1) for [CRTC:269:pipe B] <7> [232.249762] xe 0000:03:00.0: [drm:intel_dpll_disable [xe]] disabling TC PLL 3 <7> [232.250668] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:507:DDI TC1/PHY F] <7> [232.251216] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:509:DP-MST A] <7> [232.251687] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:510:DP-MST B] <7> [232.252169] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:511:DP-MST C] <7> [232.252571] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:512:DP-MST D] <7> [232.252965] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:526:DDI TC2/PHY G] <7> [232.253397] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:528:DP-MST A] <7> [232.253755] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:529:DP-MST B] <7> [232.254128] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:530:DP-MST C] <7> [232.254484] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:531:DP-MST D] <7> [232.254809] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:538:DDI TC3/PHY H] <7> [232.255357] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:542:DDI TC4/PHY I] <7> [232.255656] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:544:DP-MST A] <7> [232.255944] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:545:DP-MST B] <7> [232.256266] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:546:DP-MST C] <7> [232.256531] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:547:DP-MST D] <7> [232.256785] xe 0000:03:00.0: [drm:verify_connector_state [xe]] [CONNECTOR:508:DP-1] <7> [232.257257] xe 0000:03:00.0: [drm:verify_connector_state [xe]] [CONNECTOR:521:HDMI-A-1] <7> [232.257707] xe 0000:03:00.0: [drm:verify_connector_state [xe]] [CONNECTOR:535:HDMI-A-2] <7> [232.257944] xe 0000:03:00.0: [drm:verify_connector_state [xe]] [CONNECTOR:539:HDMI-A-3] <7> [232.258402] xe 0000:03:00.0: [drm:verify_connector_state [xe]] [CONNECTOR:543:DP-3] <7> [232.258618] xe 0000:03:00.0: [drm:verify_connector_state [xe]] [CONNECTOR:551:HDMI-A-4] <7> [232.260633] xe 0000:03:00.0: [drm:intel_dbuf_mbus_join_update [xe]] Changing mbus joined: no -> yes (pipe: A) <7> [232.261004] xe 0000:03:00.0: [drm:intel_dbuf_mdclk_cdclk_ratio_update [xe]] Updating dbuf ratio to 4 (mbus joined: yes) <7> [232.275708] xe 0000:03:00.0: [drm:intel_power_well_disable [xe]] disabling PW_B <7> [232.276510] xe 0000:03:00.0: [drm:dss_pipe_gating_enable_disable [xe]] DSS clock gating disabled for pipe_mask=0x2 (CLKGATE_DIS_DSSDSC=0xa8000000) <7> [232.277296] xe 0000:03:00.0: [drm:intel_modeset_verify_crtc [xe]] [CRTC:269:pipe B] <7> [232.278034] xe 0000:03:00.0: [drm:intel_pmdemand_program_params [xe]] initiate pmdemand request values: (0x1e03071 0x28d10e72) <7> [232.279142] xe 0000:03:00.0: [drm:i915_fifo_underrun_reset_write [xe]] Re-arming FIFO underruns on pipe A <7> [232.280090] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:35:plane 1A] ddb ( 0 - 0) -> ( 0 - 4037), size 0 -> 4037 <7> [232.280417] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,*stwm <7> [232.280712] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 4, 4, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [232.281021] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 62, 62, 139, 139, 261, 261, 261, 261, 137, 230, 244 <7> [232.281291] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 123, 123, 245, 245, 367, 367, 0, 0, 138, 306, 306 <7> [232.281593] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:151:pipe A] data rate 594000 num active planes 1 <7> [232.281938] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000 <7> [232.282298] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000 <7> [232.282601] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624 <7> [232.282963] xe 0000:03:00.0: [drm:intel_cdclk_update_dbuf_bw_min_cdclk [xe]] dbuf bandwidth min cdclk: 0 kHz -> 9282 kHz <7> [232.289563] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:554] <7> [232.289786] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:556] <6> [234.371055] xe 0000:03:00.0: [drm] Tile0: GT0: Engine memory CAT error [5]: class=bcs, logical_mask: 0x2, guc_id=0 <5> [234.371583] xe 0000:03:00.0: [drm] Tile0: GT0: log buffer overflow <7> [234.925447] xe 0000:03:00.0: [drm:xe_guc_capture_process [xe]] Tile0: GT0: Capture extraction failed:-5 <6> [234.925672] xe 0000:03:00.0: [drm] Tile0: GT0: Engine reset: engine_class=bcs, logical_mask: 0x2, guc_id=0, state=0x249 <5> [234.925725] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16923, lrc_seqno=16923, guc_id=0, flags=0x73 in no process [-1] <7> [234.925730] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.925799] ------------[ cut here ]------------ <4> [234.925801] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.925802] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:54/3530 <4> [234.925873] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.925973] autofs4 [last unloaded: snd_hda_intel] <4> [234.925978] CPU: 4 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [234.925981] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [L]=SOFTLOCKUP <4> [234.925982] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.925984] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.925990] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.926064] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.926065] RSP: 0018:ffffc90005c17ca0 EFLAGS: 00010246 <4> [234.926068] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.926070] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [234.926071] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.926072] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.926074] R13: ffff888103ae9610 R14: ffff8882e76a0000 R15: 00000000fffffffb <4> [234.926075] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [234.926077] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.926078] CR2: 000076c648fd1000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [234.926080] PKRU: 55555554 <4> [234.926081] Call Trace: <4> [234.926083] <TASK> <4> [234.926085] ? trace_hardirqs_on+0x22/0x100 <4> [234.926092] ? lock_acquire+0x20/0x2f0 <4> [234.926097] ? __pfx_autoremove_wake_function+0x10/0x10 <4> [234.926102] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.926108] process_one_work+0x239/0x760 <4> [234.926114] worker_thread+0x200/0x3f0 <4> [234.926117] ? __pfx_worker_thread+0x10/0x10 <4> [234.926119] kthread+0x10d/0x150 <4> [234.926123] ? __pfx_kthread+0x10/0x10 <4> [234.926126] ret_from_fork+0x3d4/0x480 <4> [234.926129] ? __pfx_kthread+0x10/0x10 <4> [234.926132] ret_from_fork_asm+0x1a/0x30 <4> [234.926139] </TASK> <4> [234.926141] irq event stamp: 268707 <4> [234.926142] hardirqs last enabled at (268713): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [234.926145] hardirqs last disabled at (268718): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [234.926148] softirqs last enabled at (268236): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.926151] softirqs last disabled at (268229): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.926153] ---[ end trace 0000000000000000 ]--- <6> [234.926155] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.926221] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.926257] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.926570] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.927061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.927165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.927245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.927323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.927398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.927470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.927543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.927617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.927684] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.927765] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.927867] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.929005] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.939848] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.940126] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.941647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.941720] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.941789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.941859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.941932] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.942003] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.942073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.942142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.942209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.942272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.942339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.942408] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.942477] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.942545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.942613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.942681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.942750] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.942821] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.942891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.942980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.943059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.943135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.943213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.943289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.943365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.943443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.943519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.943598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.943675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.943751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.943828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.943906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.944006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.944090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.944172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.944252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.944332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.944410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.944489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.944571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.944654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.944738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.944821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.944903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.945018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.945101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.945185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.945270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.945358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.945446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.945537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.945629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.945717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.945806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.945897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.946006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.946094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.946182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.946280] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.946984] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.946992] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16923, lrc_seqno=16923, guc_id=0, flags=0x73 in no process [-1] <7> [234.946997] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.947083] ------------[ cut here ]------------ <4> [234.947085] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.947087] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:54/3530 <4> [234.947192] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.947287] autofs4 [last unloaded: snd_hda_intel] <4> [234.947292] CPU: 4 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [234.947297] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.947298] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.947300] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.947307] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.947405] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.947408] RSP: 0018:ffffc90005c17ca0 EFLAGS: 00010246 <4> [234.947411] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.947414] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [234.947416] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.947418] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.947419] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [234.947421] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [234.947424] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.947426] CR2: 000076c648fd1000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [234.947428] PKRU: 55555554 <4> [234.947429] Call Trace: <4> [234.947431] <TASK> <4> [234.947437] ? lock_acquire+0x20/0x2f0 <4> [234.947446] ? lock_release+0xd0/0x2b0 <4> [234.947454] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.947462] process_one_work+0x239/0x760 <4> [234.947471] worker_thread+0x200/0x3f0 <4> [234.947475] ? __pfx_worker_thread+0x10/0x10 <4> [234.947478] kthread+0x10d/0x150 <4> [234.947483] ? __pfx_kthread+0x10/0x10 <4> [234.947488] ret_from_fork+0x3d4/0x480 <4> [234.947491] ? __pfx_kthread+0x10/0x10 <4> [234.947496] ret_from_fork_asm+0x1a/0x30 <4> [234.947507] </TASK> <4> [234.947509] irq event stamp: 271901 <4> [234.947511] hardirqs last enabled at (271907): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [234.947516] hardirqs last disabled at (271912): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [234.947519] softirqs last enabled at (271030): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.947523] softirqs last disabled at (271023): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.947527] ---[ end trace 0000000000000000 ]--- <6> [234.947530] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.947629] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.947639] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.948840] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.948995] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.949239] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.949471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.949575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.949682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.949780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.949878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.949992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.950087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.950183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.950268] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.950368] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.950489] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.951510] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.961923] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.962171] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.963223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.963298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.963369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.963440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.963509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.963578] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.963647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.963715] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.963782] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.963850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.963922] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.963991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.964058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.964126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.964194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.964264] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.964330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.964397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.964463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.964538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.964612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.964684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.964759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.964829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.964898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.964979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.965047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.965118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.965190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.965262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.965332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.965402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.965479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.965555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.965631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.965705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.965776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.965846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.965916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.965985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.966056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.966125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.966194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.966262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.966335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.966405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.966474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.966542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.966611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.966680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.966748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.966821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.966893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.966974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.967043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.967114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.967184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.967254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.967325] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.967439] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.967443] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16923, lrc_seqno=16923, guc_id=0, flags=0x73 in no process [-1] <7> [234.967446] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.967503] ------------[ cut here ]------------ <4> [234.967505] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.967506] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:54/3530 <4> [234.967575] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.967642] autofs4 [last unloaded: snd_hda_intel] <4> [234.967647] CPU: 5 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [234.967650] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.967651] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.967653] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.967658] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.967727] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.967729] RSP: 0000:ffffc90005c17ca0 EFLAGS: 00010246 <4> [234.967732] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.967734] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [234.967735] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.967736] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.967738] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [234.967739] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [234.967741] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.967743] CR2: 000076c648fd1000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [234.967744] PKRU: 55555554 <4> [234.967746] Call Trace: <4> [234.967747] <TASK> <4> [234.967751] ? lock_acquire+0x20/0x2f0 <4> [234.967757] ? lock_release+0xd0/0x2b0 <4> [234.967763] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.967768] process_one_work+0x239/0x760 <4> [234.967775] worker_thread+0x200/0x3f0 <4> [234.967778] ? __pfx_worker_thread+0x10/0x10 <4> [234.967780] kthread+0x10d/0x150 <4> [234.967783] ? __pfx_kthread+0x10/0x10 <4> [234.967787] ret_from_fork+0x3d4/0x480 <4> [234.967789] ? __pfx_kthread+0x10/0x10 <4> [234.967793] ret_from_fork_asm+0x1a/0x30 <4> [234.967800] </TASK> <4> [234.967802] irq event stamp: 275029 <4> [234.967803] hardirqs last enabled at (275035): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [234.967807] hardirqs last disabled at (275040): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [234.967809] softirqs last enabled at (274148): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.967812] softirqs last disabled at (274143): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.967814] ---[ end trace 0000000000000000 ]--- <7> [234.968939] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.969045] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [235.001247] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16925, lrc_seqno=16925, guc_id=0, flags=0x73 in no process [-1] <7> [235.001252] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.001324] ------------[ cut here ]------------ <4> [235.001325] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.001327] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:11/3206 <4> [235.001401] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.001472] autofs4 [last unloaded: snd_hda_intel] <4> [235.001477] CPU: 2 UID: 0 PID: 3206 Comm: kworker/u64:11 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.001480] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.001481] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.001483] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.001489] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.001559] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.001561] RSP: 0018:ffffc90004707ca0 EFLAGS: 00010246 <4> [235.001563] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.001565] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.001566] RBP: ffffc90004707db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.001567] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.001568] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.001570] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [235.001571] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.001573] CR2: 000074070bfff000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [235.001574] PKRU: 55555554 <4> [235.001576] Call Trace: <4> [235.001577] <TASK> <4> [235.001581] ? lock_acquire+0x20/0x2f0 <4> [235.001588] ? lock_release+0xd0/0x2b0 <4> [235.001593] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.001598] process_one_work+0x239/0x760 <4> [235.001605] worker_thread+0x200/0x3f0 <4> [235.001608] ? __pfx_worker_thread+0x10/0x10 <4> [235.001610] kthread+0x10d/0x150 <4> [235.001613] ? __pfx_kthread+0x10/0x10 <4> [235.001616] ret_from_fork+0x3d4/0x480 <4> [235.001619] ? __pfx_kthread+0x10/0x10 <4> [235.001622] ret_from_fork_asm+0x1a/0x30 <4> [235.001630] </TASK> <4> [235.001631] irq event stamp: 588953 <4> [235.001633] hardirqs last enabled at (588959): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.001636] hardirqs last disabled at (588964): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.001638] softirqs last enabled at (587350): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.001641] softirqs last disabled at (587345): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.001643] ---[ end trace 0000000000000000 ]--- <6> [235.001645] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.001712] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.001719] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.001767] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.001980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.002069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.002158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.002244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.002327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.002407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.002488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.002568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.002643] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.002734] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.002846] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.003871] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.013919] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.014167] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.015183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.015264] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.015340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.015418] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.015497] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.015573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.015650] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.015728] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.015806] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.015882] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.015968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.016042] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.016121] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.016203] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.016281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.016359] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.016437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.016516] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.016597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.016690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.016780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.016866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.016965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.017053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.017138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.017224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.017309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.017400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.017490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.017579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.017669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.017755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.017847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.017943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.018038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.018192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.018328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.018455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.018576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.018694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.018830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.018971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.019066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.019149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.019230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.019309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.019382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.019452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.019524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.019592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.019682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.019796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.019905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.020059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.020177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.020293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.020407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.020478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.020550] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.020683] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.020688] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16925, lrc_seqno=16925, guc_id=0, flags=0x73 in no process [-1] <7> [235.020690] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.020749] ------------[ cut here ]------------ <4> [235.020750] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.020752] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:11/3206 <4> [235.020859] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.020990] autofs4 [last unloaded: snd_hda_intel] <4> [235.020997] CPU: 2 UID: 0 PID: 3206 Comm: kworker/u64:11 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.021001] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.021005] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.021008] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.021017] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.021118] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.021121] RSP: 0018:ffffc90004707ca0 EFLAGS: 00010246 <4> [235.021125] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.021128] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.021130] RBP: ffffc90004707db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.021132] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.021135] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.021137] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [235.021139] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.021142] CR2: 000074070bfff000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [235.021144] PKRU: 55555554 <4> [235.021146] Call Trace: <4> [235.021148] <TASK> <4> [235.021155] ? lock_acquire+0x20/0x2f0 <4> [235.021165] ? lock_release+0xd0/0x2b0 <4> [235.021174] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.021183] process_one_work+0x239/0x760 <4> [235.021194] worker_thread+0x200/0x3f0 <4> [235.021199] ? __pfx_worker_thread+0x10/0x10 <4> [235.021203] kthread+0x10d/0x150 <4> [235.021207] ? __pfx_kthread+0x10/0x10 <4> [235.021213] ret_from_fork+0x3d4/0x480 <4> [235.021216] ? __pfx_kthread+0x10/0x10 <4> [235.021222] ret_from_fork_asm+0x1a/0x30 <4> [235.021235] </TASK> <4> [235.021237] irq event stamp: 592077 <4> [235.021239] hardirqs last enabled at (592083): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.021243] hardirqs last disabled at (592088): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.021247] softirqs last enabled at (591192): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.021250] softirqs last disabled at (591185): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.021254] ---[ end trace 0000000000000000 ]--- <6> [235.021270] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.021587] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.021598] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.022484] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.022588] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.022692] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.022897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.023001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.023091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.023175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.023258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.023338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.023417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.023497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.023573] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.023664] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.023777] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.024782] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.035503] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.035752] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.036838] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.036919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.036990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.037061] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.037133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.037202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.037271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.037340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.037408] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.037475] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.037542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.037608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.037675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.037742] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.037809] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.037877] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.037959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.038030] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.038097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.038172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.038246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.038319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.038391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.038465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.038538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.038610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.038680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.038752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.038824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.038897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.039000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.039073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.039150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.039227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.039304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.039377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.039450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.039519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.039589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.039657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.039730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.039804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.039874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.039954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.040026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.040094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.040163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.040232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.040302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.040371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.040440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.040510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.040579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.040647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.040715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.040784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.040851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.040923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.040997] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.041113] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.041117] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16925, lrc_seqno=16925, guc_id=0, flags=0x73 in no process [-1] <7> [235.041119] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.041177] ------------[ cut here ]------------ <4> [235.041178] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.041180] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:11/3206 <4> [235.041249] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.041331] autofs4 [last unloaded: snd_hda_intel] <4> [235.041335] CPU: 4 UID: 0 PID: 3206 Comm: kworker/u64:11 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.041339] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.041340] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.041342] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.041347] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.041415] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.041417] RSP: 0018:ffffc90004707ca0 EFLAGS: 00010246 <4> [235.041419] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.041421] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.041422] RBP: ffffc90004707db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.041423] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.041424] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.041426] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [235.041427] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.041429] CR2: 000076c648fd1000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [235.041430] PKRU: 55555554 <4> [235.041431] Call Trace: <4> [235.041433] <TASK> <4> [235.041436] ? lock_acquire+0x20/0x2f0 <4> [235.041442] ? lock_release+0xd0/0x2b0 <4> [235.041448] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.041453] process_one_work+0x239/0x760 <4> [235.041460] worker_thread+0x200/0x3f0 <4> [235.041462] ? __pfx_worker_thread+0x10/0x10 <4> [235.041465] kthread+0x10d/0x150 <4> [235.041467] ? __pfx_kthread+0x10/0x10 <4> [235.041471] ret_from_fork+0x3d4/0x480 <4> [235.041473] ? __pfx_kthread+0x10/0x10 <4> [235.041477] ret_from_fork_asm+0x1a/0x30 <4> [235.041484] </TASK> <4> [235.041485] irq event stamp: 595213 <4> [235.041486] hardirqs last enabled at (595219): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.041489] hardirqs last disabled at (595224): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.041492] softirqs last enabled at (594058): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.041494] softirqs last disabled at (594051): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.041496] ---[ end trace 0000000000000000 ]--- <7> [235.042683] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.042829] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [235.074028] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16927, lrc_seqno=16927, guc_id=0, flags=0x73 in no process [-1] <7> [235.074034] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.074103] ------------[ cut here ]------------ <4> [235.074104] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.074106] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:16/3246 <4> [235.074179] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.074250] autofs4 [last unloaded: snd_hda_intel] <4> [235.074254] CPU: 3 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.074257] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.074259] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.074260] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.074266] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.074330] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.074332] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [235.074334] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.074335] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.074336] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.074337] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.074339] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.074340] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000 <4> [235.074341] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.074342] CR2: 00007ffe653dde98 CR3: 000000012dda7001 CR4: 0000000000f72ef0 <4> [235.074344] PKRU: 55555554 <4> [235.074345] Call Trace: <4> [235.074346] <TASK> <4> [235.074349] ? lock_acquire+0x20/0x2f0 <4> [235.074355] ? lock_release+0xd0/0x2b0 <4> [235.074360] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.074365] process_one_work+0x239/0x760 <4> [235.074372] worker_thread+0x200/0x3f0 <4> [235.074374] ? __pfx_worker_thread+0x10/0x10 <4> [235.074376] kthread+0x10d/0x150 <4> [235.074379] ? __pfx_kthread+0x10/0x10 <4> [235.074382] ret_from_fork+0x3d4/0x480 <4> [235.074384] ? __pfx_kthread+0x10/0x10 <4> [235.074387] ret_from_fork_asm+0x1a/0x30 <4> [235.074394] </TASK> <4> [235.074396] irq event stamp: 165531 <4> [235.074397] hardirqs last enabled at (165537): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.074399] hardirqs last disabled at (165542): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.074401] softirqs last enabled at (164454): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [235.074404] softirqs last disabled at (164452): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [235.074406] ---[ end trace 0000000000000000 ]--- <6> [235.074408] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.074469] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.074478] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.074526] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.074731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.074819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.074905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.075008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.075088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.075168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.075247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.075328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.075406] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.075497] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.075610] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.076619] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.087267] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.087512] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.088751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.088831] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.088913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.088991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.089067] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.089142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.089217] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.089294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.089377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.089457] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.089535] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.089613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.089691] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.089774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.089854] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.089943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.090024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.090105] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.090184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.090276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.090368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.090457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.090543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.090626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.090708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.090789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.090869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.090964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.091049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.091134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.091220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.091306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.091398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.091486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.091575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.091660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.091743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.091824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.091904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.092000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.092086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.092166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.092246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.092322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.092400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.092475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.092549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.092621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.092697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.092765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.092834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.092905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.092991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.093064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.093134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.093206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.093276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.093345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.093417] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.093963] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.093967] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16927, lrc_seqno=16927, guc_id=0, flags=0x73 in no process [-1] <7> [235.093970] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.094034] ------------[ cut here ]------------ <4> [235.094035] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.094037] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:16/3246 <4> [235.094106] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.094174] autofs4 [last unloaded: snd_hda_intel] <4> [235.094178] CPU: 3 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.094181] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.094182] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.094184] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.094189] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.094257] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.094258] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [235.094261] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.094262] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.094263] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.094265] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.094266] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.094267] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000 <4> [235.094269] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.094270] CR2: 00007ffe653dde98 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [235.094272] PKRU: 55555554 <4> [235.094273] Call Trace: <4> [235.094274] <TASK> <4> [235.094278] ? lock_acquire+0x20/0x2f0 <4> [235.094283] ? lock_release+0xd0/0x2b0 <4> [235.094289] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.094295] process_one_work+0x239/0x760 <4> [235.094301] worker_thread+0x200/0x3f0 <4> [235.094304] ? __pfx_worker_thread+0x10/0x10 <4> [235.094306] kthread+0x10d/0x150 <4> [235.094309] ? __pfx_kthread+0x10/0x10 <4> [235.094313] ret_from_fork+0x3d4/0x480 <4> [235.094315] ? __pfx_kthread+0x10/0x10 <4> [235.094318] ret_from_fork_asm+0x1a/0x30 <4> [235.094326] </TASK> <4> [235.094327] irq event stamp: 168683 <4> [235.094328] hardirqs last enabled at (168689): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.094331] hardirqs last disabled at (168694): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.094333] softirqs last enabled at (167702): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.094336] softirqs last disabled at (167695): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.094338] ---[ end trace 0000000000000000 ]--- <6> [235.094340] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.094406] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.094414] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.094683] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.094885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.094978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.095105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.095199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.095294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.095371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.095449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.095527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.095600] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.095691] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.095803] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.096815] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.107539] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.107788] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.108865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.108962] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.109041] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.109116] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.109189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.109261] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.109332] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.109401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.109472] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.109541] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.109610] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.109678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.109747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.109818] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.109888] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.109967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.110036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.110104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.110173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.110250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.110325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.110399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.110472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.110543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.110615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.110689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.110759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.110831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.110905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.110990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.111060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.111130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.111206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.111283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.111358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.111431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.111502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.111573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.111643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.111711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.111782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.111852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.111923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.111993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.112065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.112134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.112205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.112275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.112345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.112413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.112481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.112551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.112620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.112688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.112756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.112827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.112897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.112977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.113049] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.113424] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.113429] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16927, lrc_seqno=16927, guc_id=0, flags=0x73 in no process [-1] <7> [235.113431] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.113490] ------------[ cut here ]------------ <4> [235.113491] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.113493] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:16/3246 <4> [235.113561] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.113628] autofs4 [last unloaded: snd_hda_intel] <4> [235.113633] CPU: 4 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.113636] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.113638] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.113640] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.113645] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.113711] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.113713] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [235.113715] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.113717] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.113718] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.113720] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.113721] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.113723] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [235.113725] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.113727] CR2: 000076c648fd1000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [235.113728] PKRU: 55555554 <4> [235.113730] Call Trace: <4> [235.113731] <TASK> <4> [235.113735] ? lock_acquire+0x20/0x2f0 <4> [235.113741] ? lock_release+0xd0/0x2b0 <4> [235.113747] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.113752] process_one_work+0x239/0x760 <4> [235.113759] worker_thread+0x200/0x3f0 <4> [235.113762] ? __pfx_worker_thread+0x10/0x10 <4> [235.113765] kthread+0x10d/0x150 <4> [235.113768] ? __pfx_kthread+0x10/0x10 <4> [235.113772] ret_from_fork+0x3d4/0x480 <4> [235.113774] ? __pfx_kthread+0x10/0x10 <4> [235.113777] ret_from_fork_asm+0x1a/0x30 <4> [235.113785] </TASK> <4> [235.113786] irq event stamp: 171817 <4> [235.113787] hardirqs last enabled at (171823): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.113791] hardirqs last disabled at (171828): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.113793] softirqs last enabled at (170654): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.113796] softirqs last disabled at (170647): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.113798] ---[ end trace 0000000000000000 ]--- <7> [235.114990] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.115139] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [235.146026] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16929, lrc_seqno=16929, guc_id=0, flags=0x73 in no process [-1] <7> [235.146032] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.146129] ------------[ cut here ]------------ <4> [235.146131] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.146134] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:16/3246 <4> [235.146239] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.146331] autofs4 [last unloaded: snd_hda_intel] <4> [235.146335] CPU: 4 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.146338] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.146340] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.146341] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.146347] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.146421] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.146422] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [235.146425] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.146427] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.146428] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.146429] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.146430] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.146432] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [235.146433] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.146435] CR2: 000076c648fd1000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [235.146436] PKRU: 55555554 <4> [235.146438] Call Trace: <4> [235.146439] <TASK> <4> [235.146443] ? lock_acquire+0x20/0x2f0 <4> [235.146449] ? lock_release+0xd0/0x2b0 <4> [235.146454] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.146460] process_one_work+0x239/0x760 <4> [235.146466] worker_thread+0x200/0x3f0 <4> [235.146469] ? __pfx_worker_thread+0x10/0x10 <4> [235.146472] kthread+0x10d/0x150 <4> [235.146475] ? __pfx_kthread+0x10/0x10 <4> [235.146478] ret_from_fork+0x3d4/0x480 <4> [235.146481] ? __pfx_kthread+0x10/0x10 <4> [235.146484] ret_from_fork_asm+0x1a/0x30 <4> [235.146492] </TASK> <4> [235.146493] irq event stamp: 172815 <4> [235.146494] hardirqs last enabled at (172821): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.146497] hardirqs last disabled at (172826): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.146500] softirqs last enabled at (170654): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.146502] softirqs last disabled at (170647): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.146504] ---[ end trace 0000000000000000 ]--- <6> [235.146507] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.146577] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.146587] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.146676] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.146881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.146988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.147079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.147163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.147243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.147320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.147397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.147477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.147553] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.147643] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.147754] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.148776] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.158919] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.159186] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.160351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.160435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.160513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.160592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.160668] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.160743] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.160816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.160888] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.160974] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.161048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.161121] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.161193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.161265] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.161336] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.161405] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.161475] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.161545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.161616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.161686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.161768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.161849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.161931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.162012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.162089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.162162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.162236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.162308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.162383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.162458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.162532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.162606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.162679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.162759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.162841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.162924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.163002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.163078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.163152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.163225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.163295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.163369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.163441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.163514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.163585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.163662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.163733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.163806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.163877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.163958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.164030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.164103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.164179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.164252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.164325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.164399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.164473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.164548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.164619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.164695] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.164813] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.164817] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16929, lrc_seqno=16929, guc_id=0, flags=0x73 in no process [-1] <7> [235.164820] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.164881] ------------[ cut here ]------------ <4> [235.164882] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.164883] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:16/3246 <4> [235.164967] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.165041] autofs4 [last unloaded: snd_hda_intel] <4> [235.165046] CPU: 4 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.165049] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.165051] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.165052] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.165058] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.165133] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.165135] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [235.165138] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.165140] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.165141] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.165142] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.165144] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.165145] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [235.165147] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.165149] CR2: 000076c648fd1000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [235.165151] PKRU: 55555554 <4> [235.165152] Call Trace: <4> [235.165153] <TASK> <4> [235.165158] ? lock_acquire+0x20/0x2f0 <4> [235.165164] ? lock_release+0xd0/0x2b0 <4> [235.165169] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.165175] process_one_work+0x239/0x760 <4> [235.165182] worker_thread+0x200/0x3f0 <4> [235.165185] ? __pfx_worker_thread+0x10/0x10 <4> [235.165187] kthread+0x10d/0x150 <4> [235.165191] ? __pfx_kthread+0x10/0x10 <4> [235.165194] ret_from_fork+0x3d4/0x480 <4> [235.165197] ? __pfx_kthread+0x10/0x10 <4> [235.165201] ret_from_fork_asm+0x1a/0x30 <4> [235.165209] </TASK> <4> [235.165210] irq event stamp: 175973 <4> [235.165211] hardirqs last enabled at (175979): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.165214] hardirqs last disabled at (175984): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.165217] softirqs last enabled at (175230): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.165219] softirqs last disabled at (175219): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.165221] ---[ end trace 0000000000000000 ]--- <6> [235.165223] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.165294] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.165301] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.165579] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.165785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.165874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.165974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.166059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.166141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.166224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.166305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.166387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.166465] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.166560] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.166676] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.167683] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.178263] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.178515] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.179615] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.179694] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.179768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.179845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.179925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.179999] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.180074] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.180148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.180221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.180294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.180370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.180444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.180517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.180589] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.180662] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.180735] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.180808] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.180881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.180962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.181043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.181123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.181200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.181276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.181350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.181423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.181494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.181567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.181642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.181718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.181793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.181869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.181953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.182033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.182114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.182193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.182270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.182346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.182418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.182492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.182565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.182640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.182713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.182785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.182856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.182939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.183013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.183087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.183159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.183233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.183305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.183375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.183451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.183526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.183598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.183668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.183740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.183814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.183887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.183969] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.184086] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.184090] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16929, lrc_seqno=16929, guc_id=0, flags=0x73 in no process [-1] <7> [235.184093] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.184154] ------------[ cut here ]------------ <4> [235.184155] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.184157] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:16/3246 <4> [235.184231] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.184295] autofs4 [last unloaded: snd_hda_intel] <4> [235.184299] CPU: 4 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.184301] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.184303] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.184304] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.184309] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.184379] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.184381] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [235.184383] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.184385] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.184386] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.184387] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.184388] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.184390] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [235.184391] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.184393] CR2: 000076c648fd1000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [235.184394] PKRU: 55555554 <4> [235.184395] Call Trace: <4> [235.184397] <TASK> <4> [235.184400] ? lock_acquire+0x20/0x2f0 <4> [235.184406] ? lock_release+0xd0/0x2b0 <4> [235.184411] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.184417] process_one_work+0x239/0x760 <4> [235.184423] worker_thread+0x200/0x3f0 <4> [235.184426] ? __pfx_worker_thread+0x10/0x10 <4> [235.184428] kthread+0x10d/0x150 <4> [235.184431] ? __pfx_kthread+0x10/0x10 <4> [235.184435] ret_from_fork+0x3d4/0x480 <4> [235.184437] ? __pfx_kthread+0x10/0x10 <4> [235.184440] ret_from_fork_asm+0x1a/0x30 <4> [235.184447] </TASK> <4> [235.184448] irq event stamp: 179105 <4> [235.184450] hardirqs last enabled at (179111): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.184452] hardirqs last disabled at (179116): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.184455] softirqs last enabled at (177966): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.184457] softirqs last disabled at (177959): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.184459] ---[ end trace 0000000000000000 ]--- <7> [235.185549] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.185696] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [235.215600] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16931, lrc_seqno=16931, guc_id=0, flags=0x73 in no process [-1] <7> [235.215605] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.215673] ------------[ cut here ]------------ <4> [235.215674] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.215676] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:16/3246 <4> [235.215749] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.215817] autofs4 [last unloaded: snd_hda_intel] <4> [235.215821] CPU: 0 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.215824] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.215825] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.215826] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.215832] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.215903] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.215913] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [235.215917] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.215919] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.215922] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.215923] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.215924] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.215926] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [235.215927] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.215929] CR2: 00007a4496a66000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [235.215930] PKRU: 55555554 <4> [235.215931] Call Trace: <4> [235.215933] <TASK> <4> [235.215937] ? lock_acquire+0x20/0x2f0 <4> [235.215968] ? lock_release+0xd0/0x2b0 <4> [235.215974] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.215980] process_one_work+0x239/0x760 <4> [235.215987] worker_thread+0x200/0x3f0 <4> [235.215990] ? __pfx_worker_thread+0x10/0x10 <4> [235.215992] kthread+0x10d/0x150 <4> [235.215995] ? __pfx_kthread+0x10/0x10 <4> [235.215999] ret_from_fork+0x3d4/0x480 <4> [235.216002] ? __pfx_kthread+0x10/0x10 <4> [235.216005] ret_from_fork_asm+0x1a/0x30 <4> [235.216013] </TASK> <4> [235.216014] irq event stamp: 180093 <4> [235.216017] hardirqs last enabled at (180099): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.216020] hardirqs last disabled at (180104): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.216022] softirqs last enabled at (177966): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.216025] softirqs last disabled at (177959): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.216027] ---[ end trace 0000000000000000 ]--- <6> [235.216029] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.216100] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.216108] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.216207] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.216449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.216568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.216686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.216799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.216916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.217033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.217145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.217257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.217367] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.217489] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.217632] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.218757] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.228933] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.229192] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.230306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.230409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.230478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.230546] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.230612] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.230678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.230743] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.230810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.230877] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.230963] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.231076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.231183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.231289] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.231396] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.231504] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.231610] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.231717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.231828] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.231940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.232056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.232172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.232279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.232393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.232495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.232598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.232700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.232801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.232909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.233022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.233128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.233229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.233334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.233442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.233548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.233659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.233764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.233869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.233996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.234104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.234212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.234327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.234437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.234547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.234655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.234770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.234884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.235023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.235130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.235239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.235346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.235456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.235574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.235685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.235794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.235903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.236050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.236159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.236269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.236388] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.236546] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.236553] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16931, lrc_seqno=16931, guc_id=0, flags=0x73 in no process [-1] <7> [235.236557] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.236647] ------------[ cut here ]------------ <4> [235.236649] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.236652] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:54/3530 <4> [235.236760] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.236894] autofs4 [last unloaded: snd_hda_intel] <4> [235.236901] CPU: 7 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.236910] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.236912] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.236915] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.236923] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.237023] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.237026] RSP: 0018:ffffc90005c17ca0 EFLAGS: 00010246 <4> [235.237031] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.237033] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.237036] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.237038] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.237041] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.237043] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [235.237046] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.237049] CR2: 000000c0003e6000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [235.237052] PKRU: 55555554 <4> [235.237054] Call Trace: <4> [235.237056] <TASK> <4> [235.237064] ? lock_acquire+0x20/0x2f0 <4> [235.237073] ? lock_release+0xd0/0x2b0 <4> [235.237083] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.237093] process_one_work+0x239/0x760 <4> [235.237105] worker_thread+0x200/0x3f0 <4> [235.237110] ? __pfx_worker_thread+0x10/0x10 <4> [235.237114] kthread+0x10d/0x150 <4> [235.237119] ? __pfx_kthread+0x10/0x10 <4> [235.237125] ret_from_fork+0x3d4/0x480 <4> [235.237129] ? __pfx_kthread+0x10/0x10 <4> [235.237134] ret_from_fork_asm+0x1a/0x30 <4> [235.237148] </TASK> <4> [235.237150] irq event stamp: 287379 <4> [235.237153] hardirqs last enabled at (287385): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.237157] hardirqs last disabled at (287390): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.237161] softirqs last enabled at (286162): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.237165] softirqs last disabled at (286157): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.237169] ---[ end trace 0000000000000000 ]--- <6> [235.237172] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.237274] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.237284] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.237590] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.237833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.237968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.238099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.238223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.238340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.238456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.238578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.238699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.238816] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.238953] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.239104] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.240236] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.250968] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.251229] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.252427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.252506] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.252579] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.252651] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.252721] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.252790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.252857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.252937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.253047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.253150] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.253219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.253287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.253354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.253422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.253489] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.253556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.253622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.253688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.253755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.253835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.253917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.253992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.254067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.254137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.254205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.254275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.254344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.254415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.254485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.254554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.254624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.254693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.254768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.254844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.254926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.254999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.255071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.255140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.255207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.255275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.255346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.255415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.255483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.255549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.255620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.255686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.255752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.255818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.255884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.255964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.256032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.256103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.256173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.256242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.256308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.256375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.256440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.256507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.256575] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.256687] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.256692] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16931, lrc_seqno=16931, guc_id=0, flags=0x73 in no process [-1] <7> [235.256694] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.256751] ------------[ cut here ]------------ <4> [235.256752] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.256754] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:54/3530 <4> [235.256823] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.256888] autofs4 [last unloaded: snd_hda_intel] <4> [235.256892] CPU: 7 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.256895] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.256896] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.256898] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.256907] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.256974] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.256976] RSP: 0018:ffffc90005c17ca0 EFLAGS: 00010246 <4> [235.256978] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.256980] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.256981] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.256983] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.256984] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.256986] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [235.256988] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.256989] CR2: 000000c0003e6000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [235.256991] PKRU: 55555554 <4> [235.256992] Call Trace: <4> [235.256994] <TASK> <4> [235.256998] ? lock_acquire+0x20/0x2f0 <4> [235.257004] ? lock_release+0xd0/0x2b0 <4> [235.257009] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.257015] process_one_work+0x239/0x760 <4> [235.257021] worker_thread+0x200/0x3f0 <4> [235.257024] ? __pfx_worker_thread+0x10/0x10 <4> [235.257027] kthread+0x10d/0x150 <4> [235.257030] ? __pfx_kthread+0x10/0x10 <4> [235.257034] ret_from_fork+0x3d4/0x480 <4> [235.257036] ? __pfx_kthread+0x10/0x10 <4> [235.257040] ret_from_fork_asm+0x1a/0x30 <4> [235.257047] </TASK> <4> [235.257049] irq event stamp: 290521 <4> [235.257050] hardirqs last enabled at (290527): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.257053] hardirqs last disabled at (290532): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.257056] softirqs last enabled at (289292): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.257058] softirqs last disabled at (289287): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.257061] ---[ end trace 0000000000000000 ]--- <7> [235.258080] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.258179] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [235.289249] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16933, lrc_seqno=16933, guc_id=0, flags=0x73 in no process [-1] <7> [235.289253] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.289320] ------------[ cut here ]------------ <4> [235.289321] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.289323] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:54/3530 <4> [235.289394] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.289462] autofs4 [last unloaded: snd_hda_intel] <4> [235.289466] CPU: 7 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.289469] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.289470] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.289472] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.289477] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.289544] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.289546] RSP: 0018:ffffc90005c17ca0 EFLAGS: 00010246 <4> [235.289548] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.289549] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.289551] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.289552] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.289553] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.289554] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [235.289556] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.289557] CR2: 000000c0003e6000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [235.289559] PKRU: 55555554 <4> [235.289560] Call Trace: <4> [235.289561] <TASK> <4> [235.289565] ? lock_acquire+0x20/0x2f0 <4> [235.289571] ? lock_release+0xd0/0x2b0 <4> [235.289577] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.289582] process_one_work+0x239/0x760 <4> [235.289588] worker_thread+0x200/0x3f0 <4> [235.289591] ? __pfx_worker_thread+0x10/0x10 <4> [235.289593] kthread+0x10d/0x150 <4> [235.289596] ? __pfx_kthread+0x10/0x10 <4> [235.289600] ret_from_fork+0x3d4/0x480 <4> [235.289602] ? __pfx_kthread+0x10/0x10 <4> [235.289605] ret_from_fork_asm+0x1a/0x30 <4> [235.289613] </TASK> <4> [235.289614] irq event stamp: 291519 <4> [235.289615] hardirqs last enabled at (291525): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.289618] hardirqs last disabled at (291530): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.289620] softirqs last enabled at (289292): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.289623] softirqs last disabled at (289287): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.289625] ---[ end trace 0000000000000000 ]--- <6> [235.289627] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.289693] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.289700] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.289792] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.290011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.290100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.290189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.290272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.290356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.290437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.290515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.290595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.290670] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.290759] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.290869] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.291901] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.301910] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.302161] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.303231] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.303308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.303382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.303455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.303528] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.303600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.303671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.303745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.303819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.303892] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.303986] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.304059] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.304131] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.304205] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.304281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.304359] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.304438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.304516] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.304595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.304682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.304766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.304847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.304934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.305015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.305093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.305168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.305245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.305326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.305409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.305492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.305575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.305659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.305749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.305837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.305929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.306017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.306104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.306191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.306278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.306362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.306450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.306538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.306626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.306712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.306804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.306890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.307007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.307099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.307191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.307281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.307370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.307463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.307556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.307651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.307744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.307839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.307943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.308039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.308138] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.308284] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.308290] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16933, lrc_seqno=16933, guc_id=0, flags=0x73 in no process [-1] <7> [235.308294] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.308376] ------------[ cut here ]------------ <4> [235.308378] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.308381] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:16/3246 <4> [235.308481] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.308596] autofs4 [last unloaded: snd_hda_intel] <4> [235.308602] CPU: 0 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.308607] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.308609] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.308612] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.308620] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.308720] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.308723] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [235.308727] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.308729] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.308731] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.308733] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.308734] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.308737] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [235.308739] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.308741] CR2: 00007a4496a66000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [235.308743] PKRU: 55555554 <4> [235.308745] Call Trace: <4> [235.308747] <TASK> <4> [235.308753] ? lock_acquire+0x20/0x2f0 <4> [235.308762] ? lock_release+0xd0/0x2b0 <4> [235.308771] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.308779] process_one_work+0x239/0x760 <4> [235.308789] worker_thread+0x200/0x3f0 <4> [235.308793] ? __pfx_worker_thread+0x10/0x10 <4> [235.308797] kthread+0x10d/0x150 <4> [235.308801] ? __pfx_kthread+0x10/0x10 <4> [235.308806] ret_from_fork+0x3d4/0x480 <4> [235.308810] ? __pfx_kthread+0x10/0x10 <4> [235.308815] ret_from_fork_asm+0x1a/0x30 <4> [235.308826] </TASK> <4> [235.308828] irq event stamp: 184299 <4> [235.308830] hardirqs last enabled at (184305): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.308834] hardirqs last disabled at (184310): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.308837] softirqs last enabled at (183436): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.308841] softirqs last disabled at (183431): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.308844] ---[ end trace 0000000000000000 ]--- <6> [235.308847] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.308963] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.308972] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.310112] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.310281] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.310446] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.310703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.310849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.311022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.311164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.311302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.311438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.311580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.311726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.311866] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.312049] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.312234] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.313380] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.323910] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.324158] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.325242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.325316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.325386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.325456] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.325526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.325594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.325665] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.325733] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.325800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.325868] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.325945] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.326012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.326081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.326149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.326217] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.326283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.326349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.326416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.326486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.326562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.326634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.326705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.326775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.326843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.326928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.327000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.327071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.327143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.327213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.327282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.327353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.327421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.327498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.327574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.327647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.327717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.327786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.327852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.327924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.327991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.328062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.328131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.328200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.328267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.328339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.328405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.328470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.328535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.328602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.328668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.328737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.328809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.328879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.328958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.329027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.329097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.329165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.329231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.329300] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.329414] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.329418] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16933, lrc_seqno=16933, guc_id=0, flags=0x73 in no process [-1] <7> [235.329421] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.329477] ------------[ cut here ]------------ <4> [235.329478] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.329479] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:54/3530 <4> [235.329547] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.329613] autofs4 [last unloaded: snd_hda_intel] <4> [235.329616] CPU: 7 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.329619] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.329620] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.329622] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.329626] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.329692] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.329694] RSP: 0018:ffffc90005c17ca0 EFLAGS: 00010246 <4> [235.329696] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.329697] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.329699] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.329700] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.329701] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.329702] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [235.329704] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.329706] CR2: 000000c0003e6000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [235.329707] PKRU: 55555554 <4> [235.329708] Call Trace: <4> [235.329709] <TASK> <4> [235.329713] ? lock_acquire+0x20/0x2f0 <4> [235.329719] ? lock_release+0xd0/0x2b0 <4> [235.329724] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.329730] process_one_work+0x239/0x760 <4> [235.329737] worker_thread+0x200/0x3f0 <4> [235.329740] ? __pfx_worker_thread+0x10/0x10 <4> [235.329742] kthread+0x10d/0x150 <4> [235.329745] ? __pfx_kthread+0x10/0x10 <4> [235.329749] ret_from_fork+0x3d4/0x480 <4> [235.329751] ? __pfx_kthread+0x10/0x10 <4> [235.329755] ret_from_fork_asm+0x1a/0x30 <4> [235.329762] </TASK> <4> [235.329764] irq event stamp: 295385 <4> [235.329765] hardirqs last enabled at (295391): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.329768] hardirqs last disabled at (295396): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.329770] softirqs last enabled at (294400): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.329773] softirqs last disabled at (294391): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.329775] ---[ end trace 0000000000000000 ]--- <7> [235.330831] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.330935] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [235.361514] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16935, lrc_seqno=16935, guc_id=0, flags=0x73 in no process [-1] <7> [235.361517] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.361582] ------------[ cut here ]------------ <4> [235.361583] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.361584] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:54/3530 <4> [235.361654] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.361722] autofs4 [last unloaded: snd_hda_intel] <4> [235.361727] CPU: 7 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.361730] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.361731] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.361732] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.361738] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.361802] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.361804] RSP: 0018:ffffc90005c17ca0 EFLAGS: 00010246 <4> [235.361806] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.361808] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.361809] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.361810] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.361811] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.361813] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [235.361814] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.361816] CR2: 000000c0003e6000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [235.361817] PKRU: 55555554 <4> [235.361818] Call Trace: <4> [235.361819] <TASK> <4> [235.361823] ? lock_acquire+0x20/0x2f0 <4> [235.361829] ? lock_release+0xd0/0x2b0 <4> [235.361834] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.361840] process_one_work+0x239/0x760 <4> [235.361846] worker_thread+0x200/0x3f0 <4> [235.361849] ? __pfx_worker_thread+0x10/0x10 <4> [235.361851] kthread+0x10d/0x150 <4> [235.361854] ? __pfx_kthread+0x10/0x10 <4> [235.361858] ret_from_fork+0x3d4/0x480 <4> [235.361860] ? __pfx_kthread+0x10/0x10 <4> [235.361864] ret_from_fork_asm+0x1a/0x30 <4> [235.361871] </TASK> <4> [235.361872] irq event stamp: 296405 <4> [235.361874] hardirqs last enabled at (296411): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.361876] hardirqs last disabled at (296416): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.361879] softirqs last enabled at (294400): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.361881] softirqs last disabled at (294391): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.361884] ---[ end trace 0000000000000000 ]--- <6> [235.361885] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.361974] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.361983] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.362074] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.362278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.362365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.362452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.362531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.362609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.362686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.362764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.362843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.362924] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.363013] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.363123] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.364128] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.373908] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.374159] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.375300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.375379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.375451] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.375524] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.375598] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.375671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.375743] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.375816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.375892] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.375985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.376060] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.376131] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.376202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.376276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.376349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.376423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.376500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.376574] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.376648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.376736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.376823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.376910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.376996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.377076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.377155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.377236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.377318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.377404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.377492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.377578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.377670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.377761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.377856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.377960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.378053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.378144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.378229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.378310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.378391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.378469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.378551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.378630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.378710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.378786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.378869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.378956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.379032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.379105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.379182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.379257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.379330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.379404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.379476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.379548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.379618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.379689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.379760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.379826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.379896] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.380028] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.380032] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16935, lrc_seqno=16935, guc_id=0, flags=0x73 in no process [-1] <7> [235.380035] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.380095] ------------[ cut here ]------------ <4> [235.380096] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.380098] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:54/3530 <4> [235.380168] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.380237] autofs4 [last unloaded: snd_hda_intel] <4> [235.380241] CPU: 7 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.380244] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.380245] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.380247] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.380252] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.380318] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.380320] RSP: 0018:ffffc90005c17ca0 EFLAGS: 00010246 <4> [235.380322] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.380323] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.380324] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.380326] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.380327] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.380328] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [235.380330] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.380331] CR2: 000000c0003e6000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [235.380333] PKRU: 55555554 <4> [235.380334] Call Trace: <4> [235.380335] <TASK> <4> [235.380339] ? lock_acquire+0x20/0x2f0 <4> [235.380344] ? lock_release+0xd0/0x2b0 <4> [235.380350] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.380355] process_one_work+0x239/0x760 <4> [235.380361] worker_thread+0x200/0x3f0 <4> [235.380364] ? __pfx_worker_thread+0x10/0x10 <4> [235.380366] kthread+0x10d/0x150 <4> [235.380369] ? __pfx_kthread+0x10/0x10 <4> [235.380373] ret_from_fork+0x3d4/0x480 <4> [235.380375] ? __pfx_kthread+0x10/0x10 <4> [235.380378] ret_from_fork_asm+0x1a/0x30 <4> [235.380386] </TASK> <4> [235.380387] irq event stamp: 299553 <4> [235.380388] hardirqs last enabled at (299559): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.380391] hardirqs last disabled at (299564): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.380393] softirqs last enabled at (298710): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.380395] softirqs last disabled at (298703): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.380397] ---[ end trace 0000000000000000 ]--- <6> [235.380399] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.380466] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.380472] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.380750] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.380953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.381034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.381119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.381198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.381275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.381350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.381426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.381503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.381576] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.381665] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.381774] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.382776] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.393497] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.393748] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.394761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.394837] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.394914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.394986] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.395057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.395126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.395194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.395262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.395328] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.395395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.395461] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.395529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.395595] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.395661] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.395728] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.395795] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.395863] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.395940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.396008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.396083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.396158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.396229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.396300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.396369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.396438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.396507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.396577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.396649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.396723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.396793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.396863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.396941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.397015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.397090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.397166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.397238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.397308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.397377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.397446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.397515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.397586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.397656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.397725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.397793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.397867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.397945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.398016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.398086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.398156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.398224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.398292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.398362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.398434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.398506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.398575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.398644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.398712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.398780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.398852] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.398971] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.398975] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16935, lrc_seqno=16935, guc_id=0, flags=0x73 in no process [-1] <7> [235.398978] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.399035] ------------[ cut here ]------------ <4> [235.399036] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.399038] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:54/3530 <4> [235.399105] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.399169] autofs4 [last unloaded: snd_hda_intel] <4> [235.399173] CPU: 7 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.399175] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.399176] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.399178] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.399183] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.399248] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.399250] RSP: 0018:ffffc90005c17ca0 EFLAGS: 00010246 <4> [235.399252] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.399253] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.399255] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.399256] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.399257] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.399259] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [235.399260] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.399262] CR2: 000000c0003e6000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [235.399263] PKRU: 55555554 <4> [235.399264] Call Trace: <4> [235.399265] <TASK> <4> [235.399269] ? lock_acquire+0x20/0x2f0 <4> [235.399274] ? lock_release+0xd0/0x2b0 <4> [235.399279] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.399285] process_one_work+0x239/0x760 <4> [235.399291] worker_thread+0x200/0x3f0 <4> [235.399294] ? __pfx_worker_thread+0x10/0x10 <4> [235.399296] kthread+0x10d/0x150 <4> [235.399299] ? __pfx_kthread+0x10/0x10 <4> [235.399303] ret_from_fork+0x3d4/0x480 <4> [235.399305] ? __pfx_kthread+0x10/0x10 <4> [235.399308] ret_from_fork_asm+0x1a/0x30 <4> [235.399315] </TASK> <4> [235.399316] irq event stamp: 302691 <4> [235.399317] hardirqs last enabled at (302697): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.399320] hardirqs last disabled at (302702): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.399322] softirqs last enabled at (301642): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.399324] softirqs last disabled at (301635): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.399327] ---[ end trace 0000000000000000 ]--- <7> [235.400394] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.400500] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [235.431442] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16937, lrc_seqno=16937, guc_id=0, flags=0x73 in no process [-1] <7> [235.431445] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.431512] ------------[ cut here ]------------ <4> [235.431513] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.431515] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:54/3530 <4> [235.431587] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.431654] autofs4 [last unloaded: snd_hda_intel] <4> [235.431658] CPU: 7 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.431661] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.431662] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.431663] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.431669] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.431736] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.431738] RSP: 0018:ffffc90005c17ca0 EFLAGS: 00010246 <4> [235.431740] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.431741] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.431743] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.431744] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.431745] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.431746] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [235.431748] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.431749] CR2: 000000c0003e6000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [235.431751] PKRU: 55555554 <4> [235.431752] Call Trace: <4> [235.431753] <TASK> <4> [235.431757] ? lock_acquire+0x20/0x2f0 <4> [235.431763] ? lock_release+0xd0/0x2b0 <4> [235.431768] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.431773] process_one_work+0x239/0x760 <4> [235.431780] worker_thread+0x200/0x3f0 <4> [235.431782] ? __pfx_worker_thread+0x10/0x10 <4> [235.431785] kthread+0x10d/0x150 <4> [235.431788] ? __pfx_kthread+0x10/0x10 <4> [235.431791] ret_from_fork+0x3d4/0x480 <4> [235.431793] ? __pfx_kthread+0x10/0x10 <4> [235.431797] ret_from_fork_asm+0x1a/0x30 <4> [235.431805] </TASK> <4> [235.431806] irq event stamp: 303843 <4> [235.431807] hardirqs last enabled at (303849): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.431810] hardirqs last disabled at (303854): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.431812] softirqs last enabled at (302856): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [235.431814] softirqs last disabled at (302854): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [235.431817] ---[ end trace 0000000000000000 ]--- <6> [235.431818] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.431886] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.431893] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.431950] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.432164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.432257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.432348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.432432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.432512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.432590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.432668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.432748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.432823] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.432922] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.433034] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.434045] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.443956] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.444215] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.445323] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.445402] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.445476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.445549] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.445619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.445690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.445759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.445828] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.445904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.445971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.446038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.446106] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.446175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.446243] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.446310] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.446377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.446443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.446509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.446577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.446656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.446732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.446805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.446878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.446961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.447031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.447101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.447170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.447241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.447314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.447385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.447457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.447528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.447604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.447680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.447757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.447831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.447909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.447983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.448053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.448123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.448196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.448267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.448337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.448406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.448478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.448549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.448620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.448689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.448761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.448830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.448906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.448978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.449047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.449118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.449187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.449255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.449322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.449389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.449461] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.449577] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.449581] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16937, lrc_seqno=16937, guc_id=0, flags=0x73 in no process [-1] <7> [235.449584] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.449641] ------------[ cut here ]------------ <4> [235.449642] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.449644] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:11/3206 <4> [235.449712] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.449791] autofs4 [last unloaded: snd_hda_intel] <4> [235.449796] CPU: 4 UID: 0 PID: 3206 Comm: kworker/u64:11 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.449799] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.449801] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.449802] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.449807] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.449874] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.449876] RSP: 0018:ffffc90004707ca0 EFLAGS: 00010246 <4> [235.449878] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.449880] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.449881] RBP: ffffc90004707db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.449882] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.449884] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.449885] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [235.449887] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.449888] CR2: 000076c648fd1000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [235.449890] PKRU: 55555554 <4> [235.449891] Call Trace: <4> [235.449892] <TASK> <4> [235.449896] ? lock_acquire+0x20/0x2f0 <4> [235.449910] ? lock_release+0xd0/0x2b0 <4> [235.449919] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.449928] process_one_work+0x239/0x760 <4> [235.449939] worker_thread+0x200/0x3f0 <4> [235.449944] ? __pfx_worker_thread+0x10/0x10 <4> [235.449948] kthread+0x10d/0x150 <4> [235.449952] ? __pfx_kthread+0x10/0x10 <4> [235.449958] ret_from_fork+0x3d4/0x480 <4> [235.449961] ? __pfx_kthread+0x10/0x10 <4> [235.449966] ret_from_fork_asm+0x1a/0x30 <4> [235.449979] </TASK> <4> [235.449981] irq event stamp: 600957 <4> [235.449984] hardirqs last enabled at (600963): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.449988] hardirqs last disabled at (600968): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.449991] softirqs last enabled at (600886): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.449995] softirqs last disabled at (600881): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.449999] ---[ end trace 0000000000000000 ]--- <6> [235.450002] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.450102] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.450111] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.450390] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.450590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.450669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.450752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.450830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.450913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.450989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.451065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.451141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.451214] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.451304] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.451416] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.452423] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.462908] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.463156] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.464226] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.464302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.464373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.464444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.464514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.464583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.464654] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.464725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.464794] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.464862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.464941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.465011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.465081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.465147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.465214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.465281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.465348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.465414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.465482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.465559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.465633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.465706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.465779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.465850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.465926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.465996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.466064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.466136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.466208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.466280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.466350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.466420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.466498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.466576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.466654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.466729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.466802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.466872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.466950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.467018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.467089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.467159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.467228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.467296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.467369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.467439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.467508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.467578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.467647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.467714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.467781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.467854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.467934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.468005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.468073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.468143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.468210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.468278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.468349] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.468461] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.468465] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16937, lrc_seqno=16937, guc_id=0, flags=0x73 in no process [-1] <7> [235.468468] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.468524] ------------[ cut here ]------------ <4> [235.468525] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.468527] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:11/3206 <4> [235.468596] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.468659] autofs4 [last unloaded: snd_hda_intel] <4> [235.468663] CPU: 4 UID: 0 PID: 3206 Comm: kworker/u64:11 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.468666] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.468667] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.468668] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.468673] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.468741] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.468742] RSP: 0018:ffffc90004707ca0 EFLAGS: 00010246 <4> [235.468745] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.468747] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.468748] RBP: ffffc90004707db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.468750] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.468751] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.468752] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [235.468754] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.468756] CR2: 000076c648fd1000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [235.468758] PKRU: 55555554 <4> [235.468759] Call Trace: <4> [235.468760] <TASK> <4> [235.468764] ? lock_acquire+0x20/0x2f0 <4> [235.468770] ? lock_release+0xd0/0x2b0 <4> [235.468775] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.468781] process_one_work+0x239/0x760 <4> [235.468787] worker_thread+0x200/0x3f0 <4> [235.468790] ? __pfx_worker_thread+0x10/0x10 <4> [235.468793] kthread+0x10d/0x150 <4> [235.468796] ? __pfx_kthread+0x10/0x10 <4> [235.468800] ret_from_fork+0x3d4/0x480 <4> [235.468802] ? __pfx_kthread+0x10/0x10 <4> [235.468805] ret_from_fork_asm+0x1a/0x30 <4> [235.468813] </TASK> <4> [235.468814] irq event stamp: 604115 <4> [235.468816] hardirqs last enabled at (604121): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.468818] hardirqs last disabled at (604126): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.468821] softirqs last enabled at (603226): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.468824] softirqs last disabled at (603203): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.468826] ---[ end trace 0000000000000000 ]--- <7> [235.469920] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.470066] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [235.500318] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16939, lrc_seqno=16939, guc_id=0, flags=0x73 in no process [-1] <7> [235.500323] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.500386] ------------[ cut here ]------------ <4> [235.500387] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.500389] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:16/3246 <4> [235.500457] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.500519] autofs4 [last unloaded: snd_hda_intel] <4> [235.500522] CPU: 0 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.500525] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.500526] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.500528] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.500532] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.500595] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.500596] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [235.500599] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.500600] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.500601] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.500602] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.500603] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.500605] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [235.500606] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.500607] CR2: 00007a4496a66000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [235.500609] PKRU: 55555554 <4> [235.500610] Call Trace: <4> [235.500611] <TASK> <4> [235.500615] ? lock_acquire+0x20/0x2f0 <4> [235.500620] ? lock_release+0xd0/0x2b0 <4> [235.500625] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.500630] process_one_work+0x239/0x760 <4> [235.500636] worker_thread+0x200/0x3f0 <4> [235.500638] ? __pfx_worker_thread+0x10/0x10 <4> [235.500640] kthread+0x10d/0x150 <4> [235.500643] ? __pfx_kthread+0x10/0x10 <4> [235.500646] ret_from_fork+0x3d4/0x480 <4> [235.500648] ? __pfx_kthread+0x10/0x10 <4> [235.500652] ret_from_fork_asm+0x1a/0x30 <4> [235.500658] </TASK> <4> [235.500659] irq event stamp: 186867 <4> [235.500661] hardirqs last enabled at (186873): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.500663] hardirqs last disabled at (186878): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.500665] softirqs last enabled at (185804): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [235.500668] softirqs last disabled at (185802): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [235.500670] ---[ end trace 0000000000000000 ]--- <6> [235.500671] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.500735] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.500743] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.500840] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.501109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.501249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.501390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.501524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.501658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.501790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.501935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.502072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.502203] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.502346] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.502512] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.503925] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.514707] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.515026] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.516277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.516415] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.516553] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.516695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.516840] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.516995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.517142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.517292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.517443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.517595] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.517751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.517915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.518074] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.518236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.518400] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.518563] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.518726] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.518896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.519072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.519257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.519444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.519623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.519799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.519975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.520145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.520313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.520480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.520646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.520807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.520977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.521137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.521292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.521450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.521608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.521761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.521920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.522071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.522214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.522353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.522488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.522625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.522757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.522884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.523016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.523149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.523276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.523400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.523522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.523646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.523768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.523890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.524022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.524147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.524270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.524392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.524517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.524638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.524761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.524887] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.525059] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.525066] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16939, lrc_seqno=16939, guc_id=0, flags=0x73 in no process [-1] <7> [235.525070] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.525176] ------------[ cut here ]------------ <4> [235.525178] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.525181] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#13: kworker/u64:11/3206 <4> [235.525294] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.525391] autofs4 [last unloaded: snd_hda_intel] <4> [235.525397] CPU: 13 UID: 0 PID: 3206 Comm: kworker/u64:11 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.525401] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.525403] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.525405] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.525413] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.525526] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.525528] RSP: 0018:ffffc90004707ca0 EFLAGS: 00010246 <4> [235.525531] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.525534] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.525536] RBP: ffffc90004707db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.525537] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.525539] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.525541] FS: 0000000000000000(0000) GS:ffff8888db317000(0000) knlGS:0000000000000000 <4> [235.525544] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.525546] CR2: 0000583db42f0d78 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [235.525548] PKRU: 55555554 <4> [235.525549] Call Trace: <4> [235.525551] <TASK> <4> [235.525558] ? lock_acquire+0x20/0x2f0 <4> [235.525567] ? lock_release+0xd0/0x2b0 <4> [235.525575] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.525584] process_one_work+0x239/0x760 <4> [235.525595] worker_thread+0x200/0x3f0 <4> [235.525599] ? __pfx_worker_thread+0x10/0x10 <4> [235.525602] kthread+0x10d/0x150 <4> [235.525606] ? __pfx_kthread+0x10/0x10 <4> [235.525612] ret_from_fork+0x3d4/0x480 <4> [235.525615] ? __pfx_kthread+0x10/0x10 <4> [235.525619] ret_from_fork_asm+0x1a/0x30 <4> [235.525632] </TASK> <4> [235.525633] irq event stamp: 607435 <4> [235.525635] hardirqs last enabled at (607441): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.525639] hardirqs last disabled at (607446): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.525642] softirqs last enabled at (606420): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.525646] softirqs last disabled at (606415): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.525649] ---[ end trace 0000000000000000 ]--- <6> [235.525651] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.525765] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.525773] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.526049] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.526301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.526430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.526566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.526697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.526827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.526964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.527096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.527229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.527358] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.527498] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.527661] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.528744] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.538904] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.539148] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.540229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.540322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.540406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.540484] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.540561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.540636] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.540712] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.540785] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.540858] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.540947] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.541020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.541094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.541166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.541237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.541308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.541380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.541452] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.541526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.541599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.541682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.541764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.541843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.541932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.542009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.542083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.542158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.542231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.542307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.542386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.542460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.542537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.542611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.542690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.542770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.542849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.542933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.543010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.543084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.543160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.543232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.543309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.543383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.543456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.543529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.543605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.543678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.543750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.543821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.543895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.543981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.544053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.544129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.544203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.544276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.544350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.544423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.544497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.544571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.544648] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.544764] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.544769] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16939, lrc_seqno=16939, guc_id=0, flags=0x73 in no process [-1] <7> [235.544772] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.544834] ------------[ cut here ]------------ <4> [235.544835] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.544836] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:11/3206 <4> [235.544912] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.544977] autofs4 [last unloaded: snd_hda_intel] <4> [235.544981] CPU: 4 UID: 0 PID: 3206 Comm: kworker/u64:11 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.544984] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.544985] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.544987] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.544992] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.545062] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.545064] RSP: 0018:ffffc90004707ca0 EFLAGS: 00010246 <4> [235.545066] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.545067] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.545069] RBP: ffffc90004707db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.545070] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.545071] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.545073] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [235.545074] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.545076] CR2: 000076c648fd1000 CR3: 0000000115abe002 CR4: 0000000000f72ef0 <4> [235.545077] PKRU: 55555554 <4> [235.545078] Call Trace: <4> [235.545080] <TASK> <4> [235.545083] ? lock_acquire+0x20/0x2f0 <4> [235.545089] ? lock_release+0xd0/0x2b0 <4> [235.545094] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.545100] process_one_work+0x239/0x760 <4> [235.545106] worker_thread+0x200/0x3f0 <4> [235.545109] ? __pfx_worker_thread+0x10/0x10 <4> [235.545111] kthread+0x10d/0x150 <4> [235.545114] ? __pfx_kthread+0x10/0x10 <4> [235.545118] ret_from_fork+0x3d4/0x480 <4> [235.545120] ? __pfx_kthread+0x10/0x10 <4> [235.545123] ret_from_fork_asm+0x1a/0x30 <4> [235.545130] </TASK> <4> [235.545131] irq event stamp: 610603 <4> [235.545133] hardirqs last enabled at (610609): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.545136] hardirqs last disabled at (610614): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.545138] softirqs last enabled at (609692): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.545140] softirqs last disabled at (609687): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.545142] ---[ end trace 0000000000000000 ]--- <7> [235.546389] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.546538] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [235.576431] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16941, lrc_seqno=16941, guc_id=0, flags=0x73 in no process [-1] <7> [235.576436] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.576526] ------------[ cut here ]------------ <4> [235.576527] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.576529] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:54/3530 <4> [235.576603] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.576671] autofs4 [last unloaded: snd_hda_intel] <4> [235.576675] CPU: 7 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.576678] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.576679] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.576681] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.576686] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.576755] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.576756] RSP: 0018:ffffc90005c17ca0 EFLAGS: 00010246 <4> [235.576759] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.576760] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.576762] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.576763] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.576764] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.576766] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [235.576767] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.576769] CR2: 000000c0003e6000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [235.576770] PKRU: 55555554 <4> [235.576771] Call Trace: <4> [235.576773] <TASK> <4> [235.576777] ? lock_acquire+0x20/0x2f0 <4> [235.576783] ? lock_release+0xd0/0x2b0 <4> [235.576788] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.576794] process_one_work+0x239/0x760 <4> [235.576800] worker_thread+0x200/0x3f0 <4> [235.576803] ? __pfx_worker_thread+0x10/0x10 <4> [235.576805] kthread+0x10d/0x150 <4> [235.576808] ? __pfx_kthread+0x10/0x10 <4> [235.576811] ret_from_fork+0x3d4/0x480 <4> [235.576814] ? __pfx_kthread+0x10/0x10 <4> [235.576817] ret_from_fork_asm+0x1a/0x30 <4> [235.576824] </TASK> <4> [235.576825] irq event stamp: 306143 <4> [235.576827] hardirqs last enabled at (306149): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.576830] hardirqs last disabled at (306154): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.576832] softirqs last enabled at (305148): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [235.576834] softirqs last disabled at (305146): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [235.576836] ---[ end trace 0000000000000000 ]--- <6> [235.576839] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.576917] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.576926] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.576988] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.577193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.577280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.577368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.577450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.577530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.577610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.577692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.577774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.577851] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.577962] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.578074] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.579085] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.588903] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.589150] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.590179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.590255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.590326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.590399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.590470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.590539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.590608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.590677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.590745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.590813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.590881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.590967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.591036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.591103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.591171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.591240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.591311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.591380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.591452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.591534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.591613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.591691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.591769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.591843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.591924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.592001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.592074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.592153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.592235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.592312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.592391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.592469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.592552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.592635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.592719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.592799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.592879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.592969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.593047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.593123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.593203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.593279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.593353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.593425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.593499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.593569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.593638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.593712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.593785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.593854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.593931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.594003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.594073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.594143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.594212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.594282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.594351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.594420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.594494] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.594607] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.594611] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16941, lrc_seqno=16941, guc_id=0, flags=0x73 in no process [-1] <7> [235.594613] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.594670] ------------[ cut here ]------------ <4> [235.594671] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.594673] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:54/3530 <4> [235.594741] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.594806] autofs4 [last unloaded: snd_hda_intel] <4> [235.594810] CPU: 7 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.594813] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.594814] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.594816] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.594821] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.594889] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.594891] RSP: 0018:ffffc90005c17ca0 EFLAGS: 00010246 <4> [235.594893] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.594899] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.594901] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.594904] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.594906] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.594909] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [235.594912] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.594914] CR2: 000000c0003e6000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [235.594916] PKRU: 55555554 <4> [235.594918] Call Trace: <4> [235.594919] <TASK> <4> [235.594923] ? lock_acquire+0x20/0x2f0 <4> [235.594928] ? lock_release+0xd0/0x2b0 <4> [235.594933] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.594939] process_one_work+0x239/0x760 <4> [235.594946] worker_thread+0x200/0x3f0 <4> [235.594948] ? __pfx_worker_thread+0x10/0x10 <4> [235.594951] kthread+0x10d/0x150 <4> [235.594954] ? __pfx_kthread+0x10/0x10 <4> [235.594957] ret_from_fork+0x3d4/0x480 <4> [235.594959] ? __pfx_kthread+0x10/0x10 <4> [235.594963] ret_from_fork_asm+0x1a/0x30 <4> [235.594970] </TASK> <4> [235.594971] irq event stamp: 309303 <4> [235.594973] hardirqs last enabled at (309309): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.594976] hardirqs last disabled at (309314): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.594978] softirqs last enabled at (308204): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.594980] softirqs last disabled at (308195): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.594983] ---[ end trace 0000000000000000 ]--- <6> [235.595910] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.595988] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.595998] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.596013] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.596113] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.596213] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.596422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.596512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.596603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.596688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.596769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.596848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.596943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.597022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.597098] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.597187] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.597296] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.598304] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.608906] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.609152] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.610195] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.610268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.610340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.610412] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.610482] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.610550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.610619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.610687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.610755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.610822] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.610890] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.610983] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.611050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.611119] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.611191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.611263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.611333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.611403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.611473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.611550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.611626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.611699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.611773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.611844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.611923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.611994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.612064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.612139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.612215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.612288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.612360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.612432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.612508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.612586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.612661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.612733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.612804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.612875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.612962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.613035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.613108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.613181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.613253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.613323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.613396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.613464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.613533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.613601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.613671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.613738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.613805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.613876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.613963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.614031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.614099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.614167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.614234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.614302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.614373] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.614486] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.614490] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16941, lrc_seqno=16941, guc_id=0, flags=0x73 in no process [-1] <7> [235.614493] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.614549] ------------[ cut here ]------------ <4> [235.614550] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.614552] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:16/3246 <4> [235.614619] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.614687] autofs4 [last unloaded: snd_hda_intel] <4> [235.614691] CPU: 0 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.614695] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.614696] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.614698] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.614703] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.614769] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.614771] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [235.614773] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.614775] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.614776] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.614778] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.614779] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.614781] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [235.614783] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.614784] CR2: 00007a4496a66000 CR3: 0000000115abe003 CR4: 0000000000f72ef0 <4> [235.614786] PKRU: 55555554 <4> [235.614787] Call Trace: <4> [235.614789] <TASK> <4> [235.614793] ? lock_acquire+0x20/0x2f0 <4> [235.614799] ? lock_release+0xd0/0x2b0 <4> [235.614804] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.614810] process_one_work+0x239/0x760 <4> [235.614816] worker_thread+0x200/0x3f0 <4> [235.614819] ? __pfx_worker_thread+0x10/0x10 <4> [235.614822] kthread+0x10d/0x150 <4> [235.614825] ? __pfx_kthread+0x10/0x10 <4> [235.614828] ret_from_fork+0x3d4/0x480 <4> [235.614831] ? __pfx_kthread+0x10/0x10 <4> [235.614834] ret_from_fork_asm+0x1a/0x30 <4> [235.614842] </TASK> <4> [235.614843] irq event stamp: 191207 <4> [235.614844] hardirqs last enabled at (191213): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.614847] hardirqs last disabled at (191218): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.614850] softirqs last enabled at (190012): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.614852] softirqs last disabled at (190007): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.614855] ---[ end trace 0000000000000000 ]--- <7> [235.615908] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.616011] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [235.646499] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16943, lrc_seqno=16943, guc_id=0, flags=0x73 in no process [-1] <7> [235.646503] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.646567] ------------[ cut here ]------------ <4> [235.646568] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.646570] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:16/3246 <4> [235.646638] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.646708] autofs4 [last unloaded: snd_hda_intel] <4> [235.646712] CPU: 0 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.646715] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.646716] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.646717] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.646723] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.646790] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.646791] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [235.646793] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.646795] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.646796] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.646797] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.646798] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.646800] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [235.646801] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.646803] CR2: 00007a4496a66000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [235.646804] PKRU: 55555554 <4> [235.646806] Call Trace: <4> [235.646807] <TASK> <4> [235.646811] ? lock_acquire+0x20/0x2f0 <4> [235.646817] ? lock_release+0xd0/0x2b0 <4> [235.646822] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.646827] process_one_work+0x239/0x760 <4> [235.646834] worker_thread+0x200/0x3f0 <4> [235.646837] ? __pfx_worker_thread+0x10/0x10 <4> [235.646839] kthread+0x10d/0x150 <4> [235.646842] ? __pfx_kthread+0x10/0x10 <4> [235.646846] ret_from_fork+0x3d4/0x480 <4> [235.646848] ? __pfx_kthread+0x10/0x10 <4> [235.646851] ret_from_fork_asm+0x1a/0x30 <4> [235.646859] </TASK> <4> [235.646860] irq event stamp: 192223 <4> [235.646861] hardirqs last enabled at (192229): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.646864] hardirqs last disabled at (192234): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.646866] softirqs last enabled at (190012): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.646868] softirqs last disabled at (190007): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.646871] ---[ end trace 0000000000000000 ]--- <6> [235.646873] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.646957] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.646967] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.647015] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.647219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.647304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.647391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.647472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.647551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.647631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.647711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.647793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.647869] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.647969] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.648081] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.649104] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.658909] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.659159] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.660241] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.660317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.660386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.660458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.660528] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.660596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.660664] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.660732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.660801] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.660872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.660950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.661020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.661088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.661157] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.661228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.661301] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.661375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.661449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.661523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.661608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.661692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.661773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.661854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.661947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.662025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.662100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.662177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.662259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.662342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.662425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.662506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.662585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.662668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.662751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.662831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.662918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.662997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.663074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.663151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.663223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.663295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.663367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.663436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.663503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.663575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.663640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.663706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.663770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.663836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.663907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.663976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.664046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.664113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.664179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.664242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.664307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.664373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.664440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.664509] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.664624] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.664628] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16943, lrc_seqno=16943, guc_id=0, flags=0x73 in no process [-1] <7> [235.664630] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.664687] ------------[ cut here ]------------ <4> [235.664688] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.664689] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:16/3246 <4> [235.664757] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.664825] autofs4 [last unloaded: snd_hda_intel] <4> [235.664829] CPU: 0 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.664833] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.664834] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.664836] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.664841] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.664912] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.664914] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [235.664916] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.664918] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.664920] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.664921] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.664923] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.664924] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [235.664926] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.664928] CR2: 00007a4496a66000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [235.664929] PKRU: 55555554 <4> [235.664931] Call Trace: <4> [235.664932] <TASK> <4> [235.664936] ? lock_acquire+0x20/0x2f0 <4> [235.664942] ? lock_release+0xd0/0x2b0 <4> [235.664947] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.664953] process_one_work+0x239/0x760 <4> [235.664960] worker_thread+0x200/0x3f0 <4> [235.664963] ? __pfx_worker_thread+0x10/0x10 <4> [235.664965] kthread+0x10d/0x150 <4> [235.664968] ? __pfx_kthread+0x10/0x10 <4> [235.664972] ret_from_fork+0x3d4/0x480 <4> [235.664975] ? __pfx_kthread+0x10/0x10 <4> [235.664978] ret_from_fork_asm+0x1a/0x30 <4> [235.664986] </TASK> <4> [235.664987] irq event stamp: 195355 <4> [235.664989] hardirqs last enabled at (195361): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.664992] hardirqs last disabled at (195366): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.664994] softirqs last enabled at (194250): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.664997] softirqs last disabled at (194245): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.664999] ---[ end trace 0000000000000000 ]--- <6> [235.665001] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.665069] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.665075] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.665353] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.665553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.665634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.665716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.665793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.665870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.665963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.666039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.666120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.666196] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.666285] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.666396] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.667400] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.677901] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.678149] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.679264] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.679341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.679411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.679482] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.679552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.679622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.679691] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.679758] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.679825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.679898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.679967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.680034] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.680102] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.680167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.680232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.680297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.680363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.680429] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.680494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.680570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.680646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.680722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.680793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.680860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.680938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.681007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.681074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.681143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.681214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.681282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.681352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.681420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.681494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.681569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.681643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.681714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.681783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.681850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.681924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.681989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.682057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.682127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.682194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.682259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.682330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.682396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.682465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.682531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.682600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.682667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.682732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.682800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.682868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.682951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.683022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.683095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.683163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.683222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.683284] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.683390] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.683394] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16943, lrc_seqno=16943, guc_id=0, flags=0x73 in no process [-1] <7> [235.683396] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.683453] ------------[ cut here ]------------ <4> [235.683454] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.683455] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:16/3246 <4> [235.683518] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.683581] autofs4 [last unloaded: snd_hda_intel] <4> [235.683585] CPU: 0 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.683588] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.683589] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.683590] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.683595] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.683661] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.683663] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [235.683666] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.683667] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.683669] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.683670] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.683672] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.683673] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [235.683675] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.683677] CR2: 00007a4496a66000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [235.683678] PKRU: 55555554 <4> [235.683680] Call Trace: <4> [235.683681] <TASK> <4> [235.683685] ? lock_acquire+0x20/0x2f0 <4> [235.683690] ? lock_release+0xd0/0x2b0 <4> [235.683696] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.683702] process_one_work+0x239/0x760 <4> [235.683708] worker_thread+0x200/0x3f0 <4> [235.683711] ? __pfx_worker_thread+0x10/0x10 <4> [235.683713] kthread+0x10d/0x150 <4> [235.683716] ? __pfx_kthread+0x10/0x10 <4> [235.683720] ret_from_fork+0x3d4/0x480 <4> [235.683722] ? __pfx_kthread+0x10/0x10 <4> [235.683726] ret_from_fork_asm+0x1a/0x30 <4> [235.683733] </TASK> <4> [235.683735] irq event stamp: 198497 <4> [235.683736] hardirqs last enabled at (198503): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.683739] hardirqs last disabled at (198508): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.683741] softirqs last enabled at (197512): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.683744] softirqs last disabled at (197505): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.683746] ---[ end trace 0000000000000000 ]--- <7> [235.684797] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.684904] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [235.717497] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16945, lrc_seqno=16945, guc_id=0, flags=0x73 in no process [-1] <7> [235.717502] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.717573] ------------[ cut here ]------------ <4> [235.717575] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.717576] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:68/3544 <4> [235.717650] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.717718] autofs4 [last unloaded: snd_hda_intel] <4> [235.717722] CPU: 2 UID: 0 PID: 3544 Comm: kworker/u64:68 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.717725] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.717726] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.717728] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.717733] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.717800] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.717802] RSP: 0018:ffffc90005c77ca0 EFLAGS: 00010246 <4> [235.717804] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.717806] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.717807] RBP: ffffc90005c77db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.717808] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.717810] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.717811] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [235.717812] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.717814] CR2: 000074070bfff000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [235.717815] PKRU: 55555554 <4> [235.717816] Call Trace: <4> [235.717818] <TASK> <4> [235.717822] ? lock_acquire+0x20/0x2f0 <4> [235.717828] ? lock_release+0xd0/0x2b0 <4> [235.717833] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.717839] process_one_work+0x239/0x760 <4> [235.717846] worker_thread+0x200/0x3f0 <4> [235.717848] ? __pfx_worker_thread+0x10/0x10 <4> [235.717851] kthread+0x10d/0x150 <4> [235.717853] ? __pfx_kthread+0x10/0x10 <4> [235.717857] ret_from_fork+0x3d4/0x480 <4> [235.717859] ? __pfx_kthread+0x10/0x10 <4> [235.717863] ret_from_fork_asm+0x1a/0x30 <4> [235.717870] </TASK> <4> [235.717871] irq event stamp: 181709 <4> [235.717872] hardirqs last enabled at (181715): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.717875] hardirqs last disabled at (181720): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.717878] softirqs last enabled at (180664): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [235.717880] softirqs last disabled at (180662): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [235.717882] ---[ end trace 0000000000000000 ]--- <6> [235.717884] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.717974] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.717983] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.718035] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.718264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.718350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.718439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.718522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.718603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.718681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.718759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.718841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.718930] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.719031] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.719141] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.720157] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.729900] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.730150] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.731201] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.731277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.731353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.731429] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.731503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.731577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.731650] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.731723] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.731797] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.731870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.731964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.732058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.732135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.732209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.732287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.732367] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.732447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.732525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.732604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.732693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.732777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.732857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.732954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.733048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.733128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.733205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.733276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.733349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.733425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.733496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.733567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.733639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.733717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.733791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.733867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.733991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.734078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.734150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.734219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.734286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.734356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.734422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.734489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.734553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.734621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.734686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.734752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.734817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.734883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.734966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.735047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.735116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.735182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.735248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.735312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.735378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.735445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.735512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.735582] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.735696] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.735700] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16945, lrc_seqno=16945, guc_id=0, flags=0x73 in no process [-1] <7> [235.735703] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.735759] ------------[ cut here ]------------ <4> [235.735760] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.735762] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:68/3544 <4> [235.735829] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.735905] autofs4 [last unloaded: snd_hda_intel] <4> [235.735913] CPU: 2 UID: 0 PID: 3544 Comm: kworker/u64:68 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.735917] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.735919] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.735922] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.735930] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.736009] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.736011] RSP: 0018:ffffc90005c77ca0 EFLAGS: 00010246 <4> [235.736014] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.736015] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.736017] RBP: ffffc90005c77db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.736018] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.736020] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.736022] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [235.736023] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.736025] CR2: 000074070bfff000 CR3: 000000011d2b5004 CR4: 0000000000f72ef0 <4> [235.736027] PKRU: 55555554 <4> [235.736028] Call Trace: <4> [235.736030] <TASK> <4> [235.736034] ? lock_acquire+0x20/0x2f0 <4> [235.736040] ? lock_release+0xd0/0x2b0 <4> [235.736045] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.736051] process_one_work+0x239/0x760 <4> [235.736057] worker_thread+0x200/0x3f0 <4> [235.736060] ? __pfx_worker_thread+0x10/0x10 <4> [235.736063] kthread+0x10d/0x150 <4> [235.736066] ? __pfx_kthread+0x10/0x10 <4> [235.736070] ret_from_fork+0x3d4/0x480 <4> [235.736072] ? __pfx_kthread+0x10/0x10 <4> [235.736076] ret_from_fork_asm+0x1a/0x30 <4> [235.736083] </TASK> <4> [235.736085] irq event stamp: 184847 <4> [235.736086] hardirqs last enabled at (184853): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.736089] hardirqs last disabled at (184858): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.736092] softirqs last enabled at (183836): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.736094] softirqs last disabled at (183829): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.736097] ---[ end trace 0000000000000000 ]--- <6> [235.736099] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.736166] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.736174] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.737293] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.737399] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.737500] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.737711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.737802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.737890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.737988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.738070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.738147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.738225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.738306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.738380] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.738472] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.738586] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.739591] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.750248] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.750500] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.751544] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.751620] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.751692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.751764] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.751834] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.751907] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.751978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.752046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.752115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.752182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.752249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.752317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.752384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.752452] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.752522] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.752590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.752658] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.752727] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.752795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.752872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.752956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.753029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.753102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.753174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.753245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.753316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.753386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.753461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.753534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.753607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.753679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.753750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.753826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.753905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.753983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.754056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.754127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.754197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.754266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.754335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.754407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.754478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.754548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.754616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.754689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.754758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.754826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.754898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.754971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.755042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.755112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.755185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.755256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.755328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.755399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.755471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.755540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.755609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.755681] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.755797] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.755801] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16945, lrc_seqno=16945, guc_id=0, flags=0x73 in no process [-1] <7> [235.755803] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.755861] ------------[ cut here ]------------ <4> [235.755863] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.755864] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:11/3206 <4> [235.755942] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.756012] autofs4 [last unloaded: snd_hda_intel] <4> [235.756017] CPU: 10 UID: 0 PID: 3206 Comm: kworker/u64:11 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.756020] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.756021] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.756023] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.756029] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.756095] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.756096] RSP: 0018:ffffc90004707ca0 EFLAGS: 00010246 <4> [235.756099] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.756100] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.756102] RBP: ffffc90004707db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.756103] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.756104] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.756105] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [235.756107] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.756108] CR2: 00007a448c066108 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [235.756110] PKRU: 55555554 <4> [235.756111] Call Trace: <4> [235.756112] <TASK> <4> [235.756116] ? lock_acquire+0x20/0x2f0 <4> [235.756122] ? lock_release+0xd0/0x2b0 <4> [235.756127] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.756133] process_one_work+0x239/0x760 <4> [235.756139] worker_thread+0x200/0x3f0 <4> [235.756142] ? __pfx_worker_thread+0x10/0x10 <4> [235.756145] kthread+0x10d/0x150 <4> [235.756147] ? __pfx_kthread+0x10/0x10 <4> [235.756151] ret_from_fork+0x3d4/0x480 <4> [235.756153] ? __pfx_kthread+0x10/0x10 <4> [235.756157] ret_from_fork_asm+0x1a/0x30 <4> [235.756164] </TASK> <4> [235.756165] irq event stamp: 616143 <4> [235.756166] hardirqs last enabled at (616149): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.756169] hardirqs last disabled at (616154): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.756171] softirqs last enabled at (615020): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.756174] softirqs last disabled at (615013): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.756176] ---[ end trace 0000000000000000 ]--- <7> [235.757314] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.757416] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [235.793971] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16947, lrc_seqno=16947, guc_id=0, flags=0x73 in no process [-1] <7> [235.793976] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.794046] ------------[ cut here ]------------ <4> [235.794048] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.794049] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:54/3530 <4> [235.794124] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.794195] autofs4 [last unloaded: snd_hda_intel] <4> [235.794200] CPU: 9 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.794203] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.794204] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.794206] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.794212] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.794282] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.794284] RSP: 0018:ffffc90005c17ca0 EFLAGS: 00010246 <4> [235.794286] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.794288] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.794289] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.794291] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.794292] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.794293] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000 <4> [235.794295] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.794296] CR2: 0000740716345c60 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [235.794298] PKRU: 55555554 <4> [235.794299] Call Trace: <4> [235.794300] <TASK> <4> [235.794304] ? lock_acquire+0x20/0x2f0 <4> [235.794310] ? lock_release+0xd0/0x2b0 <4> [235.794316] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.794321] process_one_work+0x239/0x760 <4> [235.794329] worker_thread+0x200/0x3f0 <4> [235.794331] ? __pfx_worker_thread+0x10/0x10 <4> [235.794334] kthread+0x10d/0x150 <4> [235.794337] ? __pfx_kthread+0x10/0x10 <4> [235.794340] ret_from_fork+0x3d4/0x480 <4> [235.794343] ? __pfx_kthread+0x10/0x10 <4> [235.794346] ret_from_fork_asm+0x1a/0x30 <4> [235.794354] </TASK> <4> [235.794355] irq event stamp: 311065 <4> [235.794356] hardirqs last enabled at (311071): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.794359] hardirqs last disabled at (311076): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.794362] softirqs last enabled at (310030): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [235.794364] softirqs last disabled at (310028): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [235.794366] ---[ end trace 0000000000000000 ]--- <6> [235.794369] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.794439] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.794447] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.794495] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.794700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.794788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.794876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.794979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.795062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.795141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.795219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.795298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.795373] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.795464] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.795576] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.796598] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.807247] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.807497] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.808738] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.808825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.808906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.808983] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.809053] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.809125] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.809197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.809270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.809341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.809413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.809483] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.809552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.809621] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.809692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.809763] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.809836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.809919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.809997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.810070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.810154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.810237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.810316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.810397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.810475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.810554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.810634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.810712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.810796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.810881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.810981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.811063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.811145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.811232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.811319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.811411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.811500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.811590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.811676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.811764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.811853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.811956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.812044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.812130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.812218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.812315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.812409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.812503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.812595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.812691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.812784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.812878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.812994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.813089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.813186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.813283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.813382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.813478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.813574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.813679] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.813833] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.813840] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16947, lrc_seqno=16947, guc_id=0, flags=0x73 in no process [-1] <7> [235.813843] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.813948] ------------[ cut here ]------------ <4> [235.813950] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.813952] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:54/3530 <4> [235.814052] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.814150] autofs4 [last unloaded: snd_hda_intel] <4> [235.814156] CPU: 10 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.814161] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.814162] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.814164] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.814172] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.814268] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.814270] RSP: 0018:ffffc90005c17ca0 EFLAGS: 00010246 <4> [235.814274] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.814276] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.814278] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.814280] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.814282] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.814286] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [235.814289] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.814291] CR2: 00007a448c066108 CR3: 0000000115abe002 CR4: 0000000000f72ef0 <4> [235.814293] PKRU: 55555554 <4> [235.814295] Call Trace: <4> [235.814296] <TASK> <4> [235.814302] ? lock_acquire+0x20/0x2f0 <4> [235.814310] ? lock_release+0xd0/0x2b0 <4> [235.814317] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.814325] process_one_work+0x239/0x760 <4> [235.814333] worker_thread+0x200/0x3f0 <4> [235.814337] ? __pfx_worker_thread+0x10/0x10 <4> [235.814340] kthread+0x10d/0x150 <4> [235.814344] ? __pfx_kthread+0x10/0x10 <4> [235.814349] ret_from_fork+0x3d4/0x480 <4> [235.814352] ? __pfx_kthread+0x10/0x10 <4> [235.814356] ret_from_fork_asm+0x1a/0x30 <4> [235.814367] </TASK> <4> [235.814368] irq event stamp: 314209 <4> [235.814370] hardirqs last enabled at (314215): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.814374] hardirqs last disabled at (314220): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.814376] softirqs last enabled at (313448): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.814380] softirqs last disabled at (313443): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.814383] ---[ end trace 0000000000000000 ]--- <6> [235.814386] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.814479] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.814487] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.814757] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.814993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.815095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.815203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.815304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.815405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.815500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.815594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.815692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.815783] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.815896] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.816025] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.817059] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.827785] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.828033] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.829055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.829131] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.829202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.829273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.829344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.829414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.829483] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.829552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.829620] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.829688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.829757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.829825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.829898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.829966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.830035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.830105] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.830172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.830240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.830308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.830383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.830457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.830529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.830602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.830674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.830747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.830819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.830892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.830967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.831040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.831111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.831183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.831253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.831329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.831404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.831480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.831552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.831623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.831692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.831762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.831829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.831905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.831975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.832046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.832114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.832187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.832257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.832328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.832398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.832469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.832539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.832608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.832680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.832750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.832820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.832892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.832962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.833030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.833098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.833169] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.833282] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.833286] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16947, lrc_seqno=16947, guc_id=0, flags=0x73 in no process [-1] <7> [235.833289] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.833345] ------------[ cut here ]------------ <4> [235.833347] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.833348] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:54/3530 <4> [235.833418] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.833492] autofs4 [last unloaded: snd_hda_intel] <4> [235.833496] CPU: 10 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.833499] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.833500] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.833501] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.833506] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.833574] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.833576] RSP: 0018:ffffc90005c17ca0 EFLAGS: 00010246 <4> [235.833578] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.833579] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.833581] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.833582] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.833583] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.833584] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [235.833586] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.833587] CR2: 00007a448c066108 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [235.833589] PKRU: 55555554 <4> [235.833590] Call Trace: <4> [235.833591] <TASK> <4> [235.833595] ? lock_acquire+0x20/0x2f0 <4> [235.833600] ? lock_release+0xd0/0x2b0 <4> [235.833605] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.833611] process_one_work+0x239/0x760 <4> [235.833617] worker_thread+0x200/0x3f0 <4> [235.833619] ? __pfx_worker_thread+0x10/0x10 <4> [235.833622] kthread+0x10d/0x150 <4> [235.833625] ? __pfx_kthread+0x10/0x10 <4> [235.833628] ret_from_fork+0x3d4/0x480 <4> [235.833630] ? __pfx_kthread+0x10/0x10 <4> [235.833634] ret_from_fork_asm+0x1a/0x30 <4> [235.833641] </TASK> <4> [235.833642] irq event stamp: 317325 <4> [235.833643] hardirqs last enabled at (317331): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.833646] hardirqs last disabled at (317336): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.833648] softirqs last enabled at (316352): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.833650] softirqs last disabled at (316347): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.833653] ---[ end trace 0000000000000000 ]--- <7> [235.834705] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.834805] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [235.865162] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16949, lrc_seqno=16949, guc_id=0, flags=0x73 in no process [-1] <7> [235.865166] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.865228] ------------[ cut here ]------------ <4> [235.865230] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.865231] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:54/3530 <4> [235.865298] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.865366] autofs4 [last unloaded: snd_hda_intel] <4> [235.865370] CPU: 10 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.865373] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.865374] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.865375] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.865381] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.865443] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.865445] RSP: 0018:ffffc90005c17ca0 EFLAGS: 00010246 <4> [235.865447] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.865448] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.865449] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.865450] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.865451] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.865453] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [235.865454] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.865455] CR2: 00007a448c066108 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [235.865457] PKRU: 55555554 <4> [235.865458] Call Trace: <4> [235.865459] <TASK> <4> [235.865462] ? lock_acquire+0x20/0x2f0 <4> [235.865467] ? lock_release+0xd0/0x2b0 <4> [235.865472] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.865477] process_one_work+0x239/0x760 <4> [235.865483] worker_thread+0x200/0x3f0 <4> [235.865485] ? __pfx_worker_thread+0x10/0x10 <4> [235.865487] kthread+0x10d/0x150 <4> [235.865490] ? __pfx_kthread+0x10/0x10 <4> [235.865493] ret_from_fork+0x3d4/0x480 <4> [235.865495] ? __pfx_kthread+0x10/0x10 <4> [235.865498] ret_from_fork_asm+0x1a/0x30 <4> [235.865505] </TASK> <4> [235.865506] irq event stamp: 318329 <4> [235.865507] hardirqs last enabled at (318335): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.865510] hardirqs last disabled at (318340): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.865512] softirqs last enabled at (317460): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.865514] softirqs last disabled at (317455): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.865516] ---[ end trace 0000000000000000 ]--- <6> [235.865518] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.865579] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.865585] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.865677] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.865881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.866076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.866217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.866337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.866456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.866578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.866702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.866823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.866936] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.867032] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.867145] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.868208] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.879245] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.879503] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.880650] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.880748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.880884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.881073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.881271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.881454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.881625] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.881800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.882003] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.882116] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.882215] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.882312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.882409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.882504] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.882598] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.882692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.882787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.882885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.883018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.883136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.883245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.883345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.883442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.883531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.883620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.883710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.883794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.883884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.884049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.884154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.884246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.884332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.884426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.884516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.884604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.884689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.884770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.884847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.884943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.885033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.885114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.885191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.885263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.885334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.885409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.885480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.885551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.885621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.885691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.885759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.885826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.885905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.885986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.886055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.886122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.886192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.886261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.886327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.886396] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.886512] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.886516] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16949, lrc_seqno=16949, guc_id=0, flags=0x73 in no process [-1] <7> [235.886519] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.886576] ------------[ cut here ]------------ <4> [235.886577] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.886578] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:16/3246 <4> [235.886646] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.886714] autofs4 [last unloaded: snd_hda_intel] <4> [235.886718] CPU: 8 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.886721] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.886722] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.886724] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.886729] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.886797] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.886799] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [235.886801] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.886803] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.886804] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.886805] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.886806] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.886808] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [235.886809] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.886811] CR2: 00007a4496a67000 CR3: 0000000115abe001 CR4: 0000000000f72ef0 <4> [235.886812] PKRU: 55555554 <4> [235.886813] Call Trace: <4> [235.886814] <TASK> <4> [235.886818] ? lock_acquire+0x20/0x2f0 <4> [235.886824] ? lock_release+0xd0/0x2b0 <4> [235.886830] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.886835] process_one_work+0x239/0x760 <4> [235.886842] worker_thread+0x200/0x3f0 <4> [235.886845] ? __pfx_worker_thread+0x10/0x10 <4> [235.886847] kthread+0x10d/0x150 <4> [235.886850] ? __pfx_kthread+0x10/0x10 <4> [235.886853] ret_from_fork+0x3d4/0x480 <4> [235.886855] ? __pfx_kthread+0x10/0x10 <4> [235.886859] ret_from_fork_asm+0x1a/0x30 <4> [235.886866] </TASK> <4> [235.886867] irq event stamp: 202861 <4> [235.886868] hardirqs last enabled at (202867): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.886871] hardirqs last disabled at (202872): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.886873] softirqs last enabled at (201784): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.886876] softirqs last disabled at (201775): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.886878] ---[ end trace 0000000000000000 ]--- <6> [235.886880] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.886971] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.886981] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.887250] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.887452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.887538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.887622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.887701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.887778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.887853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.887948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.888036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.888111] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.888201] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.888313] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.889325] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.899897] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.900145] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.901308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.901382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.901452] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.901523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.901592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.901660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.901729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.901797] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.901862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.901945] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.902020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.902086] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.902154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.902220] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.902285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.902350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.902414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.902478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.902544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.902619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.902694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.902766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.902839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.902919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.903007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.903080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.903151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.903224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.903297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.903368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.903438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.903509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.903583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.903656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.903731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.903803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.903872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.903956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.904038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.904106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.904175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.904243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.904311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.904377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.904446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.904511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.904576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.904640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.904707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.904771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.904836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.904913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.904992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.905060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.905127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.905194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.905260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.905325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.905394] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.905505] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.905509] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16949, lrc_seqno=16949, guc_id=0, flags=0x73 in no process [-1] <7> [235.905512] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.905568] ------------[ cut here ]------------ <4> [235.905570] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.905571] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:16/3246 <4> [235.905641] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.905705] autofs4 [last unloaded: snd_hda_intel] <4> [235.905709] CPU: 8 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.905712] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.905713] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.905715] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.905720] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.905786] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.905788] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [235.905790] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.905791] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.905792] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.905794] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.905795] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.905796] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [235.905798] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.905799] CR2: 00007a4496a67000 CR3: 0000000115abe001 CR4: 0000000000f72ef0 <4> [235.905801] PKRU: 55555554 <4> [235.905802] Call Trace: <4> [235.905803] <TASK> <4> [235.905807] ? lock_acquire+0x20/0x2f0 <4> [235.905812] ? lock_release+0xd0/0x2b0 <4> [235.905817] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.905823] process_one_work+0x239/0x760 <4> [235.905829] worker_thread+0x200/0x3f0 <4> [235.905832] ? __pfx_worker_thread+0x10/0x10 <4> [235.905834] kthread+0x10d/0x150 <4> [235.905837] ? __pfx_kthread+0x10/0x10 <4> [235.905841] ret_from_fork+0x3d4/0x480 <4> [235.905843] ? __pfx_kthread+0x10/0x10 <4> [235.905846] ret_from_fork_asm+0x1a/0x30 <4> [235.905853] </TASK> <4> [235.905854] irq event stamp: 205997 <4> [235.905855] hardirqs last enabled at (206003): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.905858] hardirqs last disabled at (206008): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.905860] softirqs last enabled at (205100): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.905863] softirqs last disabled at (205095): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.905865] ---[ end trace 0000000000000000 ]--- <7> [235.906915] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.907017] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [235.937630] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16951, lrc_seqno=16951, guc_id=0, flags=0x73 in no process [-1] <7> [235.937634] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.937704] ------------[ cut here ]------------ <4> [235.937706] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.937707] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:16/3246 <4> [235.937778] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.937845] autofs4 [last unloaded: snd_hda_intel] <4> [235.937849] CPU: 8 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.937852] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.937853] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.937854] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.937860] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.937946] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.937949] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [235.937953] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.937955] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.937958] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.937960] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.937962] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.937964] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [235.937968] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.937971] CR2: 00007a4496a67000 CR3: 0000000115abe001 CR4: 0000000000f72ef0 <4> [235.937975] PKRU: 55555554 <4> [235.937977] Call Trace: <4> [235.937980] <TASK> <4> [235.937989] ? lock_acquire+0x20/0x2f0 <4> [235.938000] ? lock_release+0xd0/0x2b0 <4> [235.938012] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.938024] process_one_work+0x239/0x760 <4> [235.938038] worker_thread+0x200/0x3f0 <4> [235.938045] ? __pfx_worker_thread+0x10/0x10 <4> [235.938050] kthread+0x10d/0x150 <4> [235.938055] ? __pfx_kthread+0x10/0x10 <4> [235.938063] ret_from_fork+0x3d4/0x480 <4> [235.938067] ? __pfx_kthread+0x10/0x10 <4> [235.938074] ret_from_fork_asm+0x1a/0x30 <4> [235.938092] </TASK> <4> [235.938094] irq event stamp: 207189 <4> [235.938096] hardirqs last enabled at (207195): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.938101] hardirqs last disabled at (207200): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.938105] softirqs last enabled at (207028): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.938109] softirqs last disabled at (207019): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.938112] ---[ end trace 0000000000000000 ]--- <6> [235.938115] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.938192] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.938198] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.938249] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.938457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.938547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.938637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.938723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.938805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.938883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.938980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.939059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.939134] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.939225] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.939337] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.940350] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.950893] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.951140] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.952178] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.952255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.952330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.952409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.952485] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.952561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.952636] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.952712] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.952787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.952864] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.952954] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.953030] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.953106] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.953184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.953260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.953335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.953411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.953488] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.953565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.953653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.953740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.953828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.953919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.954003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.954084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.954166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.954248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.954336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.954423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.954508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.954596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.954685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.954777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.954867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.954968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.955054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.955139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.955222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.955300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.955378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.955459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.955535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.955611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.955685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.955759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.955832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.955910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.955984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.956057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.956130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.956200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.956270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.956338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.956406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.956472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.956541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.956608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.956675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.956745] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.956859] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.956863] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16951, lrc_seqno=16951, guc_id=0, flags=0x73 in no process [-1] <7> [235.956865] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.956939] ------------[ cut here ]------------ <4> [235.956941] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.956942] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:54/3530 <4> [235.957011] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.957077] autofs4 [last unloaded: snd_hda_intel] <4> [235.957081] CPU: 10 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.957084] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.957086] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.957087] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.957092] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.957158] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.957160] RSP: 0018:ffffc90005c17ca0 EFLAGS: 00010246 <4> [235.957162] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.957164] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.957165] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.957166] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.957167] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.957169] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [235.957170] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.957172] CR2: 00007a448c066108 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [235.957173] PKRU: 55555554 <4> [235.957174] Call Trace: <4> [235.957175] <TASK> <4> [235.957179] ? lock_acquire+0x20/0x2f0 <4> [235.957185] ? lock_release+0xd0/0x2b0 <4> [235.957190] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.957196] process_one_work+0x239/0x760 <4> [235.957202] worker_thread+0x200/0x3f0 <4> [235.957205] ? __pfx_worker_thread+0x10/0x10 <4> [235.957207] kthread+0x10d/0x150 <4> [235.957210] ? __pfx_kthread+0x10/0x10 <4> [235.957214] ret_from_fork+0x3d4/0x480 <4> [235.957216] ? __pfx_kthread+0x10/0x10 <4> [235.957219] ret_from_fork_asm+0x1a/0x30 <4> [235.957226] </TASK> <4> [235.957228] irq event stamp: 322319 <4> [235.957229] hardirqs last enabled at (322325): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.957232] hardirqs last disabled at (322330): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.957234] softirqs last enabled at (321208): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.957236] softirqs last disabled at (321201): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.957239] ---[ end trace 0000000000000000 ]--- <6> [235.957240] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.957306] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.957312] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.958426] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.958540] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.958640] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.958843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.958950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.959043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.959126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.959208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.959286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.959364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.959442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.959514] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.959606] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.959716] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.960724] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.970905] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.971152] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.972206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.972295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.972367] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.972439] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.972509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.972578] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.972648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.972717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.972785] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.972853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.972937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.973015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.973082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.973149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.973216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.973286] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.973359] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.973426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.973493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.973568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.973642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.973712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.973783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.973852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.973942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.974026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.974095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.974166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.974236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.974307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.974377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.974446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.974522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.974596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.974670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.974741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.974811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.974877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.974965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.975048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.975121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.975191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.975260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.975328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.975396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.975462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.975527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.975593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.975659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.975724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.975789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.975857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.975944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.976037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.976109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.976181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.976247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.976313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.976384] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.976498] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.976502] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16951, lrc_seqno=16951, guc_id=0, flags=0x73 in no process [-1] <7> [235.976505] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.976562] ------------[ cut here ]------------ <4> [235.976564] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.976565] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:16/3246 <4> [235.976634] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.976699] autofs4 [last unloaded: snd_hda_intel] <4> [235.976703] CPU: 8 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [235.976706] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [235.976708] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.976709] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.976714] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.976779] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.976781] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [235.976783] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.976785] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [235.976786] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.976787] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.976789] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [235.976790] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [235.976792] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.976793] CR2: 00007a4496a67000 CR3: 0000000115abe001 CR4: 0000000000f72ef0 <4> [235.976794] PKRU: 55555554 <4> [235.976796] Call Trace: <4> [235.976797] <TASK> <4> [235.976801] ? lock_acquire+0x20/0x2f0 <4> [235.976806] ? lock_release+0xd0/0x2b0 <4> [235.976811] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.976817] process_one_work+0x239/0x760 <4> [235.976823] worker_thread+0x200/0x3f0 <4> [235.976826] ? __pfx_worker_thread+0x10/0x10 <4> [235.976828] kthread+0x10d/0x150 <4> [235.976831] ? __pfx_kthread+0x10/0x10 <4> [235.976835] ret_from_fork+0x3d4/0x480 <4> [235.976837] ? __pfx_kthread+0x10/0x10 <4> [235.976840] ret_from_fork_asm+0x1a/0x30 <4> [235.976848] </TASK> <4> [235.976849] irq event stamp: 210987 <4> [235.976850] hardirqs last enabled at (210993): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [235.976853] hardirqs last disabled at (210998): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [235.976855] softirqs last enabled at (210002): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.976857] softirqs last disabled at (209995): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.976860] ---[ end trace 0000000000000000 ]--- <7> [235.977912] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.978018] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [236.008579] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16953, lrc_seqno=16953, guc_id=0, flags=0x73 in no process [-1] <7> [236.008584] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.008654] ------------[ cut here ]------------ <4> [236.008655] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.008657] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:16/3246 <4> [236.008731] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.008801] autofs4 [last unloaded: snd_hda_intel] <4> [236.008805] CPU: 0 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.008808] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.008809] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.008811] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.008816] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.008895] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.008899] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [236.008903] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.008904] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.008906] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.008907] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.008908] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.008910] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [236.008911] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.008913] CR2: 00007a4496a66000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [236.008914] PKRU: 55555554 <4> [236.008915] Call Trace: <4> [236.008917] <TASK> <4> [236.008921] ? lock_acquire+0x20/0x2f0 <4> [236.008927] ? lock_release+0xd0/0x2b0 <4> [236.008933] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.008939] process_one_work+0x239/0x760 <4> [236.008946] worker_thread+0x200/0x3f0 <4> [236.008949] ? __pfx_worker_thread+0x10/0x10 <4> [236.008951] kthread+0x10d/0x150 <4> [236.008955] ? __pfx_kthread+0x10/0x10 <4> [236.008958] ret_from_fork+0x3d4/0x480 <4> [236.008961] ? __pfx_kthread+0x10/0x10 <4> [236.008965] ret_from_fork_asm+0x1a/0x30 <4> [236.008972] </TASK> <4> [236.008974] irq event stamp: 212149 <4> [236.008975] hardirqs last enabled at (212155): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.008979] hardirqs last disabled at (212160): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.008981] softirqs last enabled at (211132): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [236.008984] softirqs last disabled at (211130): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [236.008987] ---[ end trace 0000000000000000 ]--- <6> [236.008989] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.009059] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.009067] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.009117] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.009324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.009411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.009498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.009580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.009661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.009739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.009819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.009907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.009983] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.010073] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.010183] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.011195] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.021894] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.022142] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.023229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.023313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.023394] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.023478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.023561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.023645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.023728] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.023806] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.023890] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.023969] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.024046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.024124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.024201] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.024282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.024358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.024436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.024514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.024594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.024677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.024770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.024860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.024958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.025048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.025131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.025218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.025304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.025391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.025478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.025565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.025651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.025736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.025822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.025919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.026012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.026104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.026188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.026271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.026352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.026430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.026508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.026587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.026663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.026739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.026813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.026896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.026969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.027099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.027231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.027347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.027462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.027573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.027694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.027804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.027879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.027975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.028049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.028119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.028216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.028333] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.028490] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.028496] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16953, lrc_seqno=16953, guc_id=0, flags=0x73 in no process [-1] <7> [236.028500] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.028592] ------------[ cut here ]------------ <4> [236.028594] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.028596] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:54/3530 <4> [236.028699] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.028827] autofs4 [last unloaded: snd_hda_intel] <4> [236.028834] CPU: 8 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.028838] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.028841] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.028843] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.028852] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.028961] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.028963] RSP: 0018:ffffc90005c17ca0 EFLAGS: 00010246 <4> [236.028966] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.028968] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.028969] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.028971] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.028972] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.028974] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [236.028975] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.028977] CR2: 00007a4496a67000 CR3: 0000000115abe001 CR4: 0000000000f72ef0 <4> [236.028978] PKRU: 55555554 <4> [236.028980] Call Trace: <4> [236.028981] <TASK> <4> [236.028985] ? lock_acquire+0x20/0x2f0 <4> [236.028991] ? lock_release+0xd0/0x2b0 <4> [236.028997] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.029003] process_one_work+0x239/0x760 <4> [236.029010] worker_thread+0x200/0x3f0 <4> [236.029013] ? __pfx_worker_thread+0x10/0x10 <4> [236.029015] kthread+0x10d/0x150 <4> [236.029019] ? __pfx_kthread+0x10/0x10 <4> [236.029022] ret_from_fork+0x3d4/0x480 <4> [236.029025] ? __pfx_kthread+0x10/0x10 <4> [236.029030] ret_from_fork_asm+0x1a/0x30 <4> [236.029042] </TASK> <4> [236.029044] irq event stamp: 326385 <4> [236.029045] hardirqs last enabled at (326391): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.029048] hardirqs last disabled at (326396): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.029050] softirqs last enabled at (325506): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.029053] softirqs last disabled at (325481): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.029055] ---[ end trace 0000000000000000 ]--- <6> [236.029338] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.029492] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.029507] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.030241] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [236.030381] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [236.030527] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.030734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.030822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.030917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.031001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.031081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.031159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.031240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.031323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.031401] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.031493] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.031606] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.032613] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.042891] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.043141] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.044230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.044307] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.044378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.044449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.044518] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.044586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.044654] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.044722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.044792] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.044859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.044939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.045007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.045076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.045143] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.045211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.045279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.045347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.045415] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.045483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.045560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.045636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.045710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.045783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.045855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.045935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.046007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.046078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.046150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.046224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.046296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.046369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.046441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.046518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.046594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.046670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.046742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.046813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.046882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.046968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.047038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.047110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.047179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.047247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.047313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.047383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.047449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.047516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.047582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.047652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.047721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.047788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.047857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.047934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.048002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.048067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.048134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.048199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.048266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.048334] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.048450] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.048454] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16953, lrc_seqno=16953, guc_id=0, flags=0x73 in no process [-1] <7> [236.048457] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.048513] ------------[ cut here ]------------ <4> [236.048515] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.048516] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:54/3530 <4> [236.048584] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.048652] autofs4 [last unloaded: snd_hda_intel] <4> [236.048657] CPU: 4 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.048660] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.048661] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.048663] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.048668] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.048734] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.048736] RSP: 0018:ffffc90005c17ca0 EFLAGS: 00010246 <4> [236.048738] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.048739] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.048741] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.048742] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.048743] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.048745] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [236.048746] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.048748] CR2: 000076c648fd1000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [236.048749] PKRU: 55555554 <4> [236.048750] Call Trace: <4> [236.048751] <TASK> <4> [236.048756] ? lock_acquire+0x20/0x2f0 <4> [236.048762] ? lock_release+0xd0/0x2b0 <4> [236.048767] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.048773] process_one_work+0x239/0x760 <4> [236.048779] worker_thread+0x200/0x3f0 <4> [236.048782] ? __pfx_worker_thread+0x10/0x10 <4> [236.048784] kthread+0x10d/0x150 <4> [236.048787] ? __pfx_kthread+0x10/0x10 <4> [236.048791] ret_from_fork+0x3d4/0x480 <4> [236.048793] ? __pfx_kthread+0x10/0x10 <4> [236.048796] ret_from_fork_asm+0x1a/0x30 <4> [236.048804] </TASK> <4> [236.048805] irq event stamp: 329655 <4> [236.048806] hardirqs last enabled at (329661): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.048809] hardirqs last disabled at (329666): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.048811] softirqs last enabled at (328766): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.048814] softirqs last disabled at (328759): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.048816] ---[ end trace 0000000000000000 ]--- <7> [236.050234] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [236.050386] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [236.081244] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16955, lrc_seqno=16955, guc_id=0, flags=0x73 in no process [-1] <7> [236.081251] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.081366] ------------[ cut here ]------------ <4> [236.081368] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.081370] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#13: kworker/u64:16/3246 <4> [236.081487] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.081586] autofs4 [last unloaded: snd_hda_intel] <4> [236.081592] CPU: 13 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.081596] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.081598] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.081600] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.081608] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.081720] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.081723] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [236.081726] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.081728] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.081730] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.081732] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.081734] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.081736] FS: 0000000000000000(0000) GS:ffff8888db317000(0000) knlGS:0000000000000000 <4> [236.081738] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.081740] CR2: 0000583db42f0d78 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [236.081742] PKRU: 55555554 <4> [236.081744] Call Trace: <4> [236.081745] <TASK> <4> [236.081752] ? lock_acquire+0x20/0x2f0 <4> [236.081762] ? lock_release+0xd0/0x2b0 <4> [236.081770] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.081779] process_one_work+0x239/0x760 <4> [236.081790] worker_thread+0x200/0x3f0 <4> [236.081794] ? __pfx_worker_thread+0x10/0x10 <4> [236.081798] kthread+0x10d/0x150 <4> [236.081802] ? __pfx_kthread+0x10/0x10 <4> [236.081807] ret_from_fork+0x3d4/0x480 <4> [236.081810] ? __pfx_kthread+0x10/0x10 <4> [236.081815] ret_from_fork_asm+0x1a/0x30 <4> [236.081828] </TASK> <4> [236.081829] irq event stamp: 213959 <4> [236.081831] hardirqs last enabled at (213965): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.081835] hardirqs last disabled at (213970): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.081838] softirqs last enabled at (212978): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [236.081841] softirqs last disabled at (212976): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [236.081845] ---[ end trace 0000000000000000 ]--- <6> [236.081847] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.081972] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.081989] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.082041] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.082299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.082433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.082570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.082701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.082832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.083037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.083147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.083243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.083328] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.083425] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.083543] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.084561] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.094895] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.095155] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.096255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.096343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.096420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.096495] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.096568] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.096640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.096709] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.096781] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.096850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.096931] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.096999] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.097066] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.097132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.097198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.097266] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.097333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.097400] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.097467] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.097537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.097614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.097689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.097761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.097833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.097908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.097979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.098048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.098115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.098186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.098257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.098327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.098397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.098469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.098545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.098620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.098694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.098764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.098834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.098908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.098978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.099045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.099117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.099188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.099259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.099327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.099400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.099470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.099541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.099612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.099689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.099763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.099836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.099923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.099998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.100073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.100148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.100225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.100300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.100375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.100455] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.100584] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.100589] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16955, lrc_seqno=16955, guc_id=0, flags=0x73 in no process [-1] <7> [236.100592] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.100654] ------------[ cut here ]------------ <4> [236.100655] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.100657] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:16/3246 <4> [236.100732] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.100801] autofs4 [last unloaded: snd_hda_intel] <4> [236.100805] CPU: 2 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.100808] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.100809] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.100811] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.100816] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.100892] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.100894] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [236.100896] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.100898] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.100900] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.100901] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.100903] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.100904] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [236.100906] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.100908] CR2: 000074070bfff000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [236.100909] PKRU: 55555554 <4> [236.100911] Call Trace: <4> [236.100912] <TASK> <4> [236.100916] ? lock_acquire+0x20/0x2f0 <4> [236.100922] ? lock_release+0xd0/0x2b0 <4> [236.100928] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.100934] process_one_work+0x239/0x760 <4> [236.100940] worker_thread+0x200/0x3f0 <4> [236.100943] ? __pfx_worker_thread+0x10/0x10 <4> [236.100946] kthread+0x10d/0x150 <4> [236.100949] ? __pfx_kthread+0x10/0x10 <4> [236.100953] ret_from_fork+0x3d4/0x480 <4> [236.100955] ? __pfx_kthread+0x10/0x10 <4> [236.100959] ret_from_fork_asm+0x1a/0x30 <4> [236.100967] </TASK> <4> [236.100968] irq event stamp: 217107 <4> [236.100969] hardirqs last enabled at (217113): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.100972] hardirqs last disabled at (217118): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.100975] softirqs last enabled at (216208): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.100978] softirqs last disabled at (216201): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.100980] ---[ end trace 0000000000000000 ]--- <6> [236.100982] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.101052] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.101058] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.102175] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [236.102276] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [236.102377] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.102588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.102678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.102769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.102852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.102946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.103027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.103107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.103189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.103264] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.103356] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.103469] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.104475] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.115193] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.115442] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.116516] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.116589] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.116660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.116731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.116802] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.116871] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.116956] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.117028] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.117098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.117169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.117237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.117306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.117375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.117443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.117511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.117577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.117646] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.117713] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.117779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.117855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.117939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.118011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.118083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.118153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.118223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.118293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.118361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.118435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.118507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.118576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.118646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.118718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.118794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.118870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.118958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.119029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.119099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.119169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.119238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.119307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.119378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.119449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.119519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.119588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.119661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.119732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.119802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.119871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.119954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.120025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.120095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.120169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.120242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.120315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.120384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.120454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.120522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.120590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.120663] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.120777] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.120781] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16955, lrc_seqno=16955, guc_id=0, flags=0x73 in no process [-1] <7> [236.120784] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.120841] ------------[ cut here ]------------ <4> [236.120843] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.120844] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:81/3557 <4> [236.120922] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.120988] autofs4 [last unloaded: snd_hda_intel] <4> [236.120992] CPU: 10 UID: 0 PID: 3557 Comm: kworker/u64:81 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.120995] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.120996] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.120997] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.121002] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.121068] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.121070] RSP: 0018:ffffc90001a1bca0 EFLAGS: 00010246 <4> [236.121072] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.121073] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.121075] RBP: ffffc90001a1bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.121076] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.121077] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.121079] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [236.121080] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.121082] CR2: 00007a448c066108 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [236.121083] PKRU: 55555554 <4> [236.121084] Call Trace: <4> [236.121085] <TASK> <4> [236.121090] ? lock_acquire+0x20/0x2f0 <4> [236.121095] ? lock_release+0xd0/0x2b0 <4> [236.121100] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.121106] process_one_work+0x239/0x760 <4> [236.121112] worker_thread+0x200/0x3f0 <4> [236.121115] ? __pfx_worker_thread+0x10/0x10 <4> [236.121117] kthread+0x10d/0x150 <4> [236.121120] ? __pfx_kthread+0x10/0x10 <4> [236.121124] ret_from_fork+0x3d4/0x480 <4> [236.121126] ? __pfx_kthread+0x10/0x10 <4> [236.121129] ret_from_fork_asm+0x1a/0x30 <4> [236.121136] </TASK> <4> [236.121137] irq event stamp: 292061 <4> [236.121139] hardirqs last enabled at (292067): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.121141] hardirqs last disabled at (292072): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.121144] softirqs last enabled at (291144): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.121146] softirqs last disabled at (291137): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.121148] ---[ end trace 0000000000000000 ]--- <7> [236.122196] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [236.122296] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [236.153043] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16957, lrc_seqno=16957, guc_id=0, flags=0x73 in no process [-1] <7> [236.153046] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.153113] ------------[ cut here ]------------ <4> [236.153114] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.153115] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:81/3557 <4> [236.153182] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.153253] autofs4 [last unloaded: snd_hda_intel] <4> [236.153257] CPU: 10 UID: 0 PID: 3557 Comm: kworker/u64:81 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.153260] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.153262] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.153263] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.153270] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.153331] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.153332] RSP: 0018:ffffc90001a1bca0 EFLAGS: 00010246 <4> [236.153334] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.153335] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.153337] RBP: ffffc90001a1bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.153338] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.153339] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.153340] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [236.153342] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.153343] CR2: 00007a448c066108 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [236.153344] PKRU: 55555554 <4> [236.153345] Call Trace: <4> [236.153346] <TASK> <4> [236.153350] ? lock_acquire+0x20/0x2f0 <4> [236.153356] ? lock_release+0xd0/0x2b0 <4> [236.153361] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.153366] process_one_work+0x239/0x760 <4> [236.153372] worker_thread+0x200/0x3f0 <4> [236.153374] ? __pfx_worker_thread+0x10/0x10 <4> [236.153376] kthread+0x10d/0x150 <4> [236.153379] ? __pfx_kthread+0x10/0x10 <4> [236.153382] ret_from_fork+0x3d4/0x480 <4> [236.153385] ? __pfx_kthread+0x10/0x10 <4> [236.153388] ret_from_fork_asm+0x1a/0x30 <4> [236.153395] </TASK> <4> [236.153396] irq event stamp: 293207 <4> [236.153397] hardirqs last enabled at (293213): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.153399] hardirqs last disabled at (293218): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.153401] softirqs last enabled at (292226): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [236.153403] softirqs last disabled at (292224): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [236.153406] ---[ end trace 0000000000000000 ]--- <6> [236.153408] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.153468] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.153476] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.153531] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.153793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.153940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.154082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.154216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.154348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.154482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.154614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.154747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.154876] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.155024] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.155190] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.156549] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.166892] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.167222] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.168511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.168670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.168831] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.169003] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.169169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.169332] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.169495] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.169658] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.169820] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.169989] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.170154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.170317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.170480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.170643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.170812] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.170993] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.171165] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.171327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.171490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.171660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.171830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.172006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.172176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.172337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.172492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.172646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.172798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.172956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.173112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.173261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.173404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.173546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.173694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.173836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.173983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.174125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.174258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.174385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.174512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.174636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.174762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.174890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.175015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.175137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.175264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.175387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.175510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.175632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.175756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.175877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.176003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.176134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.176259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.176383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.176506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.176631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.176753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.176875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.177011] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.177179] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.177186] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16957, lrc_seqno=16957, guc_id=0, flags=0x73 in no process [-1] <7> [236.177190] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.177291] ------------[ cut here ]------------ <4> [236.177293] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.177295] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:11/3206 <4> [236.177408] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.177505] autofs4 [last unloaded: snd_hda_intel] <4> [236.177511] CPU: 12 UID: 0 PID: 3206 Comm: kworker/u64:11 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.177515] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.177517] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.177519] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.177527] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.177637] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.177640] RSP: 0018:ffffc90004707ca0 EFLAGS: 00010246 <4> [236.177643] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.177645] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.177647] RBP: ffffc90004707db0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.177649] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.177651] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.177653] FS: 0000000000000000(0000) GS:ffff8888db297000(0000) knlGS:0000000000000000 <4> [236.177655] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.177657] CR2: 00007a448c065358 CR3: 000000011d2b5003 CR4: 0000000000f72ef0 <4> [236.177659] PKRU: 55555554 <4> [236.177661] Call Trace: <4> [236.177662] <TASK> <4> [236.177669] ? lock_acquire+0x20/0x2f0 <4> [236.177678] ? lock_release+0xd0/0x2b0 <4> [236.177687] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.177696] process_one_work+0x239/0x760 <4> [236.177707] worker_thread+0x200/0x3f0 <4> [236.177711] ? __pfx_worker_thread+0x10/0x10 <4> [236.177714] kthread+0x10d/0x150 <4> [236.177718] ? __pfx_kthread+0x10/0x10 <4> [236.177724] ret_from_fork+0x3d4/0x480 <4> [236.177727] ? __pfx_kthread+0x10/0x10 <4> [236.177731] ret_from_fork_asm+0x1a/0x30 <4> [236.177744] </TASK> <4> [236.177746] irq event stamp: 620529 <4> [236.177747] hardirqs last enabled at (620535): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.177751] hardirqs last disabled at (620540): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.177755] softirqs last enabled at (619678): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.177758] softirqs last disabled at (619665): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.177761] ---[ end trace 0000000000000000 ]--- <6> [236.177764] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.177876] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.177891] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.178174] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.178426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.178556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.178690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.178820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.178957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.179087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.179218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.179350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.179477] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.179617] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.179780] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.181185] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.192236] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.192543] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.194446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.194525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.194600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.194675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.194749] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.194821] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.194904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.194977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.195050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.195123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.195196] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.195269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.195341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.195416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.195487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.195558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.195628] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.195697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.195767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.195845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.195937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.196010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.196085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.196156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.196227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.196297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.196368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.196443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.196516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.196588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.196661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.196734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.196811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.196893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.196973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.197048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.197120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.197190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.197261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.197331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.197403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.197473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.197544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.197614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.197689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.197760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.197831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.197907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.197978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.198047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.198115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.198186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.198255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.198325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.198392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.198463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.198533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.198600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.198671] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.198786] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.198791] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16957, lrc_seqno=16957, guc_id=0, flags=0x73 in no process [-1] <7> [236.198793] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.198852] ------------[ cut here ]------------ <4> [236.198853] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.198854] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:11/3206 <4> [236.198932] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.198998] autofs4 [last unloaded: snd_hda_intel] <4> [236.199002] CPU: 10 UID: 0 PID: 3206 Comm: kworker/u64:11 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.199005] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.199007] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.199008] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.199013] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.199079] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.199080] RSP: 0018:ffffc90004707ca0 EFLAGS: 00010246 <4> [236.199083] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.199084] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.199085] RBP: ffffc90004707db0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.199087] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.199088] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.199089] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [236.199091] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.199092] CR2: 00007a448c066108 CR3: 000000011d2b5004 CR4: 0000000000f72ef0 <4> [236.199093] PKRU: 55555554 <4> [236.199095] Call Trace: <4> [236.199096] <TASK> <4> [236.199099] ? lock_acquire+0x20/0x2f0 <4> [236.199105] ? lock_release+0xd0/0x2b0 <4> [236.199110] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.199115] process_one_work+0x239/0x760 <4> [236.199122] worker_thread+0x200/0x3f0 <4> [236.199124] ? __pfx_worker_thread+0x10/0x10 <4> [236.199127] kthread+0x10d/0x150 <4> [236.199129] ? __pfx_kthread+0x10/0x10 <4> [236.199133] ret_from_fork+0x3d4/0x480 <4> [236.199135] ? __pfx_kthread+0x10/0x10 <4> [236.199138] ret_from_fork_asm+0x1a/0x30 <4> [236.199146] </TASK> <4> [236.199147] irq event stamp: 623759 <4> [236.199148] hardirqs last enabled at (623765): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.199151] hardirqs last disabled at (623770): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.199153] softirqs last enabled at (623016): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.199155] softirqs last disabled at (623011): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.199157] ---[ end trace 0000000000000000 ]--- <7> [236.200207] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [236.200311] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [236.230650] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16959, lrc_seqno=16959, guc_id=0, flags=0x73 in no process [-1] <7> [236.230655] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.230724] ------------[ cut here ]------------ <4> [236.230725] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.230727] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:16/3246 <4> [236.230800] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.230868] autofs4 [last unloaded: snd_hda_intel] <4> [236.230872] CPU: 2 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.230875] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.230877] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.230885] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.230891] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.230960] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.230962] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [236.230965] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.230967] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.230968] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.230970] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.230971] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.230973] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [236.230975] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.230977] CR2: 000074070bfff000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [236.230978] PKRU: 55555554 <4> [236.230980] Call Trace: <4> [236.230981] <TASK> <4> [236.230985] ? lock_acquire+0x20/0x2f0 <4> [236.230992] ? lock_release+0xd0/0x2b0 <4> [236.230997] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.231003] process_one_work+0x239/0x760 <4> [236.231010] worker_thread+0x200/0x3f0 <4> [236.231013] ? __pfx_worker_thread+0x10/0x10 <4> [236.231016] kthread+0x10d/0x150 <4> [236.231019] ? __pfx_kthread+0x10/0x10 <4> [236.231023] ret_from_fork+0x3d4/0x480 <4> [236.231025] ? __pfx_kthread+0x10/0x10 <4> [236.231029] ret_from_fork_asm+0x1a/0x30 <4> [236.231036] </TASK> <4> [236.231038] irq event stamp: 219645 <4> [236.231039] hardirqs last enabled at (219651): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.231042] hardirqs last disabled at (219656): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.231045] softirqs last enabled at (219470): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.231048] softirqs last disabled at (219465): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.231050] ---[ end trace 0000000000000000 ]--- <6> [236.231053] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.231122] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.231128] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.231177] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.231382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.231466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.231552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.231630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.231708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.231783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.231860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.231947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.232022] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.232112] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.232222] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.233229] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.243895] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.244147] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.245285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.245375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.245464] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.245552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.245639] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.245734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.245824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.245927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.246016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.246102] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.246189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.246278] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.246369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.246459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.246549] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.246639] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.246732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.246822] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.246926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.247030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.247131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.247229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.247328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.247422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.247512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.247604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.247696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.247792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.247889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.247980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.248071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.248161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.248255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.248345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.248435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.248520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.248604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.248687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.248766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.248844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.248937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.249023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.249103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.249182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.249263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.249340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.249416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.249488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.249562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.249636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.249707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.249782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.249853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.249934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.250005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.250076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.250145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.250213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.250286] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.250398] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.250402] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16959, lrc_seqno=16959, guc_id=0, flags=0x73 in no process [-1] <7> [236.250405] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.250464] ------------[ cut here ]------------ <4> [236.250465] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.250466] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:11/3206 <4> [236.250536] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.250603] autofs4 [last unloaded: snd_hda_intel] <4> [236.250607] CPU: 10 UID: 0 PID: 3206 Comm: kworker/u64:11 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.250610] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.250611] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.250612] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.250617] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.250682] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.250684] RSP: 0018:ffffc90004707ca0 EFLAGS: 00010246 <4> [236.250686] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.250688] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.250689] RBP: ffffc90004707db0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.250690] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.250691] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.250693] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [236.250694] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.250696] CR2: 00007a448c066108 CR3: 0000000115abe002 CR4: 0000000000f72ef0 <4> [236.250697] PKRU: 55555554 <4> [236.250698] Call Trace: <4> [236.250700] <TASK> <4> [236.250703] ? lock_acquire+0x20/0x2f0 <4> [236.250709] ? lock_release+0xd0/0x2b0 <4> [236.250715] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.250720] process_one_work+0x239/0x760 <4> [236.250727] worker_thread+0x200/0x3f0 <4> [236.250729] ? __pfx_worker_thread+0x10/0x10 <4> [236.250732] kthread+0x10d/0x150 <4> [236.250735] ? __pfx_kthread+0x10/0x10 <4> [236.250739] ret_from_fork+0x3d4/0x480 <4> [236.250741] ? __pfx_kthread+0x10/0x10 <4> [236.250744] ret_from_fork_asm+0x1a/0x30 <4> [236.250752] </TASK> <4> [236.250753] irq event stamp: 627037 <4> [236.250754] hardirqs last enabled at (627043): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.250757] hardirqs last disabled at (627048): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.250759] softirqs last enabled at (625808): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.250762] softirqs last disabled at (625803): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.250764] ---[ end trace 0000000000000000 ]--- <6> [236.250766] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.250831] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.250838] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.251107] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.251306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.251386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.251469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.251547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.251624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.251699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.251776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.251855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.251940] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.252029] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.252142] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.253145] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.263864] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.264127] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.265292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.265368] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.265439] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.265510] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.265579] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.265649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.265717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.265785] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.265855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.265933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.266000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.266067] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.266136] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.266204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.266271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.266338] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.266406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.266473] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.266542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.266620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.266696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.266769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.266846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.266928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.267003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.267074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.267144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.267216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.267288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.267360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.267431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.267503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.267580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.267659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.267735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.267808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.267885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.267955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.268025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.268094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.268168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.268242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.268315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.268385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.268458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.268527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.268597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.268664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.268734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.268803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.268873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.268961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.269034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.269105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.269174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.269243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.269311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.269378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.269448] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.269561] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.269565] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16959, lrc_seqno=16959, guc_id=0, flags=0x73 in no process [-1] <7> [236.269568] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.269625] ------------[ cut here ]------------ <4> [236.269626] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.269627] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:11/3206 <4> [236.269696] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.269769] autofs4 [last unloaded: snd_hda_intel] <4> [236.269773] CPU: 10 UID: 0 PID: 3206 Comm: kworker/u64:11 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.269776] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.269778] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.269779] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.269784] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.269851] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.269853] RSP: 0018:ffffc90004707ca0 EFLAGS: 00010246 <4> [236.269855] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.269856] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.269858] RBP: ffffc90004707db0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.269859] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.269860] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.269861] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [236.269863] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.269864] CR2: 00007a448c066108 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [236.269866] PKRU: 55555554 <4> [236.269867] Call Trace: <4> [236.269868] <TASK> <4> [236.269872] ? lock_acquire+0x20/0x2f0 <4> [236.269877] ? lock_release+0xd0/0x2b0 <4> [236.269885] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.269891] process_one_work+0x239/0x760 <4> [236.269897] worker_thread+0x200/0x3f0 <4> [236.269900] ? __pfx_worker_thread+0x10/0x10 <4> [236.269903] kthread+0x10d/0x150 <4> [236.269906] ? __pfx_kthread+0x10/0x10 <4> [236.269909] ret_from_fork+0x3d4/0x480 <4> [236.269911] ? __pfx_kthread+0x10/0x10 <4> [236.269915] ret_from_fork_asm+0x1a/0x30 <4> [236.269922] </TASK> <4> [236.269924] irq event stamp: 630177 <4> [236.269925] hardirqs last enabled at (630183): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.269928] hardirqs last disabled at (630188): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.269930] softirqs last enabled at (629278): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.269932] softirqs last disabled at (629273): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.269935] ---[ end trace 0000000000000000 ]--- <7> [236.270942] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [236.271046] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [236.302243] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16961, lrc_seqno=16961, guc_id=0, flags=0x73 in no process [-1] <7> [236.302248] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.302320] ------------[ cut here ]------------ <4> [236.302321] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.302323] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#1: kworker/u64:11/3206 <4> [236.302397] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.302465] autofs4 [last unloaded: snd_hda_intel] <4> [236.302469] CPU: 1 UID: 0 PID: 3206 Comm: kworker/u64:11 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.302472] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.302473] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.302475] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.302481] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.302549] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.302551] RSP: 0018:ffffc90004707ca0 EFLAGS: 00010246 <4> [236.302554] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.302555] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.302556] RBP: ffffc90004707db0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.302558] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.302559] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.302560] FS: 0000000000000000(0000) GS:ffff8888dad17000(0000) knlGS:0000000000000000 <4> [236.302562] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.302563] CR2: 000076c648fd1000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [236.302565] PKRU: 55555554 <4> [236.302566] Call Trace: <4> [236.302567] <TASK> <4> [236.302571] ? lock_acquire+0x20/0x2f0 <4> [236.302577] ? lock_release+0xd0/0x2b0 <4> [236.302583] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.302588] process_one_work+0x239/0x760 <4> [236.302595] worker_thread+0x200/0x3f0 <4> [236.302598] ? __pfx_worker_thread+0x10/0x10 <4> [236.302600] kthread+0x10d/0x150 <4> [236.302603] ? __pfx_kthread+0x10/0x10 <4> [236.302606] ret_from_fork+0x3d4/0x480 <4> [236.302609] ? __pfx_kthread+0x10/0x10 <4> [236.302612] ret_from_fork_asm+0x1a/0x30 <4> [236.302619] </TASK> <4> [236.302621] irq event stamp: 631149 <4> [236.302622] hardirqs last enabled at (631155): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.302625] hardirqs last disabled at (631160): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.302627] softirqs last enabled at (629278): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.302629] softirqs last disabled at (629273): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.302632] ---[ end trace 0000000000000000 ]--- <6> [236.302634] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.302702] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.302710] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.302802] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.303031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.303127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.303221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.303307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.303391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.303474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.303555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.303639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.303717] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.303813] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.303934] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.304960] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.315685] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.315943] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.317047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.317141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.317227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.317312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.317396] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.317478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.317561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.317644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.317729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.317812] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.317904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.317993] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.318079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.318164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.318250] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.318335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.318421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.318509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.318596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.318699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.318797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.318894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.318992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.319084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.319175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.319267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.319359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.319455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.319554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.319652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.319751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.319850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.319966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.320070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.320175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.320278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.320382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.320487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.320595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.320699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.320806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.320917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.321023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.321124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.321234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.321339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.321443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.321547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.321659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.321767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.321875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.322010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.322121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.322230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.322342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.322457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.322567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.322675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.322788] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.322957] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.322964] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16961, lrc_seqno=16961, guc_id=0, flags=0x73 in no process [-1] <7> [236.322969] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.323060] ------------[ cut here ]------------ <4> [236.323063] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.323065] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:16/3246 <4> [236.323175] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.323275] autofs4 [last unloaded: snd_hda_intel] <4> [236.323281] CPU: 6 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.323286] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.323287] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.323290] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.323297] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.323399] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.323402] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [236.323405] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.323407] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.323409] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.323411] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.323413] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.323415] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [236.323417] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.323419] CR2: 00007a448c067348 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [236.323421] PKRU: 55555554 <4> [236.323423] Call Trace: <4> [236.323425] <TASK> <4> [236.323430] ? lock_acquire+0x20/0x2f0 <4> [236.323439] ? lock_release+0xd0/0x2b0 <4> [236.323447] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.323455] process_one_work+0x239/0x760 <4> [236.323464] worker_thread+0x200/0x3f0 <4> [236.323468] ? __pfx_worker_thread+0x10/0x10 <4> [236.323471] kthread+0x10d/0x150 <4> [236.323476] ? __pfx_kthread+0x10/0x10 <4> [236.323481] ret_from_fork+0x3d4/0x480 <4> [236.323484] ? __pfx_kthread+0x10/0x10 <4> [236.323489] ret_from_fork_asm+0x1a/0x30 <4> [236.323499] </TASK> <4> [236.323501] irq event stamp: 223869 <4> [236.323503] hardirqs last enabled at (223875): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.323507] hardirqs last disabled at (223880): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.323510] softirqs last enabled at (222970): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.323513] softirqs last disabled at (222963): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.323516] ---[ end trace 0000000000000000 ]--- <6> [236.323519] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.323617] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.323626] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.324829] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [236.324976] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [236.325468] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.325699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.325798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.325909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.326001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.326090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.326176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.326261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.326345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.326424] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.326518] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.326636] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.327658] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.337883] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.338156] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.339334] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.339408] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.339478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.339550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.339622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.339692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.339760] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.339829] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.339908] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.339979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.340048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.340117] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.340187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.340256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.340326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.340395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.340463] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.340531] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.340599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.340675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.340751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.340825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.340901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.340973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.341045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.341116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.341186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.341259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.341333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.341404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.341474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.341544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.341618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.341692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.341767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.341839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.341919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.341989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.342059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.342127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.342197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.342268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.342339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.342406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.342478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.342547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.342616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.342684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.342754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.342824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.342893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.342964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.343031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.343098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.343167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.343239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.343307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.343376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.343448] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.343565] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.343570] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16961, lrc_seqno=16961, guc_id=0, flags=0x73 in no process [-1] <7> [236.343572] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.343630] ------------[ cut here ]------------ <4> [236.343631] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.343633] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:54/3530 <4> [236.343701] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.343766] autofs4 [last unloaded: snd_hda_intel] <4> [236.343770] CPU: 8 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.343773] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.343774] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.343776] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.343781] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.343846] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.343848] RSP: 0018:ffffc90005c17ca0 EFLAGS: 00010246 <4> [236.343851] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.343852] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.343853] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.343855] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.343856] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.343857] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [236.343859] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.343860] CR2: 00007a4496a67000 CR3: 0000000115abe001 CR4: 0000000000f72ef0 <4> [236.343862] PKRU: 55555554 <4> [236.343863] Call Trace: <4> [236.343864] <TASK> <4> [236.343868] ? lock_acquire+0x20/0x2f0 <4> [236.343873] ? lock_release+0xd0/0x2b0 <4> [236.343882] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.343888] process_one_work+0x239/0x760 <4> [236.343895] worker_thread+0x200/0x3f0 <4> [236.343897] ? __pfx_worker_thread+0x10/0x10 <4> [236.343900] kthread+0x10d/0x150 <4> [236.343903] ? __pfx_kthread+0x10/0x10 <4> [236.343907] ret_from_fork+0x3d4/0x480 <4> [236.343909] ? __pfx_kthread+0x10/0x10 <4> [236.343912] ret_from_fork_asm+0x1a/0x30 <4> [236.343920] </TASK> <4> [236.343921] irq event stamp: 333601 <4> [236.343922] hardirqs last enabled at (333607): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.343925] hardirqs last disabled at (333612): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.343927] softirqs last enabled at (332490): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.343930] softirqs last disabled at (332483): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.343932] ---[ end trace 0000000000000000 ]--- <7> [236.344995] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [236.345098] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [236.374839] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16963, lrc_seqno=16963, guc_id=0, flags=0x73 in no process [-1] <7> [236.374845] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.374941] ------------[ cut here ]------------ <4> [236.374944] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.374946] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:54/3530 <4> [236.375020] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.375090] autofs4 [last unloaded: snd_hda_intel] <4> [236.375095] CPU: 11 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.375098] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.375100] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.375101] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.375108] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.375171] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.375173] RSP: 0018:ffffc90005c17ca0 EFLAGS: 00010246 <4> [236.375175] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.375177] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.375178] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.375180] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.375181] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.375182] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [236.375184] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.375186] CR2: 00007407109f2000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [236.375187] PKRU: 55555554 <4> [236.375188] Call Trace: <4> [236.375190] <TASK> <4> [236.375194] ? lock_acquire+0x20/0x2f0 <4> [236.375200] ? lock_release+0xd0/0x2b0 <4> [236.375205] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.375210] process_one_work+0x239/0x760 <4> [236.375216] worker_thread+0x200/0x3f0 <4> [236.375219] ? __pfx_worker_thread+0x10/0x10 <4> [236.375221] kthread+0x10d/0x150 <4> [236.375224] ? __pfx_kthread+0x10/0x10 <4> [236.375228] ret_from_fork+0x3d4/0x480 <4> [236.375230] ? __pfx_kthread+0x10/0x10 <4> [236.375233] ret_from_fork_asm+0x1a/0x30 <4> [236.375240] </TASK> <4> [236.375241] irq event stamp: 334765 <4> [236.375243] hardirqs last enabled at (334771): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.375246] hardirqs last disabled at (334776): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.375248] softirqs last enabled at (334004): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.375250] softirqs last disabled at (333995): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.375252] ---[ end trace 0000000000000000 ]--- <6> [236.375254] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.375316] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.375324] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.375378] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.375621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.375739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.375859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.376016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.376127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.376235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.376346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.376461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.376570] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.376690] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.376831] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.377989] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.387884] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.388135] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.389287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.389412] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.389536] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.389663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.389782] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.389910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.390040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.390159] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.390276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.390387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.390498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.390609] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.390718] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.390832] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.390961] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.391067] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.391173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.391276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.391377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.391490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.391597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.391700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.391805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.391922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.392005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.392076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.392142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.392208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.392274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.392340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.392406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.392472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.392542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.392610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.392679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.392744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.392809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.392874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.392958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.393026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.393098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.393164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.393225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.393285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.393351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.393411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.393471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.393530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.393594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.393655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.393716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.393779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.393841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.393913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.393981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.394048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.394114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.394174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.394239] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.394346] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.394350] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16963, lrc_seqno=16963, guc_id=0, flags=0x73 in no process [-1] <7> [236.394352] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.394410] ------------[ cut here ]------------ <4> [236.394411] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.394413] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:81/3557 <4> [236.394480] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.394549] autofs4 [last unloaded: snd_hda_intel] <4> [236.394553] CPU: 8 UID: 0 PID: 3557 Comm: kworker/u64:81 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.394556] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.394557] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.394558] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.394564] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.394630] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.394632] RSP: 0018:ffffc90001a1bca0 EFLAGS: 00010246 <4> [236.394635] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.394636] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.394637] RBP: ffffc90001a1bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.394639] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.394640] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.394641] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [236.394643] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.394644] CR2: 00007a4496a67000 CR3: 0000000115abe001 CR4: 0000000000f72ef0 <4> [236.394646] PKRU: 55555554 <4> [236.394647] Call Trace: <4> [236.394648] <TASK> <4> [236.394652] ? lock_acquire+0x20/0x2f0 <4> [236.394658] ? lock_release+0xd0/0x2b0 <4> [236.394663] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.394669] process_one_work+0x239/0x760 <4> [236.394676] worker_thread+0x200/0x3f0 <4> [236.394678] ? __pfx_worker_thread+0x10/0x10 <4> [236.394681] kthread+0x10d/0x150 <4> [236.394684] ? __pfx_kthread+0x10/0x10 <4> [236.394687] ret_from_fork+0x3d4/0x480 <4> [236.394690] ? __pfx_kthread+0x10/0x10 <4> [236.394693] ret_from_fork_asm+0x1a/0x30 <4> [236.394701] </TASK> <4> [236.394702] irq event stamp: 298579 <4> [236.394704] hardirqs last enabled at (298585): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.394707] hardirqs last disabled at (298590): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.394709] softirqs last enabled at (297698): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.394711] softirqs last disabled at (297687): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.394714] ---[ end trace 0000000000000000 ]--- <6> [236.394715] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.394783] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.394790] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.395914] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [236.396015] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [236.396147] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.396369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.396466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.396562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.396648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.396731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.396815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.396904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.396991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.397069] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.397166] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.397283] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.398296] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.408883] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.409137] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.410312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.410433] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.410545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.410654] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.410763] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.410871] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.411021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.411136] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.411248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.411355] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.411460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.411566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.411672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.411778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.411890] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.411995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.412105] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.412216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.412322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.412438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.412554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.412667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.412782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.412902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.413014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.413122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.413230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.413342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.413455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.413565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.413679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.413790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.413919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.414036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.414155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.414274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.414389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.414503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.414616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.414724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.414837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.414969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.415080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.415193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.415307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.415417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.415527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.415636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.415752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.415860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.416003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.416116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.416224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.416333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.416441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.416550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.416657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.416765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.416882] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.417042] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.417050] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16963, lrc_seqno=16963, guc_id=0, flags=0x73 in no process [-1] <7> [236.417054] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.417143] ------------[ cut here ]------------ <4> [236.417145] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.417148] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:16/3246 <4> [236.417254] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.417386] autofs4 [last unloaded: snd_hda_intel] <4> [236.417393] CPU: 0 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.417398] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.417401] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.417403] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.417412] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.417514] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.417517] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [236.417521] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.417524] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.417527] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.417530] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.417532] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.417535] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [236.417538] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.417541] CR2: 00007a4496a6f000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [236.417544] PKRU: 55555554 <4> [236.417546] Call Trace: <4> [236.417548] <TASK> <4> [236.417556] ? lock_acquire+0x20/0x2f0 <4> [236.417566] ? lock_release+0xd0/0x2b0 <4> [236.417576] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.417586] process_one_work+0x239/0x760 <4> [236.417599] worker_thread+0x200/0x3f0 <4> [236.417604] ? __pfx_worker_thread+0x10/0x10 <4> [236.417608] kthread+0x10d/0x150 <4> [236.417613] ? __pfx_kthread+0x10/0x10 <4> [236.417620] ret_from_fork+0x3d4/0x480 <4> [236.417623] ? __pfx_kthread+0x10/0x10 <4> [236.417629] ret_from_fork_asm+0x1a/0x30 <4> [236.417644] </TASK> <4> [236.417646] irq event stamp: 227067 <4> [236.417648] hardirqs last enabled at (227073): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.417653] hardirqs last disabled at (227078): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.417657] softirqs last enabled at (226162): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.417661] softirqs last disabled at (226151): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.417665] ---[ end trace 0000000000000000 ]--- <7> [236.418940] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [236.419087] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [236.449447] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16965, lrc_seqno=16965, guc_id=0, flags=0x73 in no process [-1] <7> [236.449451] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.449519] ------------[ cut here ]------------ <4> [236.449521] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.449522] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:81/3557 <4> [236.449594] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.449664] autofs4 [last unloaded: snd_hda_intel] <4> [236.449668] CPU: 8 UID: 0 PID: 3557 Comm: kworker/u64:81 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.449671] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.449673] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.449674] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.449680] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.449748] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.449750] RSP: 0018:ffffc90001a1bca0 EFLAGS: 00010246 <4> [236.449752] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.449753] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.449755] RBP: ffffc90001a1bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.449756] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.449757] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.449759] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [236.449760] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.449762] CR2: 00007a4496a67000 CR3: 0000000115abe001 CR4: 0000000000f72ef0 <4> [236.449763] PKRU: 55555554 <4> [236.449764] Call Trace: <4> [236.449765] <TASK> <4> [236.449769] ? lock_acquire+0x20/0x2f0 <4> [236.449776] ? lock_release+0xd0/0x2b0 <4> [236.449781] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.449787] process_one_work+0x239/0x760 <4> [236.449794] worker_thread+0x200/0x3f0 <4> [236.449796] ? __pfx_worker_thread+0x10/0x10 <4> [236.449799] kthread+0x10d/0x150 <4> [236.449802] ? __pfx_kthread+0x10/0x10 <4> [236.449805] ret_from_fork+0x3d4/0x480 <4> [236.449808] ? __pfx_kthread+0x10/0x10 <4> [236.449811] ret_from_fork_asm+0x1a/0x30 <4> [236.449819] </TASK> <4> [236.449820] irq event stamp: 300477 <4> [236.449821] hardirqs last enabled at (300483): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.449824] hardirqs last disabled at (300488): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.449827] softirqs last enabled at (299428): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [236.449829] softirqs last disabled at (299426): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [236.449832] ---[ end trace 0000000000000000 ]--- <6> [236.449834] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.449920] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.449926] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.450017] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.450222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.450307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.450396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.450477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.450558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.450637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.450717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.450797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.450878] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.450969] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.451080] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.452088] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.461882] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.462137] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.463236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.463331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.463415] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.463501] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.463588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.463678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.463762] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.463845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.463938] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.464019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.464099] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.464179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.464258] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.464337] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.464414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.464493] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.464570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.464645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.464724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.464808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.464896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.464976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.465057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.465133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.465210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.465285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.465356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.465432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.465508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.465580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.465653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.465726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.465803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.465884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.465960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.466034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.466107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.466178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.466248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.466316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.466388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.466458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.466528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.466596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.466667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.466736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.466805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.466877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.466946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.467016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.467084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.467155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.467224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.467294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.467360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.467428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.467494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.467563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.467635] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.467752] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.467756] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16965, lrc_seqno=16965, guc_id=0, flags=0x73 in no process [-1] <7> [236.467759] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.467817] ------------[ cut here ]------------ <4> [236.467818] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.467820] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:81/3557 <4> [236.467891] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.467958] autofs4 [last unloaded: snd_hda_intel] <4> [236.467962] CPU: 8 UID: 0 PID: 3557 Comm: kworker/u64:81 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.467965] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.467966] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.467967] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.467973] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.468039] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.468040] RSP: 0018:ffffc90001a1bca0 EFLAGS: 00010246 <4> [236.468043] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.468044] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.468045] RBP: ffffc90001a1bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.468047] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.468048] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.468049] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [236.468051] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.468052] CR2: 00007a4496a67000 CR3: 0000000115abe001 CR4: 0000000000f72ef0 <4> [236.468054] PKRU: 55555554 <4> [236.468055] Call Trace: <4> [236.468056] <TASK> <4> [236.468060] ? lock_acquire+0x20/0x2f0 <4> [236.468065] ? lock_release+0xd0/0x2b0 <4> [236.468070] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.468076] process_one_work+0x239/0x760 <4> [236.468082] worker_thread+0x200/0x3f0 <4> [236.468085] ? __pfx_worker_thread+0x10/0x10 <4> [236.468087] kthread+0x10d/0x150 <4> [236.468090] ? __pfx_kthread+0x10/0x10 <4> [236.468094] ret_from_fork+0x3d4/0x480 <4> [236.468096] ? __pfx_kthread+0x10/0x10 <4> [236.468099] ret_from_fork_asm+0x1a/0x30 <4> [236.468107] </TASK> <4> [236.468108] irq event stamp: 303623 <4> [236.468109] hardirqs last enabled at (303629): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.468112] hardirqs last disabled at (303634): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.468114] softirqs last enabled at (302598): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.468117] softirqs last disabled at (302593): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.468119] ---[ end trace 0000000000000000 ]--- <6> [236.468121] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.468187] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.468193] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.468471] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.468672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.468757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.468842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.468932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.469010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.469086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.469164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.469244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.469318] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.469406] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.469516] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.470519] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.480880] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.481130] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.482355] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.482428] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.482498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.482569] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.482639] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.482709] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.482778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.482846] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.482930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.482999] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.483067] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.483135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.483203] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.483270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.483338] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.483407] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.483475] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.483542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.483610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.483686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.483765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.483838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.483929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.484000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.484072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.484145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.484214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.484286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.484359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.484430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.484501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.484570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.484645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.484719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.484794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.484869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.484956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.485025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.485093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.485160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.485230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.485299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.485368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.485437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.485508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.485576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.485643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.485710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.485779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.485846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.485927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.485998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.486065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.486131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.486197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.486266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.486334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.486403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.486474] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.486586] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.486590] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16965, lrc_seqno=16965, guc_id=0, flags=0x73 in no process [-1] <7> [236.486592] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.486649] ------------[ cut here ]------------ <4> [236.486650] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.486652] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:81/3557 <4> [236.486719] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.486783] autofs4 [last unloaded: snd_hda_intel] <4> [236.486786] CPU: 8 UID: 0 PID: 3557 Comm: kworker/u64:81 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.486789] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.486790] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.486791] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.486796] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.486863] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.486864] RSP: 0018:ffffc90001a1bca0 EFLAGS: 00010246 <4> [236.486866] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.486868] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.486869] RBP: ffffc90001a1bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.486870] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.486871] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.486876] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [236.486878] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.486880] CR2: 00007a4496a67000 CR3: 0000000115abe001 CR4: 0000000000f72ef0 <4> [236.486881] PKRU: 55555554 <4> [236.486882] Call Trace: <4> [236.486883] <TASK> <4> [236.486887] ? lock_acquire+0x20/0x2f0 <4> [236.486892] ? lock_release+0xd0/0x2b0 <4> [236.486898] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.486903] process_one_work+0x239/0x760 <4> [236.486909] worker_thread+0x200/0x3f0 <4> [236.486911] ? __pfx_worker_thread+0x10/0x10 <4> [236.486914] kthread+0x10d/0x150 <4> [236.486917] ? __pfx_kthread+0x10/0x10 <4> [236.486920] ret_from_fork+0x3d4/0x480 <4> [236.486925] ? __pfx_kthread+0x10/0x10 <4> [236.486929] ret_from_fork_asm+0x1a/0x30 <4> [236.486936] </TASK> <4> [236.486937] irq event stamp: 306749 <4> [236.486938] hardirqs last enabled at (306755): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.486941] hardirqs last disabled at (306760): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.486943] softirqs last enabled at (305746): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.486945] softirqs last disabled at (305739): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.486948] ---[ end trace 0000000000000000 ]--- <7> [236.487975] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [236.488082] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [236.519637] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16967, lrc_seqno=16967, guc_id=0, flags=0x73 in no process [-1] <7> [236.519642] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.519712] ------------[ cut here ]------------ <4> [236.519713] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.519715] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:81/3557 <4> [236.519787] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.519855] autofs4 [last unloaded: snd_hda_intel] <4> [236.519859] CPU: 2 UID: 0 PID: 3557 Comm: kworker/u64:81 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.519862] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.519863] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.519865] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.519870] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.519964] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.519966] RSP: 0018:ffffc90001a1bca0 EFLAGS: 00010246 <4> [236.519971] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.519974] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.519978] RBP: ffffc90001a1bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.519981] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.519983] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.519986] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [236.519989] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.519991] CR2: 00007a4496a71000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [236.519994] PKRU: 55555554 <4> [236.519996] Call Trace: <4> [236.519998] <TASK> <4> [236.520006] ? lock_acquire+0x20/0x2f0 <4> [236.520017] ? lock_release+0xd0/0x2b0 <4> [236.520028] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.520040] process_one_work+0x239/0x760 <4> [236.520054] worker_thread+0x200/0x3f0 <4> [236.520060] ? __pfx_worker_thread+0x10/0x10 <4> [236.520065] kthread+0x10d/0x150 <4> [236.520070] ? __pfx_kthread+0x10/0x10 <4> [236.520077] ret_from_fork+0x3d4/0x480 <4> [236.520081] ? __pfx_kthread+0x10/0x10 <4> [236.520088] ret_from_fork_asm+0x1a/0x30 <4> [236.520104] </TASK> <4> [236.520106] irq event stamp: 307921 <4> [236.520109] hardirqs last enabled at (307927): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.520114] hardirqs last disabled at (307932): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.520118] softirqs last enabled at (307760): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.520122] softirqs last disabled at (307755): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.520127] ---[ end trace 0000000000000000 ]--- <6> [236.520130] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.520253] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.520271] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.520315] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.520567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.520699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.520826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.520982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.521068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.521153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.521236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.521319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.521398] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.521492] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.521641] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.522725] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.533457] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.533704] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.535006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.535087] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.535162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.535237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.535312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.535385] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.535459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.535532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.535606] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.535682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.535757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.535834] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.535928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.536101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.536192] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.536279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.536364] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.536448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.536533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.536628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.536724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.536817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.536920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.537012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.537104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.537190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.537277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.537369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.537460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.537551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.537643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.537734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.537831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.537943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.538041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.538134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.538226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.538314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.538403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.538487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.538575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.538662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.538748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.538835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.538937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.539021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.539104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.539185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.539269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.539348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.539426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.539506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.539586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.539664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.539741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.539819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.539900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.539978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.540060] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.540181] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.540185] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16967, lrc_seqno=16967, guc_id=0, flags=0x73 in no process [-1] <7> [236.540188] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.540254] ------------[ cut here ]------------ <4> [236.540255] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.540256] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:81/3557 <4> [236.540337] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.540408] autofs4 [last unloaded: snd_hda_intel] <4> [236.540412] CPU: 8 UID: 0 PID: 3557 Comm: kworker/u64:81 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.540415] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.540416] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.540418] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.540423] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.540495] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.540497] RSP: 0018:ffffc90001a1bca0 EFLAGS: 00010246 <4> [236.540500] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.540502] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.540503] RBP: ffffc90001a1bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.540505] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.540506] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.540508] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [236.540510] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.540511] CR2: 00007a4496a67000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [236.540513] PKRU: 55555554 <4> [236.540515] Call Trace: <4> [236.540516] <TASK> <4> [236.540520] ? lock_acquire+0x20/0x2f0 <4> [236.540526] ? lock_release+0xd0/0x2b0 <4> [236.540531] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.540537] process_one_work+0x239/0x760 <4> [236.540544] worker_thread+0x200/0x3f0 <4> [236.540547] ? __pfx_worker_thread+0x10/0x10 <4> [236.540550] kthread+0x10d/0x150 <4> [236.540553] ? __pfx_kthread+0x10/0x10 <4> [236.540557] ret_from_fork+0x3d4/0x480 <4> [236.540560] ? __pfx_kthread+0x10/0x10 <4> [236.540564] ret_from_fork_asm+0x1a/0x30 <4> [236.540572] </TASK> <4> [236.540573] irq event stamp: 311063 <4> [236.540574] hardirqs last enabled at (311069): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.540577] hardirqs last disabled at (311074): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.540580] softirqs last enabled at (310032): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.540583] softirqs last disabled at (310025): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.540585] ---[ end trace 0000000000000000 ]--- <6> [236.540587] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.540656] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.540662] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.541792] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [236.541899] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [236.542001] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.542210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.542299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.542388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.542469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.542549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.542626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.542704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.542785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.542859] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.542963] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.543076] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.544082] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.553880] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.554127] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.555327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.555401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.555472] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.555543] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.555616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.555688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.555759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.555827] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.555906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.555975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.556042] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.556108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.556174] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.556241] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.556307] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.556373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.556439] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.556505] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.556571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.556646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.556719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.556789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.556860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.556943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.557014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.557085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.557156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.557228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.557300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.557370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.557443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.557512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.557587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.557662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.557738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.557810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.557889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.557958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.558027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.558093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.558163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.558232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.558299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.558365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.558434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.558500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.558566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.558633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.558701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.558765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.558829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.558904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.558971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.559037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.559103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.559170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.559235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.559301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.559371] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.559486] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.559491] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16967, lrc_seqno=16967, guc_id=0, flags=0x73 in no process [-1] <7> [236.559493] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.559551] ------------[ cut here ]------------ <4> [236.559553] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.559555] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:16/3246 <4> [236.559623] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.559690] autofs4 [last unloaded: snd_hda_intel] <4> [236.559694] CPU: 6 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.559697] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.559699] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.559700] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.559705] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.559771] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.559773] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [236.559776] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.559777] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.559778] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.559780] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.559781] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.559782] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [236.559784] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.559785] CR2: 00007a448c067348 CR3: 0000000115abe005 CR4: 0000000000f72ef0 <4> [236.559787] PKRU: 55555554 <4> [236.559788] Call Trace: <4> [236.559789] <TASK> <4> [236.559793] ? lock_acquire+0x20/0x2f0 <4> [236.559799] ? lock_release+0xd0/0x2b0 <4> [236.559804] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.559809] process_one_work+0x239/0x760 <4> [236.559816] worker_thread+0x200/0x3f0 <4> [236.559819] ? __pfx_worker_thread+0x10/0x10 <4> [236.559821] kthread+0x10d/0x150 <4> [236.559824] ? __pfx_kthread+0x10/0x10 <4> [236.559828] ret_from_fork+0x3d4/0x480 <4> [236.559830] ? __pfx_kthread+0x10/0x10 <4> [236.559833] ret_from_fork_asm+0x1a/0x30 <4> [236.559841] </TASK> <4> [236.559842] irq event stamp: 230885 <4> [236.559843] hardirqs last enabled at (230891): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.559846] hardirqs last disabled at (230896): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.559848] softirqs last enabled at (229884): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.559851] softirqs last disabled at (229879): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.559853] ---[ end trace 0000000000000000 ]--- <7> [236.560923] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [236.561026] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [236.591403] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16969, lrc_seqno=16969, guc_id=0, flags=0x73 in no process [-1] <7> [236.591406] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.591474] ------------[ cut here ]------------ <4> [236.591475] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.591477] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:16/3246 <4> [236.591546] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.591616] autofs4 [last unloaded: snd_hda_intel] <4> [236.591620] CPU: 6 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.591623] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.591624] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.591626] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.591631] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.591696] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.591698] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [236.591700] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.591702] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.591703] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.591704] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.591705] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.591707] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [236.591708] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.591710] CR2: 00007a448c067348 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [236.591711] PKRU: 55555554 <4> [236.591712] Call Trace: <4> [236.591713] <TASK> <4> [236.591717] ? lock_acquire+0x20/0x2f0 <4> [236.591723] ? lock_release+0xd0/0x2b0 <4> [236.591729] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.591734] process_one_work+0x239/0x760 <4> [236.591741] worker_thread+0x200/0x3f0 <4> [236.591744] ? __pfx_worker_thread+0x10/0x10 <4> [236.591746] kthread+0x10d/0x150 <4> [236.591749] ? __pfx_kthread+0x10/0x10 <4> [236.591753] ret_from_fork+0x3d4/0x480 <4> [236.591756] ? __pfx_kthread+0x10/0x10 <4> [236.591759] ret_from_fork_asm+0x1a/0x30 <4> [236.591767] </TASK> <4> [236.591768] irq event stamp: 231895 <4> [236.591769] hardirqs last enabled at (231901): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.591772] hardirqs last disabled at (231906): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.591774] softirqs last enabled at (229884): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.591777] softirqs last disabled at (229879): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.591779] ---[ end trace 0000000000000000 ]--- <6> [236.591781] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.591847] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.591855] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.591915] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.592184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.592322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.592472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.592607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.592739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.592876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.593013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.593147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.593277] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.593418] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.593583] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.594985] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.604882] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.605216] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.606529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.606694] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.606855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.607032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.607200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.607371] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.607536] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.607699] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.607862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.608032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.608203] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.608380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.608550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.608720] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.608896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.609069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.609233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.609395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.609556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.609719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.609882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.610041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.610199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.610351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.610500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.610649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.610792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.610944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.611095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.611239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.611382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.611520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.611662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.611800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.611943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.612081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.612211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.612338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.612462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.612583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.612709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.612833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.612960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.613085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.613213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.613336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.613459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.613580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.613704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.613825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.613961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.614049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.614127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.614202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.614274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.614345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.614414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.614481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.614553] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.614667] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.614671] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16969, lrc_seqno=16969, guc_id=0, flags=0x73 in no process [-1] <7> [236.614674] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.614731] ------------[ cut here ]------------ <4> [236.614732] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.614733] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:11/3206 <4> [236.614802] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.614874] autofs4 [last unloaded: snd_hda_intel] <4> [236.614878] CPU: 6 UID: 0 PID: 3206 Comm: kworker/u64:11 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.614881] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.614882] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.614884] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.614890] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.614955] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.614957] RSP: 0018:ffffc90004707ca0 EFLAGS: 00010246 <4> [236.614959] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.614960] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.614962] RBP: ffffc90004707db0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.614963] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.614964] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.614966] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [236.614967] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.614969] CR2: 00007a448c067348 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [236.614970] PKRU: 55555554 <4> [236.614971] Call Trace: <4> [236.614972] <TASK> <4> [236.614976] ? lock_acquire+0x20/0x2f0 <4> [236.614982] ? lock_release+0xd0/0x2b0 <4> [236.614987] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.614993] process_one_work+0x239/0x760 <4> [236.614999] worker_thread+0x200/0x3f0 <4> [236.615002] ? __pfx_worker_thread+0x10/0x10 <4> [236.615004] kthread+0x10d/0x150 <4> [236.615007] ? __pfx_kthread+0x10/0x10 <4> [236.615010] ret_from_fork+0x3d4/0x480 <4> [236.615013] ? __pfx_kthread+0x10/0x10 <4> [236.615016] ret_from_fork_asm+0x1a/0x30 <4> [236.615023] </TASK> <4> [236.615024] irq event stamp: 643847 <4> [236.615026] hardirqs last enabled at (643853): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.615029] hardirqs last disabled at (643858): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.615031] softirqs last enabled at (642818): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.615034] softirqs last disabled at (642813): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.615036] ---[ end trace 0000000000000000 ]--- <6> [236.615038] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.615105] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.615111] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.616227] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [236.616348] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [236.616464] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.616684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.616774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.616865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.616971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.617056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.617137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.617216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.617296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.617372] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.617462] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.617574] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.618580] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.628876] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.629122] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.630335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.630409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.630479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.630550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.630621] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.630690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.630759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.630827] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.630938] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.631009] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.631079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.631147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.631216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.631283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.631351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.631419] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.631487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.631553] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.631621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.631696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.631769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.631841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.631925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.631997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.632066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.632135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.632206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.632277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.632348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.632418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.632488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.632558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.632634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.632710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.632787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.632857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.632940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.633008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.633077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.633145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.633216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.633285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.633352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.633420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.633491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.633560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.633631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.633699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.633769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.633836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.633913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.633985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.634053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.634121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.634187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.634255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.634322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.634391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.634461] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.634579] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.634583] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16969, lrc_seqno=16969, guc_id=0, flags=0x73 in no process [-1] <7> [236.634586] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.634643] ------------[ cut here ]------------ <4> [236.634644] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.634646] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:81/3557 <4> [236.634714] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.634779] autofs4 [last unloaded: snd_hda_intel] <4> [236.634783] CPU: 10 UID: 0 PID: 3557 Comm: kworker/u64:81 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.634786] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.634787] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.634789] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.634794] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.634861] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.634863] RSP: 0018:ffffc90001a1bca0 EFLAGS: 00010246 <4> [236.634865] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.634866] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.634868] RBP: ffffc90001a1bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.634873] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.634874] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.634876] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [236.634877] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.634879] CR2: 00007a448c066108 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [236.634880] PKRU: 55555554 <4> [236.634882] Call Trace: <4> [236.634883] <TASK> <4> [236.634887] ? lock_acquire+0x20/0x2f0 <4> [236.634893] ? lock_release+0xd0/0x2b0 <4> [236.634898] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.634904] process_one_work+0x239/0x760 <4> [236.634910] worker_thread+0x200/0x3f0 <4> [236.634913] ? __pfx_worker_thread+0x10/0x10 <4> [236.634916] kthread+0x10d/0x150 <4> [236.634918] ? __pfx_kthread+0x10/0x10 <4> [236.634922] ret_from_fork+0x3d4/0x480 <4> [236.634924] ? __pfx_kthread+0x10/0x10 <4> [236.634928] ret_from_fork_asm+0x1a/0x30 <4> [236.634935] </TASK> <4> [236.634936] irq event stamp: 316761 <4> [236.634937] hardirqs last enabled at (316767): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.634940] hardirqs last disabled at (316772): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.634943] softirqs last enabled at (315650): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.634945] softirqs last disabled at (315641): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.634947] ---[ end trace 0000000000000000 ]--- <7> [236.635997] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [236.636102] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [236.666685] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16971, lrc_seqno=16971, guc_id=0, flags=0x73 in no process [-1] <7> [236.666689] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.666755] ------------[ cut here ]------------ <4> [236.666757] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.666758] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:81/3557 <4> [236.666826] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.666905] autofs4 [last unloaded: snd_hda_intel] <4> [236.666910] CPU: 10 UID: 0 PID: 3557 Comm: kworker/u64:81 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.666913] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.666914] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.666916] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.666922] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.666992] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.666994] RSP: 0018:ffffc90001a1bca0 EFLAGS: 00010246 <4> [236.666997] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.666999] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.667000] RBP: ffffc90001a1bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.667002] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.667003] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.667005] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [236.667006] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.667008] CR2: 00007a448c066108 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [236.667010] PKRU: 55555554 <4> [236.667012] Call Trace: <4> [236.667013] <TASK> <4> [236.667017] ? lock_acquire+0x20/0x2f0 <4> [236.667024] ? lock_release+0xd0/0x2b0 <4> [236.667029] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.667035] process_one_work+0x239/0x760 <4> [236.667042] worker_thread+0x200/0x3f0 <4> [236.667045] ? __pfx_worker_thread+0x10/0x10 <4> [236.667047] kthread+0x10d/0x150 <4> [236.667050] ? __pfx_kthread+0x10/0x10 <4> [236.667054] ret_from_fork+0x3d4/0x480 <4> [236.667057] ? __pfx_kthread+0x10/0x10 <4> [236.667060] ret_from_fork_asm+0x1a/0x30 <4> [236.667068] </TASK> <4> [236.667069] irq event stamp: 317785 <4> [236.667071] hardirqs last enabled at (317791): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.667074] hardirqs last disabled at (317796): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.667076] softirqs last enabled at (317348): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.667079] softirqs last disabled at (317341): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.667081] ---[ end trace 0000000000000000 ]--- <6> [236.667083] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.667152] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.667162] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.667253] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.667455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.667541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.667630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.667713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.667790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.667874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.667953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.668033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.668108] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.668199] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.668313] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.669339] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.679877] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.680134] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.681342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.681433] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.681516] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.681599] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.681683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.681763] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.681843] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.681939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.682018] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.682094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.682168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.682246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.682327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.682405] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.682483] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.682564] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.682646] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.682727] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.682806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.682907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.682998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.683083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.683172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.683259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.683346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.683432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.683518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.683611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.683703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.683792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.683884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.683977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.684074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.684171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.684265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.684352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.684438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.684521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.684607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.684689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.684774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.684858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.684956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.685041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.685126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.685206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.685285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.685360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.685439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.685514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.685590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.685668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.685742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.685816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.686252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.686332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.686400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.686469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.686544] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.686661] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.686666] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16971, lrc_seqno=16971, guc_id=0, flags=0x73 in no process [-1] <7> [236.686668] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.686726] ------------[ cut here ]------------ <4> [236.686727] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.686729] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:81/3557 <4> [236.686797] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.686866] autofs4 [last unloaded: snd_hda_intel] <4> [236.686873] CPU: 10 UID: 0 PID: 3557 Comm: kworker/u64:81 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.686877] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.686878] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.686880] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.686885] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.686951] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.686953] RSP: 0018:ffffc90001a1bca0 EFLAGS: 00010246 <4> [236.686955] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.686956] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.686958] RBP: ffffc90001a1bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.686959] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.686960] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.686961] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [236.686963] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.686964] CR2: 00007a448c066108 CR3: 000000011d2b5004 CR4: 0000000000f72ef0 <4> [236.686966] PKRU: 55555554 <4> [236.686967] Call Trace: <4> [236.686968] <TASK> <4> [236.686972] ? lock_acquire+0x20/0x2f0 <4> [236.686978] ? lock_release+0xd0/0x2b0 <4> [236.686983] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.686989] process_one_work+0x239/0x760 <4> [236.686995] worker_thread+0x200/0x3f0 <4> [236.686998] ? __pfx_worker_thread+0x10/0x10 <4> [236.687000] kthread+0x10d/0x150 <4> [236.687004] ? __pfx_kthread+0x10/0x10 <4> [236.687007] ret_from_fork+0x3d4/0x480 <4> [236.687010] ? __pfx_kthread+0x10/0x10 <4> [236.687013] ret_from_fork_asm+0x1a/0x30 <4> [236.687021] </TASK> <4> [236.687022] irq event stamp: 320943 <4> [236.687023] hardirqs last enabled at (320949): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.687026] hardirqs last disabled at (320954): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.687028] softirqs last enabled at (320062): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.687031] softirqs last disabled at (320055): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.687033] ---[ end trace 0000000000000000 ]--- <6> [236.687960] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.688032] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.688042] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.688055] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [236.688154] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [236.688259] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.688521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.688659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.688797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.688938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.689070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.689200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.689331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.689464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.689593] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.689733] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.689901] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.691228] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.701878] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.702186] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.703538] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.703658] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.703774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.703959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.704079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.704198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.704316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.704435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.704553] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.704672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.704790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.704913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.705033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.705153] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.705273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.705392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.705512] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.705632] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.705751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.705879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.706004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.706128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.706251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.706373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.706495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.706616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.706738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.706863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.706996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.707123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.707248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.707374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.707505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.707635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.707765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.707897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.708025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.708148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.708272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.708393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.708519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.708643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.708766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.708891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.709020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.709143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.709266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.709387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.709510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.709632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.709754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.709883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.710007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.710131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.710254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.710379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.710502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.710624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.710750] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.710923] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.710930] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16971, lrc_seqno=16971, guc_id=0, flags=0x73 in no process [-1] <7> [236.710935] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.711038] ------------[ cut here ]------------ <4> [236.711040] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.711042] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:11/3206 <4> [236.711153] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.711248] autofs4 [last unloaded: snd_hda_intel] <4> [236.711254] CPU: 12 UID: 0 PID: 3206 Comm: kworker/u64:11 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.711258] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.711260] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.711262] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.711270] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.711380] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.711382] RSP: 0018:ffffc90004707ca0 EFLAGS: 00010246 <4> [236.711385] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.711387] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.711389] RBP: ffffc90004707db0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.711391] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.711393] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.711395] FS: 0000000000000000(0000) GS:ffff8888db297000(0000) knlGS:0000000000000000 <4> [236.711397] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.711399] CR2: 00007a4496a72000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [236.711401] PKRU: 55555554 <4> [236.711403] Call Trace: <4> [236.711405] <TASK> <4> [236.711411] ? lock_acquire+0x20/0x2f0 <4> [236.711420] ? lock_release+0xd0/0x2b0 <4> [236.711429] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.711438] process_one_work+0x239/0x760 <4> [236.711449] worker_thread+0x200/0x3f0 <4> [236.711453] ? __pfx_worker_thread+0x10/0x10 <4> [236.711457] kthread+0x10d/0x150 <4> [236.711461] ? __pfx_kthread+0x10/0x10 <4> [236.711466] ret_from_fork+0x3d4/0x480 <4> [236.711469] ? __pfx_kthread+0x10/0x10 <4> [236.711474] ret_from_fork_asm+0x1a/0x30 <4> [236.711486] </TASK> <4> [236.711488] irq event stamp: 648809 <4> [236.711490] hardirqs last enabled at (648815): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.711494] hardirqs last disabled at (648820): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.711497] softirqs last enabled at (647988): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.711500] softirqs last disabled at (647983): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.711504] ---[ end trace 0000000000000000 ]--- <7> [236.713165] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [236.713335] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [236.742919] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16973, lrc_seqno=16973, guc_id=0, flags=0x73 in no process [-1] <7> [236.742924] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.742993] ------------[ cut here ]------------ <4> [236.742995] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.742996] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:81/3557 <4> [236.743070] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.743142] autofs4 [last unloaded: snd_hda_intel] <4> [236.743150] CPU: 8 UID: 0 PID: 3557 Comm: kworker/u64:81 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.743153] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.743154] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.743156] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.743161] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.743226] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.743227] RSP: 0018:ffffc90001a1bca0 EFLAGS: 00010246 <4> [236.743230] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.743231] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.743232] RBP: ffffc90001a1bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.743233] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.743234] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.743236] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [236.743237] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.743238] CR2: 00007a4496a73000 CR3: 0000000115abe001 CR4: 0000000000f72ef0 <4> [236.743240] PKRU: 55555554 <4> [236.743241] Call Trace: <4> [236.743242] <TASK> <4> [236.743246] ? lock_acquire+0x20/0x2f0 <4> [236.743252] ? lock_release+0xd0/0x2b0 <4> [236.743256] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.743262] process_one_work+0x239/0x760 <4> [236.743268] worker_thread+0x200/0x3f0 <4> [236.743270] ? __pfx_worker_thread+0x10/0x10 <4> [236.743272] kthread+0x10d/0x150 <4> [236.743275] ? __pfx_kthread+0x10/0x10 <4> [236.743279] ret_from_fork+0x3d4/0x480 <4> [236.743281] ? __pfx_kthread+0x10/0x10 <4> [236.743284] ret_from_fork_asm+0x1a/0x30 <4> [236.743292] </TASK> <4> [236.743293] irq event stamp: 322165 <4> [236.743294] hardirqs last enabled at (322171): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.743297] hardirqs last disabled at (322176): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.743299] softirqs last enabled at (321134): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [236.743301] softirqs last disabled at (321132): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [236.743303] ---[ end trace 0000000000000000 ]--- <6> [236.743309] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.743372] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.743381] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.743435] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.743692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.743823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.743966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.744101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.744232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.744361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.744492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.744624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.744753] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.744898] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.745065] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.746411] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.756878] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.757226] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.758525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.758618] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.758701] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.758783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.758862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.758966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.759043] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.759120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.759195] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.759268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.759340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.759413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.759486] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.759557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.759627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.759698] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.759765] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.759832] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.759925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.760003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.760080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.760154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.760229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.760302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.760373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.760444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.760515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.760588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.760661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.760734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.760804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.760878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.760955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.761030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.761105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.761177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.761247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.761316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.761385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.761453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.761524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.761594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.761664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.761733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.761807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.761879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.761951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.762021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.762095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.762167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.762238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.762313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.762385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.762456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.762526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.762595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.762663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.762730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.762803] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.762929] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.762933] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16973, lrc_seqno=16973, guc_id=0, flags=0x73 in no process [-1] <7> [236.762936] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.762993] ------------[ cut here ]------------ <4> [236.762995] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.762996] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:11/3206 <4> [236.763066] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.763134] autofs4 [last unloaded: snd_hda_intel] <4> [236.763139] CPU: 4 UID: 0 PID: 3206 Comm: kworker/u64:11 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.763142] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.763143] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.763144] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.763150] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.763217] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.763219] RSP: 0018:ffffc90004707ca0 EFLAGS: 00010246 <4> [236.763221] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.763223] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.763224] RBP: ffffc90004707db0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.763225] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.763227] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.763228] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [236.763230] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.763231] CR2: 000076c648fd1000 CR3: 000000011d2b5001 CR4: 0000000000f72ef0 <4> [236.763233] PKRU: 55555554 <4> [236.763234] Call Trace: <4> [236.763235] <TASK> <4> [236.763239] ? lock_acquire+0x20/0x2f0 <4> [236.763245] ? lock_release+0xd0/0x2b0 <4> [236.763250] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.763256] process_one_work+0x239/0x760 <4> [236.763263] worker_thread+0x200/0x3f0 <4> [236.763266] ? __pfx_worker_thread+0x10/0x10 <4> [236.763268] kthread+0x10d/0x150 <4> [236.763271] ? __pfx_kthread+0x10/0x10 <4> [236.763275] ret_from_fork+0x3d4/0x480 <4> [236.763278] ? __pfx_kthread+0x10/0x10 <4> [236.763281] ret_from_fork_asm+0x1a/0x30 <4> [236.763289] </TASK> <4> [236.763290] irq event stamp: 652229 <4> [236.763291] hardirqs last enabled at (652235): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.763295] hardirqs last disabled at (652240): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.763297] softirqs last enabled at (651386): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.763300] softirqs last disabled at (651363): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.763302] ---[ end trace 0000000000000000 ]--- <6> [236.763304] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.763372] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.763377] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.763657] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.763857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.763953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.764038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.764115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.764193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.764269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.764346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.764423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.764497] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.764585] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.764697] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.765703] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.776421] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.776667] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.777906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.777980] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.778049] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.778118] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.778186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.778255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.778324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.778392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.778458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.778524] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.778592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.778659] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.778726] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.778792] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.778858] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.778943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.779011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.779078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.779146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.779223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.779300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.779373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.779446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.779518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.779591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.779662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.779732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.779805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.779882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.779955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.780026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.780097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.780174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.780251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.780328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.780401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.780472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.780541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.780611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.780677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.780747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.780816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.780891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.780961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.781033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.781104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.781172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.781239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.781308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.781376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.781444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.781514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.781582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.781649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.781717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.781785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.781853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.781932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.782005] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.782117] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.782121] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16973, lrc_seqno=16973, guc_id=0, flags=0x73 in no process [-1] <7> [236.782124] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.782180] ------------[ cut here ]------------ <4> [236.782182] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.782183] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:11/3206 <4> [236.782251] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.782315] autofs4 [last unloaded: snd_hda_intel] <4> [236.782319] CPU: 4 UID: 0 PID: 3206 Comm: kworker/u64:11 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.782322] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.782323] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.782324] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.782329] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.782394] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.782396] RSP: 0018:ffffc90004707ca0 EFLAGS: 00010246 <4> [236.782398] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.782399] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.782401] RBP: ffffc90004707db0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.782402] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.782403] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.782404] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [236.782406] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.782408] CR2: 000076c648fd1000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [236.782409] PKRU: 55555554 <4> [236.782410] Call Trace: <4> [236.782411] <TASK> <4> [236.782415] ? lock_acquire+0x20/0x2f0 <4> [236.782420] ? lock_release+0xd0/0x2b0 <4> [236.782426] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.782431] process_one_work+0x239/0x760 <4> [236.782437] worker_thread+0x200/0x3f0 <4> [236.782440] ? __pfx_worker_thread+0x10/0x10 <4> [236.782442] kthread+0x10d/0x150 <4> [236.782445] ? __pfx_kthread+0x10/0x10 <4> [236.782448] ret_from_fork+0x3d4/0x480 <4> [236.782451] ? __pfx_kthread+0x10/0x10 <4> [236.782454] ret_from_fork_asm+0x1a/0x30 <4> [236.782461] </TASK> <4> [236.782462] irq event stamp: 655359 <4> [236.782463] hardirqs last enabled at (655365): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.782466] hardirqs last disabled at (655370): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.782468] softirqs last enabled at (654502): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.782471] softirqs last disabled at (654497): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.782473] ---[ end trace 0000000000000000 ]--- <7> [236.783563] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [236.783712] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [236.814068] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16975, lrc_seqno=16975, guc_id=0, flags=0x73 in no process [-1] <7> [236.814074] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.814184] ------------[ cut here ]------------ <4> [236.814187] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.814189] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:11/3206 <4> [236.814293] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.814380] autofs4 [last unloaded: snd_hda_intel] <4> [236.814384] CPU: 4 UID: 0 PID: 3206 Comm: kworker/u64:11 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.814388] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.814389] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.814391] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.814396] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.814468] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.814470] RSP: 0018:ffffc90004707ca0 EFLAGS: 00010246 <4> [236.814472] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.814474] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.814475] RBP: ffffc90004707db0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.814477] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.814478] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.814479] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [236.814481] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.814482] CR2: 000076c648fd1000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [236.814484] PKRU: 55555554 <4> [236.814485] Call Trace: <4> [236.814486] <TASK> <4> [236.814490] ? lock_acquire+0x20/0x2f0 <4> [236.814496] ? lock_release+0xd0/0x2b0 <4> [236.814501] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.814507] process_one_work+0x239/0x760 <4> [236.814513] worker_thread+0x200/0x3f0 <4> [236.814516] ? __pfx_worker_thread+0x10/0x10 <4> [236.814519] kthread+0x10d/0x150 <4> [236.814521] ? __pfx_kthread+0x10/0x10 <4> [236.814525] ret_from_fork+0x3d4/0x480 <4> [236.814527] ? __pfx_kthread+0x10/0x10 <4> [236.814531] ret_from_fork_asm+0x1a/0x30 <4> [236.814538] </TASK> <4> [236.814539] irq event stamp: 656391 <4> [236.814540] hardirqs last enabled at (656397): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.814543] hardirqs last disabled at (656402): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.814545] softirqs last enabled at (654502): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.814548] softirqs last disabled at (654497): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.814550] ---[ end trace 0000000000000000 ]--- <6> [236.814553] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.814623] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.814632] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.814680] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.814895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.815008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.815098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.815180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.815260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.815339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.815418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.815498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.815573] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.815664] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.815774] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.816797] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.826923] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.827178] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.828351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.828430] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.828503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.828575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.828645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.828714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.828781] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.828848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.828934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.829005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.829073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.829139] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.829207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.829277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.829344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.829412] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.829478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.829546] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.829612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.829688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.829764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.829836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.829920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.829993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.830064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.830135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.830209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.830281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.830352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.830423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.830495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.830567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.830645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.830722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.830798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.830879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.830955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.831024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.831093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.831159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.831230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.831299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.831367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.831436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.831510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.831581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.831652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.831721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.831791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.831861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.831947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.832019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.832088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.832158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.832225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.832296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.832364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.832434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.832507] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.832622] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.832627] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16975, lrc_seqno=16975, guc_id=0, flags=0x73 in no process [-1] <7> [236.832629] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.832686] ------------[ cut here ]------------ <4> [236.832687] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.832688] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:11/3206 <4> [236.832755] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.832823] autofs4 [last unloaded: snd_hda_intel] <4> [236.832827] CPU: 4 UID: 0 PID: 3206 Comm: kworker/u64:11 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.832830] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.832831] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.832832] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.832838] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.832921] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.832923] RSP: 0018:ffffc90004707ca0 EFLAGS: 00010246 <4> [236.832925] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.832927] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.832929] RBP: ffffc90004707db0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.832930] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.832932] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.832933] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [236.832935] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.832937] CR2: 000076c648fd1000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [236.832939] PKRU: 55555554 <4> [236.832940] Call Trace: <4> [236.832941] <TASK> <4> [236.832946] ? lock_acquire+0x20/0x2f0 <4> [236.832952] ? lock_release+0xd0/0x2b0 <4> [236.832957] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.832963] process_one_work+0x239/0x760 <4> [236.832970] worker_thread+0x200/0x3f0 <4> [236.832973] ? __pfx_worker_thread+0x10/0x10 <4> [236.832976] kthread+0x10d/0x150 <4> [236.832979] ? __pfx_kthread+0x10/0x10 <4> [236.832983] ret_from_fork+0x3d4/0x480 <4> [236.832985] ? __pfx_kthread+0x10/0x10 <4> [236.832988] ret_from_fork_asm+0x1a/0x30 <4> [236.832996] </TASK> <4> [236.832998] irq event stamp: 659571 <4> [236.832999] hardirqs last enabled at (659577): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.833002] hardirqs last disabled at (659582): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.833005] softirqs last enabled at (659410): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.833008] softirqs last disabled at (659399): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.833010] ---[ end trace 0000000000000000 ]--- <6> [236.833012] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.833079] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.833085] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.833352] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.833552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.833633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.833716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.833794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.833877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.833953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.834031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.834109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.834183] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.834273] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.834384] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.835385] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.846103] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.846350] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.847575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.847650] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.847724] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.847795] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.847870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.847939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.848007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.848074] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.848146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.848212] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.848280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.848348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.848417] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.848485] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.848551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.848617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.848685] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.848753] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.848820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.848906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.848981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.849053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.849125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.849194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.849266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.849337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.849408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.849479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.849552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.849622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.849692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.849762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.849837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.849921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.849996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.850067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.850138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.850205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.850273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.850339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.850409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.850476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.850548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.850614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.850686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.850754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.850823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.850897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.850966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.851034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.851103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.851174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.851245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.851315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.851383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.851453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.851521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.851590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.851661] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.851774] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.851778] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16975, lrc_seqno=16975, guc_id=0, flags=0x73 in no process [-1] <7> [236.851781] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.851839] ------------[ cut here ]------------ <4> [236.851840] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.851842] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:11/3206 <4> [236.851921] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.851986] autofs4 [last unloaded: snd_hda_intel] <4> [236.851990] CPU: 4 UID: 0 PID: 3206 Comm: kworker/u64:11 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.851993] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.851994] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.851995] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.852001] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.852066] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.852068] RSP: 0018:ffffc90004707ca0 EFLAGS: 00010246 <4> [236.852070] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.852071] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.852073] RBP: ffffc90004707db0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.852074] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.852075] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.852076] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [236.852078] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.852079] CR2: 000076c648fd1000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [236.852081] PKRU: 55555554 <4> [236.852082] Call Trace: <4> [236.852083] <TASK> <4> [236.852087] ? lock_acquire+0x20/0x2f0 <4> [236.852092] ? lock_release+0xd0/0x2b0 <4> [236.852097] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.852103] process_one_work+0x239/0x760 <4> [236.852109] worker_thread+0x200/0x3f0 <4> [236.852112] ? __pfx_worker_thread+0x10/0x10 <4> [236.852114] kthread+0x10d/0x150 <4> [236.852117] ? __pfx_kthread+0x10/0x10 <4> [236.852121] ret_from_fork+0x3d4/0x480 <4> [236.852123] ? __pfx_kthread+0x10/0x10 <4> [236.852126] ret_from_fork_asm+0x1a/0x30 <4> [236.852133] </TASK> <4> [236.852134] irq event stamp: 662725 <4> [236.852136] hardirqs last enabled at (662731): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.852138] hardirqs last disabled at (662736): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.852141] softirqs last enabled at (661982): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.852143] softirqs last disabled at (661971): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.852145] ---[ end trace 0000000000000000 ]--- <7> [236.853184] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [236.853343] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [236.884688] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16977, lrc_seqno=16977, guc_id=0, flags=0x73 in no process [-1] <7> [236.884693] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.884765] ------------[ cut here ]------------ <4> [236.884766] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.884768] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:81/3557 <4> [236.884841] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.884946] autofs4 [last unloaded: snd_hda_intel] <4> [236.884950] CPU: 10 UID: 0 PID: 3557 Comm: kworker/u64:81 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.884953] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.884954] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.884956] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.884961] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.885031] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.885033] RSP: 0018:ffffc90001a1bca0 EFLAGS: 00010246 <4> [236.885036] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.885037] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.885039] RBP: ffffc90001a1bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.885040] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.885042] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.885043] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [236.885045] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.885046] CR2: 00007a448c066108 CR3: 0000000115abe002 CR4: 0000000000f72ef0 <4> [236.885048] PKRU: 55555554 <4> [236.885050] Call Trace: <4> [236.885051] <TASK> <4> [236.885055] ? lock_acquire+0x20/0x2f0 <4> [236.885061] ? lock_release+0xd0/0x2b0 <4> [236.885066] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.885072] process_one_work+0x239/0x760 <4> [236.885079] worker_thread+0x200/0x3f0 <4> [236.885082] ? __pfx_worker_thread+0x10/0x10 <4> [236.885086] kthread+0x10d/0x150 <4> [236.885089] ? __pfx_kthread+0x10/0x10 <4> [236.885093] ret_from_fork+0x3d4/0x480 <4> [236.885096] ? __pfx_kthread+0x10/0x10 <4> [236.885099] ret_from_fork_asm+0x1a/0x30 <4> [236.885107] </TASK> <4> [236.885108] irq event stamp: 324739 <4> [236.885110] hardirqs last enabled at (324745): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.885113] hardirqs last disabled at (324750): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.885115] softirqs last enabled at (324158): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.885118] softirqs last disabled at (324151): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.885120] ---[ end trace 0000000000000000 ]--- <6> [236.885123] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.885191] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.885200] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.885248] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.885451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.885539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.885627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.885710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.885790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.885874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.885955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.886035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.886112] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.886201] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.886312] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.887326] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.897870] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.898145] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.899345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.899422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.899493] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.899565] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.899634] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.899703] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.899773] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.899842] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.899926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.899994] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.900062] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.900129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.900197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.900266] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.900338] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.900409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.900478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.900548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.900618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.900698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.900778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.900855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.900967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.901045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.901123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.901199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.901274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.901354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.901434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.901513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.901593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.901673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.901759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.901844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.901945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.902032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.902114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.902191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.902272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.902352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.902435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.902515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.902593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.902671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.902751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.902828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.902916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.902991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.903068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.903143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.903212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.903285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.903355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.903425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.903493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.903565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.903635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.903702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.903773] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.903900] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.903904] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16977, lrc_seqno=16977, guc_id=0, flags=0x73 in no process [-1] <7> [236.903907] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.903967] ------------[ cut here ]------------ <4> [236.903968] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.903970] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:81/3557 <4> [236.904041] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.904109] autofs4 [last unloaded: snd_hda_intel] <4> [236.904113] CPU: 10 UID: 0 PID: 3557 Comm: kworker/u64:81 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.904116] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.904117] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.904119] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.904124] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.904193] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.904195] RSP: 0018:ffffc90001a1bca0 EFLAGS: 00010246 <4> [236.904197] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.904199] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.904200] RBP: ffffc90001a1bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.904202] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.904203] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.904205] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [236.904207] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.904208] CR2: 00007a448c066108 CR3: 0000000115abe002 CR4: 0000000000f72ef0 <4> [236.904210] PKRU: 55555554 <4> [236.904212] Call Trace: <4> [236.904213] <TASK> <4> [236.904217] ? lock_acquire+0x20/0x2f0 <4> [236.904223] ? lock_release+0xd0/0x2b0 <4> [236.904229] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.904235] process_one_work+0x239/0x760 <4> [236.904241] worker_thread+0x200/0x3f0 <4> [236.904244] ? __pfx_worker_thread+0x10/0x10 <4> [236.904247] kthread+0x10d/0x150 <4> [236.904250] ? __pfx_kthread+0x10/0x10 <4> [236.904254] ret_from_fork+0x3d4/0x480 <4> [236.904256] ? __pfx_kthread+0x10/0x10 <4> [236.904260] ret_from_fork_asm+0x1a/0x30 <4> [236.904268] </TASK> <4> [236.904269] irq event stamp: 327915 <4> [236.904271] hardirqs last enabled at (327921): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.904274] hardirqs last disabled at (327926): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.904276] softirqs last enabled at (327106): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.904279] softirqs last disabled at (327083): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.904283] ---[ end trace 0000000000000000 ]--- <6> [236.904285] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.904353] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.904362] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.905491] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [236.905595] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [236.905698] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.905908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.905991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.906076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.906155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.906244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.906334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.906411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.906489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.906563] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.906653] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.906765] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.907772] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.918491] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.918740] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.919988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.920066] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.920138] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.920210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.920280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.920350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.920419] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.920487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.920555] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.920623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.920690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.920756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.920826] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.920907] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.920977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.921047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.921113] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.921179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.921245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.921322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.921429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.921507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.921581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.921654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.921726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.921798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.921877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.921955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.922029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.922102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.922176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.922249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.922327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.922401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.922476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.922549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.922622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.922692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.922761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.922827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.922913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.922983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.923052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.923119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.923192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.923262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.923331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.923400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.923470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.923554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.923632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.923704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.923773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.923842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.923923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.923995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.924062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.924129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.924199] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.924318] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.924322] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16977, lrc_seqno=16977, guc_id=0, flags=0x73 in no process [-1] <7> [236.924324] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.924384] ------------[ cut here ]------------ <4> [236.924385] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.924387] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:54/3530 <4> [236.924456] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.924521] autofs4 [last unloaded: snd_hda_intel] <4> [236.924525] CPU: 11 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.924528] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.924529] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.924531] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.924536] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.924602] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.924604] RSP: 0018:ffffc90005c17ca0 EFLAGS: 00010246 <4> [236.924606] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.924608] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.924609] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.924610] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.924611] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.924613] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [236.924614] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.924616] CR2: 00007407109f2000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [236.924617] PKRU: 55555554 <4> [236.924619] Call Trace: <4> [236.924620] <TASK> <4> [236.924624] ? lock_acquire+0x20/0x2f0 <4> [236.924630] ? lock_release+0xd0/0x2b0 <4> [236.924635] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.924640] process_one_work+0x239/0x760 <4> [236.924647] worker_thread+0x200/0x3f0 <4> [236.924650] ? __pfx_worker_thread+0x10/0x10 <4> [236.924652] kthread+0x10d/0x150 <4> [236.924655] ? __pfx_kthread+0x10/0x10 <4> [236.924659] ret_from_fork+0x3d4/0x480 <4> [236.924661] ? __pfx_kthread+0x10/0x10 <4> [236.924664] ret_from_fork_asm+0x1a/0x30 <4> [236.924672] </TASK> <4> [236.924673] irq event stamp: 338535 <4> [236.924675] hardirqs last enabled at (338541): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.924678] hardirqs last disabled at (338546): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.924680] softirqs last enabled at (337660): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.924683] softirqs last disabled at (337653): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.924685] ---[ end trace 0000000000000000 ]--- <7> [236.925749] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [236.925853] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [236.956628] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16979, lrc_seqno=16979, guc_id=0, flags=0x73 in no process [-1] <7> [236.956632] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.956698] ------------[ cut here ]------------ <4> [236.956699] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.956701] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:54/3530 <4> [236.956772] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.956840] autofs4 [last unloaded: snd_hda_intel] <4> [236.956844] CPU: 11 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.956847] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.956849] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.956850] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.956855] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.956943] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.956945] RSP: 0018:ffffc90005c17ca0 EFLAGS: 00010246 <4> [236.956947] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.956949] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.956950] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.956952] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.956953] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.956955] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [236.956956] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.956958] CR2: 00007407109f2000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [236.956959] PKRU: 55555554 <4> [236.956960] Call Trace: <4> [236.956962] <TASK> <4> [236.956966] ? lock_acquire+0x20/0x2f0 <4> [236.956972] ? lock_release+0xd0/0x2b0 <4> [236.956978] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.956984] process_one_work+0x239/0x760 <4> [236.956991] worker_thread+0x200/0x3f0 <4> [236.956994] ? __pfx_worker_thread+0x10/0x10 <4> [236.956996] kthread+0x10d/0x150 <4> [236.957000] ? __pfx_kthread+0x10/0x10 <4> [236.957004] ret_from_fork+0x3d4/0x480 <4> [236.957006] ? __pfx_kthread+0x10/0x10 <4> [236.957010] ret_from_fork_asm+0x1a/0x30 <4> [236.957017] </TASK> <4> [236.957019] irq event stamp: 339535 <4> [236.957020] hardirqs last enabled at (339541): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.957024] hardirqs last disabled at (339546): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.957026] softirqs last enabled at (339374): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.957029] softirqs last disabled at (339369): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.957031] ---[ end trace 0000000000000000 ]--- <6> [236.957034] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.957103] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.957113] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.957205] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.957407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.957491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.957577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.957660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.957740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.957819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.957910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.957991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.958066] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.958157] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.958269] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.959291] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.969871] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.970122] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.971439] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.971529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.971616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.971703] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.971790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.971885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.971977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.972063] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.972148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.972232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.972320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.972409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.972497] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.972586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.972675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.972763] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.972855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.972971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.973060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.973161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.973258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.973352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.973448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.973539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.973627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.973715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.973806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.973910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.974002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.974093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.974180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.974266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.974357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.974450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.974540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.974625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.974709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.974790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.974877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.974956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.975036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.975115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.975199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.975280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.975361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.975439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.975514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.975586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.975659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.975731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.975799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.975879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.975951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.976022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.976091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.976164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.976232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.976301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.976374] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.976488] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.976492] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16979, lrc_seqno=16979, guc_id=0, flags=0x73 in no process [-1] <7> [236.976494] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.976552] ------------[ cut here ]------------ <4> [236.976553] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.976555] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:54/3530 <4> [236.976623] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.976694] autofs4 [last unloaded: snd_hda_intel] <4> [236.976699] CPU: 11 UID: 0 PID: 3530 Comm: kworker/u64:54 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.976702] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.976703] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.976705] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.976710] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.976777] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.976779] RSP: 0018:ffffc90005c17ca0 EFLAGS: 00010246 <4> [236.976781] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.976782] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.976784] RBP: ffffc90005c17db0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.976785] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.976786] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.976788] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [236.976789] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.976791] CR2: 00007407109f2000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [236.976792] PKRU: 55555554 <4> [236.976793] Call Trace: <4> [236.976794] <TASK> <4> [236.976798] ? lock_acquire+0x20/0x2f0 <4> [236.976804] ? lock_release+0xd0/0x2b0 <4> [236.976810] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.976815] process_one_work+0x239/0x760 <4> [236.976822] worker_thread+0x200/0x3f0 <4> [236.976825] ? __pfx_worker_thread+0x10/0x10 <4> [236.976827] kthread+0x10d/0x150 <4> [236.976830] ? __pfx_kthread+0x10/0x10 <4> [236.976834] ret_from_fork+0x3d4/0x480 <4> [236.976836] ? __pfx_kthread+0x10/0x10 <4> [236.976840] ret_from_fork_asm+0x1a/0x30 <4> [236.976847] </TASK> <4> [236.976848] irq event stamp: 342675 <4> [236.976850] hardirqs last enabled at (342681): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.976853] hardirqs last disabled at (342686): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.976855] softirqs last enabled at (341596): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.976857] softirqs last disabled at (341589): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.976864] ---[ end trace 0000000000000000 ]--- <6> [236.976865] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [236.976933] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [236.976977] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [236.978093] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [236.978197] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [236.978341] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [236.978567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [236.978664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [236.978759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [236.978845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [236.978942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [236.979025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [236.979107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [236.979190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [236.979269] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [236.979365] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [236.979483] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [236.980495] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [236.991264] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [236.991544] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [236.992729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [236.992813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [236.992901] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [236.992980] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [236.993056] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [236.993129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [236.993202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [236.993274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [236.993346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [236.993418] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [236.993490] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [236.993562] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [236.993633] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [236.993706] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [236.993779] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [236.993851] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [236.993935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [236.994007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [236.994079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [236.994161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [236.994244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [236.994322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [236.994399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [236.994476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [236.994551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [236.994625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [236.994698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [236.994772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [236.994847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [236.994934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [236.995009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [236.995085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [236.995167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [236.995246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [236.995325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [236.995402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [236.995478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [236.995554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [236.995629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [236.995703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [236.995777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [236.995849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [236.995936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [236.996009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [236.996085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [236.996157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [236.996230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [236.996302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [236.996375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [236.996446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [236.996517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [236.996593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [236.996666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [236.996740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [236.996812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [236.996892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [236.996964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [236.997037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [236.997114] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [236.997230] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [236.997235] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16979, lrc_seqno=16979, guc_id=0, flags=0x73 in no process [-1] <7> [236.997237] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [236.997299] ------------[ cut here ]------------ <4> [236.997300] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [236.997301] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:11/3206 <4> [236.997375] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [236.997444] autofs4 [last unloaded: snd_hda_intel] <4> [236.997449] CPU: 4 UID: 0 PID: 3206 Comm: kworker/u64:11 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [236.997452] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [236.997453] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [236.997455] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [236.997460] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [236.997531] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [236.997533] RSP: 0018:ffffc90004707ca0 EFLAGS: 00010246 <4> [236.997535] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [236.997537] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [236.997538] RBP: ffffc90004707db0 R08: 0000000000000000 R09: 0000000000000000 <4> [236.997539] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [236.997541] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [236.997542] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [236.997544] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [236.997545] CR2: 000076c648fd1000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [236.997547] PKRU: 55555554 <4> [236.997548] Call Trace: <4> [236.997549] <TASK> <4> [236.997553] ? lock_acquire+0x20/0x2f0 <4> [236.997559] ? lock_release+0xd0/0x2b0 <4> [236.997564] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [236.997570] process_one_work+0x239/0x760 <4> [236.997576] worker_thread+0x200/0x3f0 <4> [236.997579] ? __pfx_worker_thread+0x10/0x10 <4> [236.997581] kthread+0x10d/0x150 <4> [236.997584] ? __pfx_kthread+0x10/0x10 <4> [236.997588] ret_from_fork+0x3d4/0x480 <4> [236.997590] ? __pfx_kthread+0x10/0x10 <4> [236.997594] ret_from_fork_asm+0x1a/0x30 <4> [236.997601] </TASK> <4> [236.997603] irq event stamp: 666585 <4> [236.997604] hardirqs last enabled at (666591): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [236.997607] hardirqs last disabled at (666596): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [236.997609] softirqs last enabled at (665628): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.997612] softirqs last disabled at (665619): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [236.997614] ---[ end trace 0000000000000000 ]--- <7> [236.998720] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [236.998872] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [237.029892] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16981, lrc_seqno=16981, guc_id=0, flags=0x73 in no process [-1] <7> [237.029900] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [237.030013] ------------[ cut here ]------------ <4> [237.030015] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [237.030017] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#13: kworker/u64:81/3557 <4> [237.030134] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [237.030231] autofs4 [last unloaded: snd_hda_intel] <4> [237.030237] CPU: 13 UID: 0 PID: 3557 Comm: kworker/u64:81 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [237.030242] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [237.030244] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [237.030246] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [237.030254] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [237.030367] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [237.030369] RSP: 0018:ffffc90001a1bca0 EFLAGS: 00010246 <4> [237.030373] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [237.030375] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [237.030377] RBP: ffffc90001a1bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [237.030379] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [237.030380] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [237.030382] FS: 0000000000000000(0000) GS:ffff8888db317000(0000) knlGS:0000000000000000 <4> [237.030385] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [237.030387] CR2: 0000583db42f0d78 CR3: 000000011d2b5005 CR4: 0000000000f72ef0 <4> [237.030389] PKRU: 55555554 <4> [237.030391] Call Trace: <4> [237.030393] <TASK> <4> [237.030399] ? lock_acquire+0x20/0x2f0 <4> [237.030409] ? lock_release+0xd0/0x2b0 <4> [237.030417] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [237.030426] process_one_work+0x239/0x760 <4> [237.030437] worker_thread+0x200/0x3f0 <4> [237.030441] ? __pfx_worker_thread+0x10/0x10 <4> [237.030445] kthread+0x10d/0x150 <4> [237.030449] ? __pfx_kthread+0x10/0x10 <4> [237.030454] ret_from_fork+0x3d4/0x480 <4> [237.030457] ? __pfx_kthread+0x10/0x10 <4> [237.030462] ret_from_fork_asm+0x1a/0x30 <4> [237.030475] </TASK> <4> [237.030476] irq event stamp: 330723 <4> [237.030478] hardirqs last enabled at (330729): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [237.030482] hardirqs last disabled at (330734): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [237.030485] softirqs last enabled at (329698): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [237.030488] softirqs last disabled at (329696): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [237.030492] ---[ end trace 0000000000000000 ]--- <6> [237.030494] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [237.030608] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [237.030621] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [237.030714] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [237.030974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [237.031109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [237.031246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [237.031378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [237.031509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [237.031639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [237.031771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [237.031928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [237.032024] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [237.032121] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [237.032235] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [237.033264] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [237.043867] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [237.044117] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [237.045303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [237.045392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [237.045474] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [237.045554] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [237.045635] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [237.045715] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [237.045795] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [237.045885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [237.045967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [237.046044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [237.046121] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [237.046197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [237.046274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [237.046352] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [237.046430] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [237.046507] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [237.046584] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [237.046663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [237.046742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [237.046835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [237.046938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [237.047027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [237.047116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [237.047201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [237.047287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [237.047373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [237.047460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [237.047551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [237.047641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [237.047730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [237.047819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [237.047921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [237.048020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [237.048114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [237.048211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [237.048304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [237.048399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [237.048486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [237.048573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [237.048657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [237.048746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [237.048836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [237.048936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [237.049022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [237.049111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [237.049195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [237.049277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [237.049360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [237.049441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [237.049518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [237.049595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [237.049676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [237.049756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [237.049834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [237.049921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [237.049999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [237.050075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [237.050151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [237.050231] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [237.050352] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [237.050356] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16981, lrc_seqno=16981, guc_id=0, flags=0x73 in no process [-1] <7> [237.050359] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [237.050421] ------------[ cut here ]------------ <4> [237.050422] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [237.050423] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:81/3557 <4> [237.050496] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [237.050574] autofs4 [last unloaded: snd_hda_intel] <4> [237.050579] CPU: 8 UID: 0 PID: 3557 Comm: kworker/u64:81 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [237.050582] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [237.050584] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [237.050585] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [237.050591] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [237.050658] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [237.050660] RSP: 0018:ffffc90001a1bca0 EFLAGS: 00010246 <4> [237.050662] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [237.050664] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [237.050666] RBP: ffffc90001a1bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [237.050668] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [237.050669] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [237.050670] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [237.050672] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [237.050673] CR2: 00007a4496a74000 CR3: 0000000115abe001 CR4: 0000000000f72ef0 <4> [237.050675] PKRU: 55555554 <4> [237.050676] Call Trace: <4> [237.050677] <TASK> <4> [237.050681] ? lock_acquire+0x20/0x2f0 <4> [237.050687] ? lock_release+0xd0/0x2b0 <4> [237.050693] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [237.050698] process_one_work+0x239/0x760 <4> [237.050704] worker_thread+0x200/0x3f0 <4> [237.050707] ? __pfx_worker_thread+0x10/0x10 <4> [237.050710] kthread+0x10d/0x150 <4> [237.050713] ? __pfx_kthread+0x10/0x10 <4> [237.050716] ret_from_fork+0x3d4/0x480 <4> [237.050718] ? __pfx_kthread+0x10/0x10 <4> [237.050722] ret_from_fork_asm+0x1a/0x30 <4> [237.050729] </TASK> <4> [237.050731] irq event stamp: 333907 <4> [237.050732] hardirqs last enabled at (333913): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [237.050735] hardirqs last disabled at (333918): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [237.050737] softirqs last enabled at (332950): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [237.050740] softirqs last disabled at (332943): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [237.050742] ---[ end trace 0000000000000000 ]--- <6> [237.050744] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [237.050811] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [237.050817] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [237.051931] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [237.052042] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [237.052143] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [237.052354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [237.052443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [237.052534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [237.052618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [237.052698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [237.052779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [237.052867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [237.052953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [237.053029] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [237.053121] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [237.053233] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [237.054240] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [237.064866] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [237.065115] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [237.066342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [237.066441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [237.066511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [237.066583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [237.066655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [237.066726] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [237.066794] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [237.066879] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [237.066948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [237.067021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [237.067091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [237.067160] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [237.067228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [237.067295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [237.067362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [237.067428] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [237.067495] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [237.067561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [237.067627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [237.067705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [237.067778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [237.067850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [237.067937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [237.068007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [237.068076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [237.068144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [237.068217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [237.068290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [237.068361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [237.068431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [237.068500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [237.068569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [237.068645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [237.068718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [237.068793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [237.068869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [237.068938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [237.069004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [237.069070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [237.069134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [237.069202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [237.069269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [237.069336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [237.069404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [237.069475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [237.069541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [237.069607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [237.069671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [237.069737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [237.069801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [237.069868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [237.069939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [237.070006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [237.070074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [237.070139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [237.070207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [237.070273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [237.070341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [237.070412] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [237.070526] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [237.070530] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16981, lrc_seqno=16981, guc_id=0, flags=0x73 in no process [-1] <7> [237.070532] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [237.070589] ------------[ cut here ]------------ <4> [237.070590] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [237.070592] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:16/3246 <4> [237.070659] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [237.070724] autofs4 [last unloaded: snd_hda_intel] <4> [237.070728] CPU: 6 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [237.070732] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [237.070733] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [237.070734] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [237.070739] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [237.070805] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [237.070807] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [237.070809] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [237.070811] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [237.070812] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [237.070814] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [237.070815] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [237.070817] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [237.070819] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [237.070820] CR2: 00007a4496a76000 CR3: 0000000115abe005 CR4: 0000000000f72ef0 <4> [237.070822] PKRU: 55555554 <4> [237.070823] Call Trace: <4> [237.070824] <TASK> <4> [237.070829] ? lock_acquire+0x20/0x2f0 <4> [237.070835] ? lock_release+0xd0/0x2b0 <4> [237.070840] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [237.070846] process_one_work+0x239/0x760 <4> [237.070852] worker_thread+0x200/0x3f0 <4> [237.070856] ? __pfx_worker_thread+0x10/0x10 <4> [237.070863] kthread+0x10d/0x150 <4> [237.070866] ? __pfx_kthread+0x10/0x10 <4> [237.070870] ret_from_fork+0x3d4/0x480 <4> [237.070872] ? __pfx_kthread+0x10/0x10 <4> [237.070876] ret_from_fork_asm+0x1a/0x30 <4> [237.070883] </TASK> <4> [237.070885] irq event stamp: 237343 <4> [237.070886] hardirqs last enabled at (237349): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [237.070889] hardirqs last disabled at (237354): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [237.070892] softirqs last enabled at (236108): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [237.070894] softirqs last disabled at (236099): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [237.070897] ---[ end trace 0000000000000000 ]--- <7> [237.071954] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [237.072058] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [237.102724] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16983, lrc_seqno=16983, guc_id=0, flags=0x73 in no process [-1] <7> [237.102729] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [237.102798] ------------[ cut here ]------------ <4> [237.102799] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [237.102801] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:16/3246 <4> [237.102887] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [237.102967] autofs4 [last unloaded: snd_hda_intel] <4> [237.102972] CPU: 10 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [237.102976] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [237.102977] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [237.102979] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [237.102985] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [237.103056] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [237.103058] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [237.103061] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [237.103063] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [237.103064] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [237.103066] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [237.103067] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [237.103069] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [237.103071] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [237.103072] CR2: 00007a448c066108 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [237.103074] PKRU: 55555554 <4> [237.103076] Call Trace: <4> [237.103077] <TASK> <4> [237.103081] ? lock_acquire+0x20/0x2f0 <4> [237.103088] ? lock_release+0xd0/0x2b0 <4> [237.103093] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [237.103099] process_one_work+0x239/0x760 <4> [237.103106] worker_thread+0x200/0x3f0 <4> [237.103109] ? __pfx_worker_thread+0x10/0x10 <4> [237.103112] kthread+0x10d/0x150 <4> [237.103115] ? __pfx_kthread+0x10/0x10 <4> [237.103119] ret_from_fork+0x3d4/0x480 <4> [237.103122] ? __pfx_kthread+0x10/0x10 <4> [237.103126] ret_from_fork_asm+0x1a/0x30 <4> [237.103133] </TASK> <4> [237.103135] irq event stamp: 238351 <4> [237.103136] hardirqs last enabled at (238357): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [237.103140] hardirqs last disabled at (238362): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [237.103142] softirqs last enabled at (237608): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [237.103145] softirqs last disabled at (237599): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [237.103147] ---[ end trace 0000000000000000 ]--- <6> [237.103149] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [237.103219] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [237.103228] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [237.103325] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [237.103588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [237.103726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [237.104334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [237.104428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [237.104515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [237.104596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [237.104677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [237.104758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [237.104836] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [237.104939] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [237.105052] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [237.106064] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [237.116783] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [237.117044] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [237.118234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [237.118322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [237.118407] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [237.118494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [237.118576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [237.118660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [237.118747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [237.118834] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [237.118937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [237.119022] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [237.119107] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [237.119192] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [237.119277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [237.119361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [237.119442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [237.119523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [237.119610] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [237.119694] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [237.119780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [237.119883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [237.119982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [237.120075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [237.120167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [237.120259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [237.120354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [237.120447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [237.120540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [237.120637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [237.120733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [237.120828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [237.120940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [237.121037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [237.121138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [237.121236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [237.121332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [237.121426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [237.121517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [237.121609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [237.121695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [237.121779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [237.121874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [237.121958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [237.122044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [237.122128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [237.122217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [237.122298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [237.122380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [237.122459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [237.122541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [237.122619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [237.122697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [237.122778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [237.122854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [237.122948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [237.123028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [237.123108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [237.123183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [237.123259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [237.123336] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [237.123455] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [237.123459] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16983, lrc_seqno=16983, guc_id=0, flags=0x73 in no process [-1] <7> [237.123462] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [237.123524] ------------[ cut here ]------------ <4> [237.123526] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [237.123528] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:68/3544 <4> [237.123598] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [237.123668] autofs4 [last unloaded: snd_hda_intel] <4> [237.123672] CPU: 8 UID: 0 PID: 3544 Comm: kworker/u64:68 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [237.123675] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [237.123677] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [237.123678] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [237.123683] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [237.123753] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [237.123755] RSP: 0018:ffffc90005c77ca0 EFLAGS: 00010246 <4> [237.123757] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [237.123759] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [237.123760] RBP: ffffc90005c77db0 R08: 0000000000000000 R09: 0000000000000000 <4> [237.123761] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [237.123762] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [237.123764] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [237.123765] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [237.123767] CR2: 00007a4496a74000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [237.123768] PKRU: 55555554 <4> [237.123770] Call Trace: <4> [237.123771] <TASK> <4> [237.123775] ? lock_acquire+0x20/0x2f0 <4> [237.123781] ? lock_release+0xd0/0x2b0 <4> [237.123786] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [237.123792] process_one_work+0x239/0x760 <4> [237.123799] worker_thread+0x200/0x3f0 <4> [237.123802] ? __pfx_worker_thread+0x10/0x10 <4> [237.123804] kthread+0x10d/0x150 <4> [237.123807] ? __pfx_kthread+0x10/0x10 <4> [237.123811] ret_from_fork+0x3d4/0x480 <4> [237.123813] ? __pfx_kthread+0x10/0x10 <4> [237.123817] ret_from_fork_asm+0x1a/0x30 <4> [237.123824] </TASK> <4> [237.123825] irq event stamp: 189749 <4> [237.123827] hardirqs last enabled at (189755): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [237.123830] hardirqs last disabled at (189760): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [237.123832] softirqs last enabled at (188618): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [237.123834] softirqs last disabled at (188613): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [237.123837] ---[ end trace 0000000000000000 ]--- <6> [237.123838] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [237.123915] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [237.123921] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [237.125111] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [237.125214] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [237.125315] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [237.125518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [237.125605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [237.125695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [237.125777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [237.125863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [237.125942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [237.126022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [237.126102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [237.126176] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [237.126268] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [237.126381] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [237.127387] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [237.137864] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [237.138112] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [237.139321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [237.139396] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [237.139467] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [237.139539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [237.139611] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [237.139682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [237.139751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [237.139820] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [237.139917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [237.139987] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [237.140055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [237.140124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [237.140193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [237.140262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [237.140330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [237.140399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [237.140469] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [237.140537] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [237.140604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [237.140681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [237.140755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [237.140827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [237.140913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [237.140984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [237.141054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [237.141124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [237.141193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [237.141268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [237.141341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [237.141414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [237.141485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [237.141555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [237.141631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [237.141706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [237.141782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [237.141861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [237.141934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [237.142005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [237.142075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [237.142143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [237.142215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [237.142286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [237.142357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [237.142426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [237.142499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [237.142568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [237.142637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [237.142704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [237.142775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [237.142845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [237.142926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [237.143000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [237.143068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [237.143139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [237.143206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [237.143275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [237.143343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [237.143410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [237.143481] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [237.143597] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [237.143600] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16983, lrc_seqno=16983, guc_id=0, flags=0x73 in no process [-1] <7> [237.143603] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [237.143660] ------------[ cut here ]------------ <4> [237.143662] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [237.143663] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:16/3246 <4> [237.143733] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [237.143796] autofs4 [last unloaded: snd_hda_intel] <4> [237.143800] CPU: 10 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [237.143803] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [237.143805] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [237.143806] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [237.143811] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [237.143883] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [237.143885] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [237.143888] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [237.143889] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [237.143891] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [237.143892] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [237.143894] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [237.143896] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [237.143897] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [237.143899] CR2: 00007a448c066108 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [237.143901] PKRU: 55555554 <4> [237.143902] Call Trace: <4> [237.143904] <TASK> <4> [237.143908] ? lock_acquire+0x20/0x2f0 <4> [237.143914] ? lock_release+0xd0/0x2b0 <4> [237.143919] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [237.143925] process_one_work+0x239/0x760 <4> [237.143932] worker_thread+0x200/0x3f0 <4> [237.143935] ? __pfx_worker_thread+0x10/0x10 <4> [237.143937] kthread+0x10d/0x150 <4> [237.143941] ? __pfx_kthread+0x10/0x10 <4> [237.143944] ret_from_fork+0x3d4/0x480 <4> [237.143947] ? __pfx_kthread+0x10/0x10 <4> [237.143950] ret_from_fork_asm+0x1a/0x30 <4> [237.143958] </TASK> <4> [237.143960] irq event stamp: 242237 <4> [237.143961] hardirqs last enabled at (242243): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [237.143964] hardirqs last disabled at (242248): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [237.143967] softirqs last enabled at (241126): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [237.143969] softirqs last disabled at (241117): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [237.143972] ---[ end trace 0000000000000000 ]--- <7> [237.145030] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [237.145147] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [237.175474] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16985, lrc_seqno=16985, guc_id=0, flags=0x73 in no process [-1] <7> [237.175480] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [237.175548] ------------[ cut here ]------------ <4> [237.175550] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [237.175552] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:68/3544 <4> [237.175625] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [237.175695] autofs4 [last unloaded: snd_hda_intel] <4> [237.175699] CPU: 3 UID: 0 PID: 3544 Comm: kworker/u64:68 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [237.175702] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [237.175704] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [237.175705] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [237.175711] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [237.175782] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [237.175783] RSP: 0018:ffffc90005c77ca0 EFLAGS: 00010246 <4> [237.175786] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [237.175787] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [237.175789] RBP: ffffc90005c77db0 R08: 0000000000000000 R09: 0000000000000000 <4> [237.175790] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [237.175791] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [237.175792] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000 <4> [237.175794] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [237.175795] CR2: 00007a4496a6c000 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [237.175797] PKRU: 55555554 <4> [237.175798] Call Trace: <4> [237.175799] <TASK> <4> [237.175803] ? lock_acquire+0x20/0x2f0 <4> [237.175810] ? lock_release+0xd0/0x2b0 <4> [237.175815] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [237.175820] process_one_work+0x239/0x760 <4> [237.175827] worker_thread+0x200/0x3f0 <4> [237.175830] ? __pfx_worker_thread+0x10/0x10 <4> [237.175833] kthread+0x10d/0x150 <4> [237.175836] ? __pfx_kthread+0x10/0x10 <4> [237.175839] ret_from_fork+0x3d4/0x480 <4> [237.175842] ? __pfx_kthread+0x10/0x10 <4> [237.175845] ret_from_fork_asm+0x1a/0x30 <4> [237.175853] </TASK> <4> [237.175854] irq event stamp: 191617 <4> [237.175866] hardirqs last enabled at (191633): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [237.175871] hardirqs last disabled at (191638): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [237.175876] softirqs last enabled at (191628): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [237.175881] softirqs last disabled at (191621): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [237.175885] ---[ end trace 0000000000000000 ]--- <6> [237.175889] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [237.176013] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [237.176028] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [237.176122] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [237.176372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [237.176497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [237.176625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [237.176744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [237.176839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [237.176943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [237.177025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [237.177109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [237.177187] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [237.177293] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [237.177445] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [237.178509] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [237.189223] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [237.189478] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [237.190628] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [237.190724] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [237.190810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [237.190917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [237.191052] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [237.191180] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [237.191308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [237.191440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [237.191576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [237.191677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [237.191766] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [237.191854] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [237.191970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [237.192109] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [237.192245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [237.192391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [237.192532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [237.192669] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [237.192804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [237.192969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [237.193077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [237.193174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [237.193264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [237.193351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [237.193471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [237.193601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [237.193733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [237.193875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [237.194013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [237.194150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [237.194248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [237.194333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [237.194418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [237.194501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [237.194616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [237.194738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [237.194865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [237.194984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [237.195098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [237.195210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [237.195297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [237.195371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [237.195442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [237.195511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [237.195608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [237.195722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [237.195831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [237.195967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [237.196082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [237.196192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [237.196296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [237.196376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [237.196449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [237.196519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [237.196587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [237.196656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [237.196762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [237.196876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [237.196992] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [237.197151] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [237.197158] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16985, lrc_seqno=16985, guc_id=0, flags=0x73 in no process [-1] <7> [237.197162] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [237.197251] ------------[ cut here ]------------ <4> [237.197253] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [237.197256] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:68/3544 <4> [237.197357] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [237.197425] autofs4 [last unloaded: snd_hda_intel] <4> [237.197429] CPU: 3 UID: 0 PID: 3544 Comm: kworker/u64:68 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [237.197432] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [237.197433] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [237.197435] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [237.197440] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [237.197510] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [237.197512] RSP: 0018:ffffc90005c77ca0 EFLAGS: 00010246 <4> [237.197514] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [237.197516] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [237.197517] RBP: ffffc90005c77db0 R08: 0000000000000000 R09: 0000000000000000 <4> [237.197518] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [237.197520] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [237.197521] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000 <4> [237.197523] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [237.197524] CR2: 00007a4496a6c000 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [237.197526] PKRU: 55555554 <4> [237.197527] Call Trace: <4> [237.197528] <TASK> <4> [237.197532] ? lock_acquire+0x20/0x2f0 <4> [237.197537] ? lock_release+0xd0/0x2b0 <4> [237.197543] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [237.197548] process_one_work+0x239/0x760 <4> [237.197554] worker_thread+0x200/0x3f0 <4> [237.197557] ? __pfx_worker_thread+0x10/0x10 <4> [237.197560] kthread+0x10d/0x150 <4> [237.197563] ? __pfx_kthread+0x10/0x10 <4> [237.197566] ret_from_fork+0x3d4/0x480 <4> [237.197569] ? __pfx_kthread+0x10/0x10 <4> [237.197572] ret_from_fork_asm+0x1a/0x30 <4> [237.197580] </TASK> <4> [237.197581] irq event stamp: 194773 <4> [237.197582] hardirqs last enabled at (194779): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [237.197585] hardirqs last disabled at (194784): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [237.197587] softirqs last enabled at (193640): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [237.197590] softirqs last disabled at (193631): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [237.197592] ---[ end trace 0000000000000000 ]--- <6> [237.197594] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [237.197660] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [237.197667] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [237.198881] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [237.199022] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [237.199183] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [237.199405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [237.199502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [237.199597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [237.199683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [237.199769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [237.199852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [237.199954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [237.200032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [237.200107] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [237.200198] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [237.200311] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [237.201318] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [237.212045] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [237.212294] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [237.213498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [237.213572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [237.213643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [237.213716] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [237.213787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [237.213862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [237.213930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [237.213997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [237.214064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [237.214131] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [237.214199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [237.214269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [237.214339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [237.214406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [237.214473] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [237.214540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [237.214606] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [237.214673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [237.214739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [237.214814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [237.214897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [237.214970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [237.215042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [237.215110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [237.215179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [237.215246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [237.215314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [237.215383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [237.215454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [237.215522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [237.215591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [237.215661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [237.215735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [237.215808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [237.215889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [237.215964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [237.216033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [237.216100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [237.216168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [237.216234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [237.216303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [237.216370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [237.216439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [237.216505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [237.216576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [237.216642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [237.216709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [237.216776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [237.216846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [237.216928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [237.216997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [237.217065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [237.217132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [237.217202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [237.217270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [237.217340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [237.217408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [237.217476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [237.217546] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [237.217659] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [237.217663] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16985, lrc_seqno=16985, guc_id=0, flags=0x73 in no process [-1] <7> [237.217666] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [237.217723] ------------[ cut here ]------------ <4> [237.217725] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [237.217726] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:68/3544 <4> [237.217794] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [237.217863] autofs4 [last unloaded: snd_hda_intel] <4> [237.217868] CPU: 4 UID: 0 PID: 3544 Comm: kworker/u64:68 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [237.217871] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [237.217873] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [237.217874] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [237.217880] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [237.217946] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [237.217948] RSP: 0018:ffffc90005c77ca0 EFLAGS: 00010246 <4> [237.217950] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [237.217952] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [237.217953] RBP: ffffc90005c77db0 R08: 0000000000000000 R09: 0000000000000000 <4> [237.217954] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [237.217955] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [237.217957] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [237.217958] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [237.217960] CR2: 000076c648fd1000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [237.217961] PKRU: 55555554 <4> [237.217962] Call Trace: <4> [237.217963] <TASK> <4> [237.217968] ? lock_acquire+0x20/0x2f0 <4> [237.217973] ? lock_release+0xd0/0x2b0 <4> [237.217978] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [237.217984] process_one_work+0x239/0x760 <4> [237.217990] worker_thread+0x200/0x3f0 <4> [237.217993] ? __pfx_worker_thread+0x10/0x10 <4> [237.217995] kthread+0x10d/0x150 <4> [237.217998] ? __pfx_kthread+0x10/0x10 <4> [237.218002] ret_from_fork+0x3d4/0x480 <4> [237.218004] ? __pfx_kthread+0x10/0x10 <4> [237.218007] ret_from_fork_asm+0x1a/0x30 <4> [237.218014] </TASK> <4> [237.218016] irq event stamp: 197941 <4> [237.218017] hardirqs last enabled at (197947): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [237.218019] hardirqs last disabled at (197952): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [237.218022] softirqs last enabled at (197030): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [237.218024] softirqs last disabled at (197023): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [237.218026] ---[ end trace 0000000000000000 ]--- <7> [237.219210] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [237.219356] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [237.250179] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16987, lrc_seqno=16987, guc_id=0, flags=0x73 in no process [-1] <7> [237.250183] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [237.250252] ------------[ cut here ]------------ <4> [237.250253] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [237.250255] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:16/3246 <4> [237.250328] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [237.250397] autofs4 [last unloaded: snd_hda_intel] <4> [237.250402] CPU: 10 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [237.250405] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [237.250406] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [237.250407] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [237.250413] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [237.250482] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [237.250484] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [237.250486] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [237.250488] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [237.250490] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [237.250491] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [237.250492] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [237.250493] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [237.250495] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [237.250496] CR2: 00007a448c066108 CR3: 000000011d2b5004 CR4: 0000000000f72ef0 <4> [237.250498] PKRU: 55555554 <4> [237.250499] Call Trace: <4> [237.250500] <TASK> <4> [237.250504] ? lock_acquire+0x20/0x2f0 <4> [237.250511] ? lock_release+0xd0/0x2b0 <4> [237.250516] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [237.250521] process_one_work+0x239/0x760 <4> [237.250528] worker_thread+0x200/0x3f0 <4> [237.250531] ? __pfx_worker_thread+0x10/0x10 <4> [237.250533] kthread+0x10d/0x150 <4> [237.250536] ? __pfx_kthread+0x10/0x10 <4> [237.250540] ret_from_fork+0x3d4/0x480 <4> [237.250542] ? __pfx_kthread+0x10/0x10 <4> [237.250546] ret_from_fork_asm+0x1a/0x30 <4> [237.250553] </TASK> <4> [237.250555] irq event stamp: 244841 <4> [237.250556] hardirqs last enabled at (244847): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [237.250559] hardirqs last disabled at (244852): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [237.250561] softirqs last enabled at (243824): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [237.250563] softirqs last disabled at (243822): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [237.250566] ---[ end trace 0000000000000000 ]--- <6> [237.250568] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [237.250636] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [237.250644] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [237.250735] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [237.250956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [237.251044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [237.251132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [237.251217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [237.251300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [237.251381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [237.251458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [237.251538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [237.251614] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [237.251705] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [237.251817] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [237.252832] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [237.262862] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [237.263115] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [237.264373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [237.264511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [237.264639] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [237.264774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [237.264918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [237.265053] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [237.265187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [237.265323] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [237.265458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [237.265594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [237.265734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [237.265882] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [237.266025] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [237.266165] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [237.266305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [237.266450] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [237.266597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [237.266748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [237.266904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [237.267066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [237.267225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [237.267381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [237.267540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [237.267693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [237.267842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [237.268001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [237.268152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [237.268300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [237.268448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [237.268590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [237.268732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [237.268880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [237.269031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [237.269174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [237.269312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [237.269445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [237.269575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [237.269703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [237.269829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [237.269955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [237.270083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [237.270208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [237.270332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [237.270454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [237.270582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [237.270706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [237.270829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [237.270956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [237.271081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [237.271203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [237.271326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [237.271452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [237.271576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [237.271699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [237.271822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [237.271950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [237.272074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [237.272197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [237.272325] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [237.272491] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [237.272498] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16987, lrc_seqno=16987, guc_id=0, flags=0x73 in no process [-1] <7> [237.272502] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [237.272603] ------------[ cut here ]------------ <4> [237.272605] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [237.272608] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:16/3246 <4> [237.272720] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [237.272820] autofs4 [last unloaded: snd_hda_intel] <4> [237.272826] CPU: 12 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [237.272830] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [237.272832] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [237.272834] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [237.272842] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [237.272958] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [237.272961] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [237.272964] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [237.272967] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [237.272969] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [237.272971] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [237.272973] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [237.272975] FS: 0000000000000000(0000) GS:ffff8888db297000(0000) knlGS:0000000000000000 <4> [237.272977] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [237.272980] CR2: 00007a4496a77000 CR3: 0000000115abe006 CR4: 0000000000f72ef0 <4> [237.272982] PKRU: 55555554 <4> [237.272984] Call Trace: <4> [237.272986] <TASK> <4> [237.272993] ? lock_acquire+0x20/0x2f0 <4> [237.273002] ? lock_release+0xd0/0x2b0 <4> [237.273011] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [237.273020] process_one_work+0x239/0x760 <4> [237.273031] worker_thread+0x200/0x3f0 <4> [237.273036] ? __pfx_worker_thread+0x10/0x10 <4> [237.273039] kthread+0x10d/0x150 <4> [237.273043] ? __pfx_kthread+0x10/0x10 <4> [237.273049] ret_from_fork+0x3d4/0x480 <4> [237.273052] ? __pfx_kthread+0x10/0x10 <4> [237.273057] ret_from_fork_asm+0x1a/0x30 <4> [237.273069] </TASK> <4> [237.273071] irq event stamp: 248035 <4> [237.273073] hardirqs last enabled at (248041): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [237.273077] hardirqs last disabled at (248046): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [237.273080] softirqs last enabled at (246980): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [237.273083] softirqs last disabled at (246973): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [237.273087] ---[ end trace 0000000000000000 ]--- <6> [237.273099] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [237.273181] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [237.273188] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [237.274693] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [237.274850] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [237.275012] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [237.275217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [237.275305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [237.275393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [237.275474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [237.275552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [237.275628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [237.275705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [237.275783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [237.275859] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [237.275951] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [237.276063] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [237.277072] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [237.287792] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [237.288046] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [237.289240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [237.289314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [237.289386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [237.289456] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [237.289526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [237.289599] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [237.289668] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [237.289736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [237.289804] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [237.289877] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [237.289946] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [237.290014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [237.290082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [237.290149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [237.290218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [237.290286] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [237.290354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [237.290422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [237.290490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [237.290566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [237.290641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [237.290714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [237.290787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [237.290862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [237.290936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [237.291006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [237.291077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [237.291149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [237.291223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [237.291296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [237.291368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [237.291440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [237.291516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [237.291593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [237.291670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [237.291744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [237.291815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [237.291892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [237.291961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [237.292030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [237.292102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [237.292173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [237.292242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [237.292309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [237.292383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [237.292451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [237.292520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [237.292584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [237.292652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [237.292723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [237.292789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [237.292862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [237.292931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [237.293001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [237.293067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [237.293136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [237.293202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [237.293268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [237.293339] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [237.293453] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [237.293457] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16987, lrc_seqno=16987, guc_id=0, flags=0x73 in no process [-1] <7> [237.293460] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [237.293519] ------------[ cut here ]------------ <4> [237.293520] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [237.293521] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:16/3246 <4> [237.293589] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [237.293656] autofs4 [last unloaded: snd_hda_intel] <4> [237.293660] CPU: 6 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [237.293663] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [237.293664] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [237.293666] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [237.293671] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [237.293737] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [237.293739] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [237.293741] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [237.293742] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [237.293744] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [237.293745] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [237.293746] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [237.293748] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [237.293749] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [237.293751] CR2: 00007a4496a76000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [237.293752] PKRU: 55555554 <4> [237.293753] Call Trace: <4> [237.293754] <TASK> <4> [237.293759] ? lock_acquire+0x20/0x2f0 <4> [237.293764] ? lock_release+0xd0/0x2b0 <4> [237.293770] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [237.293775] process_one_work+0x239/0x760 <4> [237.293782] worker_thread+0x200/0x3f0 <4> [237.293785] ? __pfx_worker_thread+0x10/0x10 <4> [237.293787] kthread+0x10d/0x150 <4> [237.293790] ? __pfx_kthread+0x10/0x10 <4> [237.293794] ret_from_fork+0x3d4/0x480 <4> [237.293796] ? __pfx_kthread+0x10/0x10 <4> [237.293799] ret_from_fork_asm+0x1a/0x30 <4> [237.293807] </TASK> <4> [237.293808] irq event stamp: 251173 <4> [237.293809] hardirqs last enabled at (251179): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [237.293812] hardirqs last disabled at (251184): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [237.293814] softirqs last enabled at (249962): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [237.293817] softirqs last disabled at (249957): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [237.293819] ---[ end trace 0000000000000000 ]--- <7> [237.295033] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [237.295133] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [237.326161] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16989, lrc_seqno=16989, guc_id=0, flags=0x73 in no process [-1] <7> [237.326165] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [237.326234] ------------[ cut here ]------------ <4> [237.326235] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [237.326237] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:16/3246 <4> [237.326308] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [237.326377] autofs4 [last unloaded: snd_hda_intel] <4> [237.326381] CPU: 6 UID: 0 PID: 3246 Comm: kworker/u64:16 Tainted: G S U W L 7.0.0-rc6-lgci-xe-xe-pw-164212v2-debug+ #1 PREEMPT(lazy) <4> [237.326384] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [237.326385] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [237.326387] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [237.326392] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [237.326461] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [237.326462] RSP: 0018:ffffc900017cbca0 EFLAGS: 00010246 <4> [237.326465] RAX: ffffffffa1202f81 RBX: 0000000000000000 RCX: 0000000000000000 <4> [237.326466] RDX: ffff888103ae9610 RSI: ffffffffa1202f81 RDI: ffffffffa1003ef0 <4> [237.326468] RBP: ffffc900017cbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [237.326469] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [237.326470] R13: ffff888103ae9610 R14: ffff888177c9d018 R15: 00000000ffffffc2 <4> [237.326471] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [237.326473] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [237.326474] CR2: 00007a4496a76000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [237.326476] PKRU: 55555554 <4> [237.326477] Call Trace: <4> [237.326478] <TASK> <4> [237.326482] ? lock_acquire+0x20/0x2f0 <4> [237.326488] ? lock_release+0xd0/0x2b0 <4> [237.326493] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [237.326499] process_one_work+0x239/0x760 <4> [237.326506] worker_thread+0x200/0x3f0 <4> [237.326508] ? __pfx_worker_thread+0x10/0x10 <4> [237.326511] kthread+0x10d/0x150 <4> [237.326514] ? __pfx_kthread+0x10/0x10 <4> [237.326518] ret_from_fork+0x3d4/0x480 <4> [237.326520] ? __pfx_kthread+0x10/0x10 <4> [237.326524] ret_from_fork_asm+0x1a/0x30 <4> [237.326531] </TASK> <4> [237.326533] irq event stamp: 252353 <4> [237.326534] hardirqs last enabled at (252359): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0 <4> [237.326537] hardirqs last disabled at (252364): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0 <4> [237.326539] softirqs last enabled at (251320): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [237.326541] softirqs last disabled at (251318): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [237.326544] ---[ end trace 0000000000000000 ]--- <6> [237.326546] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [237.326612] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [237.326621] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [237.326676] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [237.326946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [237.327087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [237.327227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [237.327362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [237.327494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [237.327625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [237.327756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [237.327896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [237.328028] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [237.328170] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [237.328335] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [237.329718] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [237.339868] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [237.340211] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [237.341533] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [237.341689] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [237.341844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [237.342012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [237.342173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [237.342336] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [237.342499] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [237.342662] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [237.342827] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [237.343004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [237.343177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [237.343350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [237.343528] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [237.343714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [237.343900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [237.344081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [237.344260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [237.344429] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [237.344594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [237.344764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [237.344958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [237.345065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [237.345165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [237.345258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [237.345348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [237.345436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [237.345519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [237.345604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [237.345689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [237.345772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [237.345861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [237.345944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [237.346031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [237.346117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [237.346202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [237.346284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [237.346366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [237.346442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [237.346518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [237.346591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080

<7> [232.193279] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [232.193695] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:153:plane 1B] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [232.280417] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:35:plane 1A] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm

<4> [234.925873] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.926064] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.947192] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.947405] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.967575] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.967727] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.001401] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.001559] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.020859] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.021118] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.041249] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.041415] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.074179] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.074330] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.094106] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.094257] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.113561] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.113711] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.146239] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.146421] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.164967] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.165133] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.184231] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.184379] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.215749] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.215903] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.236760] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.237023] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.256823] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.256974] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.289394] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.289544] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.308481] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.308720] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.329547] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.329692] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.361654] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.361802] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.380168] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.380318] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.399105] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.399248] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.431587] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.431736] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.449712] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.449874] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.468596] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.468741] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.500457] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.500595] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.525294] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.525526] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.544912] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.545062] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.576603] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.576755] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.594741] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.594889] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.614619] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.614769] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.646638] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.646790] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.664757] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.664912] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.683518] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.683661] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.717650] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.717800] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.735829] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.736009] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.755942] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.756095] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.794124] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.794282] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.814052] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.814268] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.833418] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.833574] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.865298] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.865443] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.886646] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.886797] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.905641] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.905786] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.937778] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.937946] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.957011] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.957158] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.976634] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.976779] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.008731] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.008895] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.028699] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.028961] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.048584] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.048734] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.081487] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.081720] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.100732] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.100892] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.120922] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.121068] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.153182] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.153331] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.177408] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.177637] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.198932] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.199079] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.230800] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.230960] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.250536] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.250682] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.269696] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.269851] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.302397] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.302549] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.323175] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.323399] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.343701] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.343846] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.375020] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.375171] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.394480] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.394630] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.417254] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.417514] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.449594] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.449748] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.467891] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.468039] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.486719] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.486863] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.519787] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.519964] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.540337] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.540495] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.559623] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.559771] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.591546] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.591696] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.614802] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.614955] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.634714] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.634861] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.666826] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.666992] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.686797] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.686951] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.711153] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.711380] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.743070] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.743226] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.763066] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.763217] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.782251] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.782394] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.814293] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.814468] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.832755] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.832921] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.851921] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.852066] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.884841] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.885031] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.904041] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.904193] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.924456] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.924602] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.956772] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.956943] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.976623] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.976777] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [236.997375] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [236.997531] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [237.030134] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [237.030367] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [237.050496] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [237.050658] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [237.070659] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [237.070805] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [237.102887] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [237.103056] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [237.123598] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [237.123753] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [237.143733] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [237.143883] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [237.175625] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [237.175782] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [237.197357] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [237.197510] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [237.217794] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [237.217946] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [237.250328] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [237.250482] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [237.272720] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [237.272958] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [237.293589] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [237.293737] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [237.326308] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency binfmt_misc intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp eeepc_wmi spi_nor asus_wmi mtd sparse_keymap mei_pxp platform_profile mei_hdcp wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg r8169 aesni_intel snd_hda_codec rapl snd_hda_core usbhid snd_hwdep intel_cstate hid snd_pcm video realtek nls_iso8859_1 snd_timer i2c_i801 snd spi_intel_pci i2c_mux spi_intel i2c_smbus soundcore idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec wmi pinctrl_alderlake acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [237.326461] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 46 9f 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

Results for igt@kms_big_fb@4-tiled-32bpp-rotate-0