igt@kms_plane_cursor@overlay@pipe-c-dp-2-size-256 on shard-bmg@IGTPW

Detail	Value
Duration	4.28 seconds
Hostname	shard-bmg-4
Igt-Version	IGT-Version: 2.4-g8aca0b828 (x86_64) (Linux: 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ x86_64)
Out	This test caused an abort condition: Kernel badly tainted (0x4244, 0x200) (check dmesg for details): TAINT_WARN: WARN_ON has happened. Starting dynamic subtest: pipe-C-DP-2-size-256 Dynamic subtest pipe-C-DP-2-size-256: SUCCESS (4.283s) Using (pipe D + DP-2) to run the subtest.
Err	Starting dynamic subtest: pipe-C-DP-2-size-256 Dynamic subtest pipe-C-DP-2-size-256: SUCCESS (4.283s)
Dmesg Scroll to first warning	<6> [246.748393] [IGT] kms_plane_cursor: starting dynamic subtest pipe-C-DP-2-size-256 <5> [246.748998] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38187, lrc_seqno=38187, guc_id=0, flags=0x73 in no process [-1] <7> [246.749026] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.749531] ------------[ cut here ]------------ <4> [246.749542] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.749553] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:7/708 <4> [246.750281] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy <7> [246.750340] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:554] <4> [246.750356] gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [246.750918] CPU: 11 UID: 0 PID: 708 Comm: kworker/u64:7 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [246.750940] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.750950] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [246.750961] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.751001] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [246.751504] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [246.751516] RSP: 0018:ffffc900016c3ca0 EFLAGS: 00010246 <4> [246.751534] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.751544] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [246.751554] RBP: ffffc900016c3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.751562] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.751570] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [246.751580] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [246.751592] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.751601] CR2: 0000718d911e3000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [246.751611] PKRU: 55555554 <4> [246.751620] Call Trace: <4> [246.751628] <TASK> <4> [246.751677] ? lock_acquire+0x60/0x300 <4> [246.751714] ? lock_release+0xd0/0x2b0 <4> [246.751749] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.751793] process_one_work+0x239/0x740 <4> [246.751841] worker_thread+0x200/0x3f0 <4> [246.751863] ? __pfx_worker_thread+0x10/0x10 <4> [246.751881] kthread+0x10d/0x150 <4> [246.751897] ? __pfx_kthread+0x10/0x10 <4> [246.751918] ret_from_fork+0x3bd/0x470 <4> [246.751933] ? __pfx_kthread+0x10/0x10 <4> [246.751953] ret_from_fork_asm+0x1a/0x30 <4> [246.752008] </TASK> <4> [246.752017] irq event stamp: 322349 <4> [246.752026] hardirqs last enabled at (322355): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [246.752042] hardirqs last disabled at (322360): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [246.752055] softirqs last enabled at (321918): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.752073] softirqs last disabled at (321913): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.752089] ---[ end trace 0000000000000000 ]--- <7> [246.752283] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:556] <6> [246.752102] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [246.752563] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [246.752628] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [246.752968] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [246.754144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [246.754617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [246.755057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [246.755469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [246.755850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [246.756229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [246.756517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [246.756970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [246.757262] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [246.757577] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [246.757856] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [246.759403] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [246.770254] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [246.770588] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [246.772001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [246.772165] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [246.772319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [246.772471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [246.772619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [246.772807] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [246.772963] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [246.773120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [246.773277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [246.773428] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [246.773575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [246.773745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [246.773893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [246.774034] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [246.774173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [246.774311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [246.774445] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [246.774579] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [246.774733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [246.774881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [246.775026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [246.775161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [246.775292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [246.775425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [246.775555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [246.775703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [246.775826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [246.775946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [246.776064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [246.776185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [246.776302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [246.776415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [246.776527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [246.776644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [246.776762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [246.776878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [246.776988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [246.777095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [246.777197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [246.777296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [246.777395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [246.777517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [246.777621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [246.777741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [246.777841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [246.777935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [246.778029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [246.778117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [246.778204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [246.778292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [246.778381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [246.778464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [246.778550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [246.778639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [246.778723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [246.778810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [246.778895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [246.778975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [246.779052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [246.779134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [246.779213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [246.779289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [246.779368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [246.779446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [246.779520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [246.779593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [246.779679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [246.779758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [246.779836] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [246.779955] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [246.779963] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38187, lrc_seqno=38187, guc_id=0, flags=0x73 in no process [-1] <7> [246.779965] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.780027] ------------[ cut here ]------------ <4> [246.780028] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.780029] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:7/708 <4> [246.780101] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [246.780165] <4> [246.780168] CPU: 11 UID: 0 PID: 708 Comm: kworker/u64:7 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [246.780171] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.780172] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [246.780174] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.780179] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [246.780249] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [246.780250] RSP: 0018:ffffc900016c3ca0 EFLAGS: 00010246 <4> [246.780253] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.780254] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [246.780255] RBP: ffffc900016c3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.780256] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.780257] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [246.780259] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [246.780260] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.780261] CR2: 0000718d911e3000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [246.780263] PKRU: 55555554 <4> [246.780264] Call Trace: <4> [246.780265] <TASK> <4> [246.780269] ? lock_acquire+0x60/0x300 <4> [246.780274] ? lock_release+0xd0/0x2b0 <4> [246.780278] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.780284] process_one_work+0x239/0x740 <4> [246.780291] worker_thread+0x200/0x3f0 <4> [246.780293] ? __pfx_worker_thread+0x10/0x10 <4> [246.780296] kthread+0x10d/0x150 <4> [246.780298] ? __pfx_kthread+0x10/0x10 <4> [246.780301] ret_from_fork+0x3bd/0x470 <4> [246.780303] ? __pfx_kthread+0x10/0x10 <4> [246.780306] ret_from_fork_asm+0x1a/0x30 <4> [246.780313] </TASK> <4> [246.780314] irq event stamp: 325517 <4> [246.780315] hardirqs last enabled at (325523): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [246.780317] hardirqs last disabled at (325528): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [246.780319] softirqs last enabled at (324362): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.780322] softirqs last disabled at (324357): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.780324] ---[ end trace 0000000000000000 ]--- <6> [246.780326] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [246.780393] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [246.780401] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [246.781514] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [246.781617] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [246.781731] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [246.781943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [246.782034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [246.782125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [246.782212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [246.782310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [246.782392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [246.782472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [246.782552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [246.782651] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [246.782755] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [246.782843] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [246.783865] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [246.793640] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [246.793892] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [246.794793] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [246.794871] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [246.794944] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [246.795018] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [246.795091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [246.795161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [246.795231] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [246.795303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [246.795373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [246.795443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [246.795511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [246.795581] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [246.795654] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [246.795727] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [246.795799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [246.795866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [246.795932] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [246.795998] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [246.796065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [246.796143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [246.796221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [246.796296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [246.796369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [246.796442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [246.796514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [246.796585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [246.796671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [246.796741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [246.796810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [246.796883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [246.796956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [246.797027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [246.797099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [246.797170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [246.797245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [246.797321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [246.797399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [246.797472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [246.797549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [246.797619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [246.797703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [246.797776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [246.797847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [246.797923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [246.797997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [246.798069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [246.798146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [246.798220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [246.798291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [246.798363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [246.798437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [246.798507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [246.798577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [246.798652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [246.798724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [246.798798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [246.798868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [246.798937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [246.799005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [246.799078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [246.799149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [246.799219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [246.799288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [246.799357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [246.799427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [246.799496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [246.799565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [246.799636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [246.799706] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [246.799823] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [246.799827] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38187, lrc_seqno=38187, guc_id=0, flags=0x73 in no process [-1] <7> [246.799829] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.799891] ------------[ cut here ]------------ <4> [246.799892] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.799893] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:2/121 <4> [246.799965] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [246.800026] <4> [246.800028] CPU: 4 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [246.800031] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.800032] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [246.800033] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.800039] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [246.800108] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [246.800110] RSP: 0018:ffffc9000056fca0 EFLAGS: 00010246 <4> [246.800112] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.800113] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [246.800114] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.800115] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.800116] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [246.800118] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [246.800119] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.800120] CR2: 000000c00030d000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [246.800122] PKRU: 55555554 <4> [246.800123] Call Trace: <4> [246.800124] <TASK> <4> [246.800127] ? lock_acquire+0x60/0x300 <4> [246.800132] ? lock_release+0xd0/0x2b0 <4> [246.800137] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.800142] process_one_work+0x239/0x740 <4> [246.800149] worker_thread+0x200/0x3f0 <4> [246.800152] ? __pfx_worker_thread+0x10/0x10 <4> [246.800154] kthread+0x10d/0x150 <4> [246.800156] ? __pfx_kthread+0x10/0x10 <4> [246.800159] ret_from_fork+0x3bd/0x470 <4> [246.800161] ? __pfx_kthread+0x10/0x10 <4> [246.800163] ret_from_fork_asm+0x1a/0x30 <4> [246.800171] </TASK> <4> [246.800172] irq event stamp: 713625 <4> [246.800173] hardirqs last enabled at (713631): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [246.800175] hardirqs last disabled at (713636): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [246.800176] softirqs last enabled at (712590): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.800179] softirqs last disabled at (712583): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.800181] ---[ end trace 0000000000000000 ]--- <7> [246.801369] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [246.801471] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [246.807190] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38209, lrc_seqno=38209, guc_id=0, flags=0x73 in no process [-1] <7> [246.807197] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.807318] ------------[ cut here ]------------ <4> [246.807320] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.807322] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#12: kworker/u64:8/983 <4> [246.807448] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [246.807545] <4> [246.807549] CPU: 12 UID: 0 PID: 983 Comm: kworker/u64:8 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [246.807553] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.807555] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [246.807557] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.807566] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [246.807695] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [246.807698] RSP: 0018:ffffc90003173ca0 EFLAGS: 00010246 <4> [246.807702] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.807704] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [246.807706] RBP: ffffc90003173db0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.807708] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.807710] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [246.807712] FS: 0000000000000000(0000) GS:ffff8888db283000(0000) knlGS:0000000000000000 <4> [246.807714] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.807716] CR2: 00007fe398457000 CR3: 00000001227a0000 CR4: 0000000000f52ef0 <4> [246.807719] PKRU: 55555554 <4> [246.807720] Call Trace: <4> [246.807722] <TASK> <4> [246.807729] ? lock_acquire+0x60/0x300 <4> [246.807738] ? lock_release+0xd0/0x2b0 <4> [246.807746] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.807756] process_one_work+0x239/0x740 <4> [246.807767] worker_thread+0x200/0x3f0 <4> [246.807772] ? __pfx_worker_thread+0x10/0x10 <4> [246.807775] kthread+0x10d/0x150 <4> [246.807779] ? __pfx_kthread+0x10/0x10 <4> [246.807783] ret_from_fork+0x3bd/0x470 <4> [246.807787] ? __pfx_kthread+0x10/0x10 <4> [246.807791] ret_from_fork_asm+0x1a/0x30 <4> [246.807803] </TASK> <4> [246.807805] irq event stamp: 1387187 <4> [246.807806] hardirqs last enabled at (1387193): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [246.807810] hardirqs last disabled at (1387198): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [246.807812] softirqs last enabled at (1387026): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.807816] softirqs last disabled at (1387021): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.807820] ---[ end trace 0000000000000000 ]--- <6> [246.807822] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [246.807945] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [246.807955] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [246.808259] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [246.808529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [246.808683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [246.808831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [246.808971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [246.809110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [246.809246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [246.809385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [246.809526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [246.809667] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [246.809818] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [246.809963] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [246.811208] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [246.822014] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [246.822287] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [246.823314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [246.823404] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [246.823485] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [246.823564] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [246.823648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [246.823731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [246.823815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [246.823898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [246.823979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [246.824060] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [246.824140] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [246.824222] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [246.824303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [246.824384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [246.824465] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [246.824546] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [246.824626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [246.824720] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [246.824801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [246.824893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [246.824984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [246.825073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [246.825159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [246.825246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [246.825337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [246.825420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [246.825504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [246.825587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [246.825680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [246.825767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [246.825855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [246.825944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [246.826031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [246.826117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [246.826208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [246.826298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [246.826388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [246.826473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [246.826559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [246.826646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [246.826729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [246.826812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [246.826893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [246.826975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [246.827059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [246.827142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [246.827226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [246.827307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [246.827388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [246.827471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [246.827560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [246.827646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [246.827728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [246.827811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [246.827892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [246.827973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [246.828056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [246.828137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [246.828217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [246.828299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [246.828380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [246.828460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [246.828542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [246.828622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [246.828719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [246.828801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [246.828882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [246.828964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [246.829048] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [246.829179] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [246.829184] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38209, lrc_seqno=38209, guc_id=0, flags=0x73 in no process [-1] <7> [246.829186] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.829259] ------------[ cut here ]------------ <4> [246.829260] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.829262] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:2/121 <4> [246.829346] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [246.829410] <4> [246.829413] CPU: 2 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [246.829416] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.829417] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [246.829418] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.829424] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [246.829515] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [246.829517] RSP: 0000:ffffc9000056fca0 EFLAGS: 00010246 <4> [246.829519] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.829521] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [246.829522] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.829523] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.829525] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [246.829526] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [246.829527] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.829529] CR2: 000000c000427000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [246.829530] PKRU: 55555554 <4> [246.829531] Call Trace: <4> [246.829533] <TASK> <4> [246.829537] ? lock_acquire+0x60/0x300 <4> [246.829542] ? lock_release+0xd0/0x2b0 <4> [246.829547] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.829554] process_one_work+0x239/0x740 <4> [246.829560] worker_thread+0x200/0x3f0 <4> [246.829563] ? __pfx_worker_thread+0x10/0x10 <4> [246.829566] kthread+0x10d/0x150 <4> [246.829568] ? __pfx_kthread+0x10/0x10 <4> [246.829571] ret_from_fork+0x3bd/0x470 <4> [246.829573] ? __pfx_kthread+0x10/0x10 <4> [246.829576] ret_from_fork_asm+0x1a/0x30 <4> [246.829583] </TASK> <4> [246.829584] irq event stamp: 717745 <4> [246.829586] hardirqs last enabled at (717751): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [246.829588] hardirqs last disabled at (717756): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [246.829590] softirqs last enabled at (716868): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.829593] softirqs last disabled at (716857): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.829595] ---[ end trace 0000000000000000 ]--- <6> [246.830615] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [246.830709] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [246.830715] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [246.830770] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [246.830887] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [246.831005] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [246.831225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [246.831326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [246.831428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [246.831522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [246.831615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [246.831718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [246.831811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [246.831905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [246.831994] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [246.832099] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [246.832199] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [246.833237] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [246.843640] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [246.843899] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [246.844886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [246.844977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [246.845063] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [246.845149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [246.845230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [246.845312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [246.845394] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [246.845477] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [246.845561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [246.845647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [246.845731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [246.845811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [246.845891] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [246.845971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [246.846052] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [246.846131] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [246.846213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [246.846293] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [246.846373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [246.846461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [246.846552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [246.846643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [246.846728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [246.846813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [246.846898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [246.846980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [246.847063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [246.847150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [246.847234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [246.847319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [246.847405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [246.847488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [246.847572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [246.847658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [246.847747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [246.847835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [246.847924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [246.848009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [246.848090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [246.848171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [246.848251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [246.848337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [246.848421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [246.848503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [246.848588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [246.848680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [246.848767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [246.848852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [246.848935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [246.849019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [246.849105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [246.849187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [246.849270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [246.849352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [246.849432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [246.849515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [246.849598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [246.849687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [246.849768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [246.849852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [246.849932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [246.850013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [246.850094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [246.850175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [246.850257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [246.850338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [246.850417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [246.850497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [246.850581] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [246.850713] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [246.850717] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38209, lrc_seqno=38209, guc_id=0, flags=0x73 in no process [-1] <7> [246.850720] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.850792] ------------[ cut here ]------------ <4> [246.850793] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.850795] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:2/121 <4> [246.850878] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [246.850942] <4> [246.850944] CPU: 2 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [246.850947] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.850948] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [246.850949] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.850955] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [246.851035] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [246.851037] RSP: 0000:ffffc9000056fca0 EFLAGS: 00010246 <4> [246.851039] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.851041] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [246.851042] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.851043] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.851045] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [246.851046] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [246.851048] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.851049] CR2: 000000c000427000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [246.851051] PKRU: 55555554 <4> [246.851052] Call Trace: <4> [246.851053] <TASK> <4> [246.851057] ? lock_acquire+0x60/0x300 <4> [246.851062] ? lock_release+0xd0/0x2b0 <4> [246.851067] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.851073] process_one_work+0x239/0x740 <4> [246.851080] worker_thread+0x200/0x3f0 <4> [246.851083] ? __pfx_worker_thread+0x10/0x10 <4> [246.851086] kthread+0x10d/0x150 <4> [246.851088] ? __pfx_kthread+0x10/0x10 <4> [246.851091] ret_from_fork+0x3bd/0x470 <4> [246.851093] ? __pfx_kthread+0x10/0x10 <4> [246.851096] ret_from_fork_asm+0x1a/0x30 <4> [246.851103] </TASK> <4> [246.851104] irq event stamp: 720909 <4> [246.851106] hardirqs last enabled at (720915): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [246.851108] hardirqs last disabled at (720920): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [246.851109] softirqs last enabled at (719986): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.851113] softirqs last disabled at (719979): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.851115] ---[ end trace 0000000000000000 ]--- <7> [246.852300] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [246.852424] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [246.853456] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38210, lrc_seqno=38210, guc_id=0, flags=0x73 in no process [-1] <7> [246.853459] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.853534] ------------[ cut here ]------------ <4> [246.853535] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.853536] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:2/121 <4> [246.853620] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [246.853689] <4> [246.853691] CPU: 2 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [246.853694] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.853695] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [246.853697] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [246.853729] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:558] <4> [246.853703] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [246.853785] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [246.853786] RSP: 0000:ffffc9000056fca0 EFLAGS: 00010246 <4> [246.853788] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.853790] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [246.853791] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.853792] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.853794] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [246.853795] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [246.853796] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.853798] CR2: 000000c000427000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [246.853799] PKRU: 55555554 <4> [246.853800] Call Trace: <4> [246.853801] <TASK> <4> [246.853805] ? lock_acquire+0x60/0x300 <4> [246.853810] ? lock_release+0xd0/0x2b0 <4> [246.853815] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.853821] process_one_work+0x239/0x740 <4> [246.853828] worker_thread+0x200/0x3f0 <4> [246.853831] ? __pfx_worker_thread+0x10/0x10 <4> [246.853834] kthread+0x10d/0x150 <4> [246.853836] ? __pfx_kthread+0x10/0x10 <4> [246.853839] ret_from_fork+0x3bd/0x470 <4> [246.853841] ? __pfx_kthread+0x10/0x10 <4> [246.853844] ret_from_fork_asm+0x1a/0x30 <4> [246.853852] </TASK> <4> [246.853853] irq event stamp: 721797 <4> [246.853854] hardirqs last enabled at (721803): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [246.853856] hardirqs last disabled at (721808): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [246.853858] softirqs last enabled at (721144): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.853860] softirqs last disabled at (721139): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.853863] ---[ end trace 0000000000000000 ]--- <6> [246.853864] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [246.853945] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [246.853952] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [246.854141] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [246.854403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [246.854549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [246.854716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [246.854827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [246.854927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [246.855023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [246.855115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [246.855205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [246.855291] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [246.855392] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [246.855514] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [246.856608] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [246.866659] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [246.866917] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [246.868004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [246.868114] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [246.868207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [246.868294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [246.868380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [246.868465] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [246.868551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [246.868645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [246.868729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [246.868811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [246.868893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [246.868975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [246.869056] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [246.869137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [246.869219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [246.869299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [246.869380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [246.869461] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [246.869543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [246.869644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [246.869735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [246.869822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [246.869908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [246.869995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [246.870086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [246.870170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [246.870252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [246.870334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [246.870414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [246.870498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [246.870583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [246.870674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [246.870757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [246.870841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [246.870930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [246.871018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [246.871106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [246.871189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [246.871272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [246.871356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [246.871438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [246.871523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [246.871604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [246.871694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [246.871776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [246.871859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [246.871943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [246.872024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [246.872104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [246.872186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [246.872270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [246.872355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [246.872437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [246.872520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [246.872605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [246.872698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [246.872781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [246.872863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [246.872943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [246.873027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [246.873108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [246.873191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [246.873272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [246.873353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [246.873436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [246.873521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [246.873604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [246.873693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [246.873779] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [246.873909] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [246.873914] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38210, lrc_seqno=38210, guc_id=0, flags=0x73 in no process [-1] <7> [246.873917] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.873991] ------------[ cut here ]------------ <4> [246.873993] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.873994] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:4/203 <4> [246.874078] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [246.874144] <4> [246.874146] CPU: 6 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [246.874150] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.874151] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [246.874152] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.874159] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [246.874239] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [246.874241] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [246.874243] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.874245] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [246.874246] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.874248] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.874249] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [246.874250] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [246.874252] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.874253] CR2: 00007e66a2e83a40 CR3: 00000001227a0000 CR4: 0000000000f52ef0 <4> [246.874255] PKRU: 55555554 <4> [246.874256] Call Trace: <4> [246.874257] <TASK> <4> [246.874262] ? lock_acquire+0x60/0x300 <4> [246.874267] ? lock_release+0xd0/0x2b0 <4> [246.874272] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.874278] process_one_work+0x239/0x740 <4> [246.874285] worker_thread+0x200/0x3f0 <4> [246.874289] ? __pfx_worker_thread+0x10/0x10 <4> [246.874291] kthread+0x10d/0x150 <4> [246.874294] ? __pfx_kthread+0x10/0x10 <4> [246.874297] ret_from_fork+0x3bd/0x470 <4> [246.874299] ? __pfx_kthread+0x10/0x10 <4> [246.874302] ret_from_fork_asm+0x1a/0x30 <4> [246.874310] </TASK> <4> [246.874311] irq event stamp: 241515 <4> [246.874312] hardirqs last enabled at (241521): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [246.874314] hardirqs last disabled at (241526): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [246.874316] softirqs last enabled at (240400): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.874319] softirqs last disabled at (240393): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.874322] ---[ end trace 0000000000000000 ]--- <6> [246.874324] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [246.874403] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [246.874408] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [246.875573] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [246.875701] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [246.875820] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [246.876037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [246.876135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [246.876235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [246.876330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [246.876423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [246.876513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [246.876604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [246.876718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [246.876806] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [246.876912] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [246.877011] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [246.878053] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [246.888644] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [246.888925] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [246.889885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [246.889982] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [246.890072] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [246.890160] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [246.890245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [246.890327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [246.890409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [246.890491] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [246.890575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [246.890665] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [246.890747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [246.890828] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [246.890909] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [246.890991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [246.891071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [246.891151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [246.891232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [246.891313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [246.891394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [246.891486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [246.891578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [246.891672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [246.891758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [246.891845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [246.891931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [246.892015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [246.892098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [246.892181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [246.892265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [246.892350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [246.892436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [246.892520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [246.892605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [246.892698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [246.892790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [246.892884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [246.892975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [246.893062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [246.893148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [246.893227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [246.893310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [246.893393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [246.893474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [246.893556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [246.893642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [246.893727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [246.893811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [246.893892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [246.893973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [246.894057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [246.894142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [246.894224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [246.894309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [246.894394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [246.894476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [246.894558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [246.894643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [246.894723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [246.894801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [246.894885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [246.894966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [246.895048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [246.895130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [246.895210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [246.895293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [246.895375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [246.895456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [246.895535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [246.895616] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [246.895755] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [246.895760] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38210, lrc_seqno=38210, guc_id=0, flags=0x73 in no process [-1] <7> [246.895762] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.895835] ------------[ cut here ]------------ <4> [246.895836] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.895837] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:4/203 <4> [246.895920] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [246.895986] <4> [246.895988] CPU: 6 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [246.895991] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.895992] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [246.895994] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.896000] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [246.896080] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [246.896082] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [246.896085] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.896086] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [246.896087] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.896089] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.896090] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [246.896091] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [246.896093] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.896094] CR2: 00007e66a2e83a40 CR3: 00000001227a0000 CR4: 0000000000f52ef0 <4> [246.896096] PKRU: 55555554 <4> [246.896097] Call Trace: <4> [246.896098] <TASK> <4> [246.896102] ? lock_acquire+0x60/0x300 <4> [246.896108] ? lock_release+0xd0/0x2b0 <4> [246.896113] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.896119] process_one_work+0x239/0x740 <4> [246.896125] worker_thread+0x200/0x3f0 <4> [246.896128] ? __pfx_worker_thread+0x10/0x10 <4> [246.896131] kthread+0x10d/0x150 <4> [246.896133] ? __pfx_kthread+0x10/0x10 <4> [246.896136] ret_from_fork+0x3bd/0x470 <4> [246.896139] ? __pfx_kthread+0x10/0x10 <4> [246.896141] ret_from_fork_asm+0x1a/0x30 <4> [246.896149] </TASK> <4> [246.896150] irq event stamp: 244751 <4> [246.896151] hardirqs last enabled at (244757): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [246.896153] hardirqs last disabled at (244762): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [246.896155] softirqs last enabled at (243572): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.896158] softirqs last disabled at (243565): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.896161] ---[ end trace 0000000000000000 ]--- <7> [246.897364] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [246.897485] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [246.900933] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38223, lrc_seqno=38223, guc_id=0, flags=0x73 in no process [-1] <7> [246.900937] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.901018] ------------[ cut here ]------------ <4> [246.901019] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.901021] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:4/203 <4> [246.901107] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [246.901173] <4> [246.901175] CPU: 6 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [246.901178] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.901179] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [246.901180] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.901186] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [246.901269] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [246.901270] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [246.901273] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.901274] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [246.901275] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.901276] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.901277] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [246.901279] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [246.901280] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.901282] CR2: 00007e66a2e83a40 CR3: 00000001227a0000 CR4: 0000000000f52ef0 <4> [246.901283] PKRU: 55555554 <4> [246.901284] Call Trace: <4> [246.901285] <TASK> <4> [246.901289] ? lock_acquire+0x60/0x300 <4> [246.901294] ? lock_release+0xd0/0x2b0 <4> [246.901299] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.901305] process_one_work+0x239/0x740 <4> [246.901312] worker_thread+0x200/0x3f0 <4> [246.901315] ? __pfx_worker_thread+0x10/0x10 <4> [246.901317] kthread+0x10d/0x150 <4> [246.901320] ? __pfx_kthread+0x10/0x10 <4> [246.901322] ret_from_fork+0x3bd/0x470 <4> [246.901325] ? __pfx_kthread+0x10/0x10 <4> [246.901327] ret_from_fork_asm+0x1a/0x30 <4> [246.901335] </TASK> <4> [246.901336] irq event stamp: 245835 <4> [246.901337] hardirqs last enabled at (245841): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [246.901340] hardirqs last disabled at (245846): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [246.901341] softirqs last enabled at (243572): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.901344] softirqs last disabled at (243565): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.901347] ---[ end trace 0000000000000000 ]--- <6> [246.901349] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [246.901430] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [246.901437] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [246.901720] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [246.901940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [246.902042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [246.902146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [246.902246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [246.902340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [246.902432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [246.902524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [246.902616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [246.902717] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [246.902824] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [246.902924] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [246.903964] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [246.914670] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [246.914934] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [246.915948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [246.916039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [246.916125] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [246.916211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [246.916297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [246.916383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [246.916469] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [246.916553] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [246.916640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [246.916722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [246.916803] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [246.916885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [246.916966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [246.917046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [246.917125] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [246.917205] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [246.917285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [246.917363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [246.917442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [246.917533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [246.917624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [246.917737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [246.917823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [246.917908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [246.917996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [246.918079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [246.918162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [246.918245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [246.918327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [246.918412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [246.918497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [246.918582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [246.918674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [246.918759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [246.918848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [246.918937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [246.919028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [246.919114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [246.919199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [246.919282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [246.919364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [246.919446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [246.919528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [246.919610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [246.919719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [246.919805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [246.919889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [246.919971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [246.920052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [246.920133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [246.920218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [246.920300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [246.920383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [246.920465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [246.920544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [246.920626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [246.920719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [246.920799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [246.920880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [246.920963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [246.921045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [246.921127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [246.921209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [246.921289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [246.921371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [246.921453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [246.921533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [246.921611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [246.921702] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [246.921829] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [246.921833] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38223, lrc_seqno=38223, guc_id=0, flags=0x73 in no process [-1] <7> [246.921836] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.921907] ------------[ cut here ]------------ <4> [246.921909] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.921910] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:2/121 <4> [246.921993] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [246.922058] <4> [246.922060] CPU: 2 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [246.922063] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.922064] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [246.922066] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.922072] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [246.922152] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [246.922153] RSP: 0000:ffffc9000056fca0 EFLAGS: 00010246 <4> [246.922156] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.922157] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [246.922158] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.922160] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.922161] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [246.922162] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [246.922164] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.922165] CR2: 000000c000427000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [246.922167] PKRU: 55555554 <4> [246.922168] Call Trace: <4> [246.922169] <TASK> <4> [246.922173] ? lock_acquire+0x60/0x300 <4> [246.922178] ? lock_release+0xd0/0x2b0 <4> [246.922183] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.922189] process_one_work+0x239/0x740 <4> [246.922196] worker_thread+0x200/0x3f0 <4> [246.922199] ? __pfx_worker_thread+0x10/0x10 <4> [246.922202] kthread+0x10d/0x150 <4> [246.922204] ? __pfx_kthread+0x10/0x10 <4> [246.922207] ret_from_fork+0x3bd/0x470 <4> [246.922209] ? __pfx_kthread+0x10/0x10 <4> [246.922212] ret_from_fork_asm+0x1a/0x30 <4> [246.922220] </TASK> <4> [246.922221] irq event stamp: 726253 <4> [246.922222] hardirqs last enabled at (726259): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [246.922224] hardirqs last disabled at (726264): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [246.922226] softirqs last enabled at (725146): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.922229] softirqs last disabled at (725139): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.922232] ---[ end trace 0000000000000000 ]--- <6> [246.922233] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [246.922314] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [246.922320] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [246.923426] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [246.923546] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [246.923665] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [246.923884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [246.923985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [246.924087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [246.924184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [246.924277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [246.924368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [246.924459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [246.924550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [246.924642] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [246.924748] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [246.924848] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [246.925888] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [246.935640] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [246.935901] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [246.936910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [246.937001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [246.937087] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [246.937173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [246.937257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [246.937339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [246.937420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [246.937502] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [246.937583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [246.937672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [246.937753] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [246.937834] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [246.937914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [246.937995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [246.938076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [246.938156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [246.938237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [246.938318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [246.938399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [246.938489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [246.938579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [246.938678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [246.938765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [246.938851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [246.938935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [246.939018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [246.939100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [246.939182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [246.939264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [246.939348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [246.939434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [246.939519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [246.939604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [246.939697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [246.939791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [246.939884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [246.939975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [246.940060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [246.940149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [246.940231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [246.940312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [246.940395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [246.940475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [246.940557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [246.940644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [246.940727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [246.940808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [246.940889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [246.940967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [246.941048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [246.941131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [246.941213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [246.941299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [246.941381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [246.941461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [246.941541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [246.941623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [246.941723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [246.941805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [246.941888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [246.941971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [246.942054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [246.942139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [246.942222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [246.942304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [246.942385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [246.942468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [246.942550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [246.942639] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [246.942767] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [246.942771] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38223, lrc_seqno=38223, guc_id=0, flags=0x73 in no process [-1] <7> [246.942773] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.942845] ------------[ cut here ]------------ <4> [246.942846] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.942847] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:4/203 <4> [246.942930] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [246.942993] <4> [246.942995] CPU: 6 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [246.942998] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.943000] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [246.943001] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.943007] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [246.943087] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [246.943089] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [246.943091] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.943093] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [246.943094] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.943095] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.943096] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [246.943098] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [246.943099] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.943101] CR2: 00007e66a2e83a40 CR3: 00000001227a0000 CR4: 0000000000f52ef0 <4> [246.943102] PKRU: 55555554 <4> [246.943103] Call Trace: <4> [246.943105] <TASK> <4> [246.943108] ? lock_acquire+0x60/0x300 <4> [246.943113] ? lock_release+0xd0/0x2b0 <4> [246.943118] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.943124] process_one_work+0x239/0x740 <4> [246.943131] worker_thread+0x200/0x3f0 <4> [246.943134] ? __pfx_worker_thread+0x10/0x10 <4> [246.943137] kthread+0x10d/0x150 <4> [246.943139] ? __pfx_kthread+0x10/0x10 <4> [246.943142] ret_from_fork+0x3bd/0x470 <4> [246.943144] ? __pfx_kthread+0x10/0x10 <4> [246.943147] ret_from_fork_asm+0x1a/0x30 <4> [246.943154] </TASK> <4> [246.943155] irq event stamp: 249419 <4> [246.943156] hardirqs last enabled at (249425): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [246.943159] hardirqs last disabled at (249430): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [246.943160] softirqs last enabled at (248496): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.943163] softirqs last disabled at (248451): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.943166] ---[ end trace 0000000000000000 ]--- <7> [246.944201] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [246.944327] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [246.945412] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38224, lrc_seqno=38224, guc_id=0, flags=0x73 in no process [-1] <7> [246.945441] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:560] <7> [246.945417] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.945505] ------------[ cut here ]------------ <4> [246.945507] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.945509] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:7/708 <4> [246.945600] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [246.945679] <4> [246.945682] CPU: 1 UID: 0 PID: 708 Comm: kworker/u64:7 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [246.945685] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.945686] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [246.945688] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.945694] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [246.945773] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [246.945775] RSP: 0018:ffffc900016c3ca0 EFLAGS: 00010246 <4> [246.945777] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.945779] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [246.945780] RBP: ffffc900016c3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.945782] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.945783] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [246.945784] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [246.945786] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.945787] CR2: 0000718d911e3000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [246.945789] PKRU: 55555554 <4> [246.945790] Call Trace: <4> [246.945791] <TASK> <4> [246.945795] ? lock_acquire+0x60/0x300 <4> [246.945800] ? lock_release+0xd0/0x2b0 <4> [246.945805] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.945811] process_one_work+0x239/0x740 <4> [246.945818] worker_thread+0x200/0x3f0 <4> [246.945821] ? __pfx_worker_thread+0x10/0x10 <4> [246.945824] kthread+0x10d/0x150 <4> [246.945826] ? __pfx_kthread+0x10/0x10 <4> [246.945829] ret_from_fork+0x3bd/0x470 <4> [246.945832] ? __pfx_kthread+0x10/0x10 <4> [246.945834] ret_from_fork_asm+0x1a/0x30 <4> [246.945842] </TASK> <4> [246.945843] irq event stamp: 327697 <4> [246.945844] hardirqs last enabled at (327703): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [246.945846] hardirqs last disabled at (327708): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [246.945848] softirqs last enabled at (327208): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.945851] softirqs last disabled at (327203): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.945853] ---[ end trace 0000000000000000 ]--- <6> [246.945855] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [246.945933] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [246.945941] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [246.946143] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [246.946418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [246.946533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [246.946650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [246.946774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [246.946884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [246.946973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [246.947061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [246.947149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [246.947233] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [246.947334] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [246.947429] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [246.948621] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [246.958642] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [246.958901] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [246.959921] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [246.960007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [246.960088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [246.960170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [246.960249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [246.960328] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [246.960406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [246.960483] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [246.960560] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [246.960646] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [246.960725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [246.960802] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [246.960879] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [246.960956] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [246.961033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [246.961110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [246.961186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [246.961263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [246.961339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [246.961426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [246.961511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [246.961593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [246.961683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [246.961763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [246.961841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [246.961918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [246.962001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [246.962078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [246.962155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [246.962235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [246.962316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [246.962394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [246.962474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [246.962552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [246.962645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [246.962732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [246.962817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [246.962899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [246.962979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [246.963056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [246.963138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [246.963218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [246.963294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [246.963372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [246.963451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [246.963528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [246.963605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [246.963692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [246.963768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [246.963845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [246.963924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [246.964000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [246.964076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [246.964151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [246.964226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [246.964302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [246.964381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [246.964460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [246.964535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [246.964613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [246.964742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [246.964821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [246.964898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [246.964975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [246.965052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [246.965129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [246.965204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [246.965280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [246.965360] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [246.965483] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [246.965487] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38224, lrc_seqno=38224, guc_id=0, flags=0x73 in no process [-1] <7> [246.965490] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.965558] ------------[ cut here ]------------ <4> [246.965559] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.965561] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:4/203 <4> [246.965644] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [246.965712] <4> [246.965714] CPU: 5 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [246.965717] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.965718] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [246.965720] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.965726] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [246.965801] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [246.965803] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [246.965806] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.965807] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [246.965808] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.965809] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.965811] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [246.965812] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [246.965814] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.965815] CR2: 0000718d91dbf000 CR3: 000000020918f000 CR4: 0000000000f52ef0 <4> [246.965816] PKRU: 55555554 <4> [246.965818] Call Trace: <4> [246.965819] <TASK> <4> [246.965823] ? lock_acquire+0x60/0x300 <4> [246.965828] ? lock_release+0xd0/0x2b0 <4> [246.965833] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.965839] process_one_work+0x239/0x740 <4> [246.965846] worker_thread+0x200/0x3f0 <4> [246.965849] ? __pfx_worker_thread+0x10/0x10 <4> [246.965852] kthread+0x10d/0x150 <4> [246.965854] ? __pfx_kthread+0x10/0x10 <4> [246.965857] ret_from_fork+0x3bd/0x470 <4> [246.965859] ? __pfx_kthread+0x10/0x10 <4> [246.965862] ret_from_fork_asm+0x1a/0x30 <4> [246.965869] </TASK> <4> [246.965871] irq event stamp: 252961 <4> [246.965872] hardirqs last enabled at (252967): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [246.965874] hardirqs last disabled at (252972): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [246.965876] softirqs last enabled at (252058): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.965879] softirqs last disabled at (251831): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.965881] ---[ end trace 0000000000000000 ]--- <6> [246.965883] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [246.965959] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [246.965965] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [246.966242] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [246.966452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [246.966542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [246.966642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [246.966730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [246.966817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [246.966903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [246.966990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [246.967077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [246.967164] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [246.967265] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [246.967358] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [246.968396] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [246.978650] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [246.978908] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [246.979874] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [246.979960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [246.980042] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [246.980124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [246.980205] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [246.980284] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [246.980363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [246.980442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [246.980521] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [246.980599] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [246.980689] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [246.980767] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [246.980844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [246.980922] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [246.980997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [246.981073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [246.981149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [246.981224] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [246.981299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [246.981385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [246.981469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [246.981551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [246.981630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [246.981730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [246.981813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [246.981891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [246.981967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [246.982044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [246.982120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [246.982198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [246.982276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [246.982353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [246.982431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [246.982510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [246.982594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [246.982687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [246.982770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [246.982850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [246.982929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [246.983006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [246.983083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [246.983158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [246.983234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [246.983311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [246.983388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [246.983465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [246.983543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [246.983619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [246.983710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [246.983788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [246.983867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [246.983943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [246.984020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [246.984095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [246.984170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [246.984248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [246.984324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [246.984400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [246.984475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [246.984553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [246.984629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [246.984725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [246.984801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [246.984877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [246.984954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [246.985034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [246.985113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [246.985189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [246.985268] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [246.985391] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [246.985395] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38224, lrc_seqno=38224, guc_id=0, flags=0x73 in no process [-1] <7> [246.985397] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.985465] ------------[ cut here ]------------ <4> [246.985466] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.985467] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:4/203 <4> [246.985555] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [246.985619] <4> [246.985621] CPU: 5 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [246.985624] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.985625] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [246.985626] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.985637] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [246.985716] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [246.985717] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [246.985720] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.985721] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [246.985722] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.985724] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.985725] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [246.985726] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [246.985728] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.985729] CR2: 0000718d91dbf000 CR3: 000000020918f000 CR4: 0000000000f52ef0 <4> [246.985730] PKRU: 55555554 <4> [246.985732] Call Trace: <4> [246.985733] <TASK> <4> [246.985737] ? lock_acquire+0x60/0x300 <4> [246.985741] ? lock_release+0xd0/0x2b0 <4> [246.985746] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.985753] process_one_work+0x239/0x740 <4> [246.985759] worker_thread+0x200/0x3f0 <4> [246.985762] ? __pfx_worker_thread+0x10/0x10 <4> [246.985765] kthread+0x10d/0x150 <4> [246.985767] ? __pfx_kthread+0x10/0x10 <4> [246.985770] ret_from_fork+0x3bd/0x470 <4> [246.985772] ? __pfx_kthread+0x10/0x10 <4> [246.985775] ret_from_fork_asm+0x1a/0x30 <4> [246.985782] </TASK> <4> [246.985783] irq event stamp: 256107 <4> [246.985784] hardirqs last enabled at (256113): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [246.985786] hardirqs last disabled at (256118): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [246.985788] softirqs last enabled at (255210): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.985791] softirqs last disabled at (255205): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.985793] ---[ end trace 0000000000000000 ]--- <7> [246.986810] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [246.986920] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [246.990417] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38227, lrc_seqno=38227, guc_id=0, flags=0x73 in no process [-1] <7> [246.990420] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [246.990502] ------------[ cut here ]------------ <4> [246.990503] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [246.990504] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:4/203 <4> [246.990593] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [246.990663] <4> [246.990666] CPU: 6 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [246.990669] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [246.990671] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [246.990672] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [246.990678] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [246.990764] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [246.990766] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [246.990768] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [246.990769] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [246.990771] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [246.990772] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [246.990773] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [246.990774] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [246.990776] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [246.990777] CR2: 00007fe398463000 CR3: 0000000136bff000 CR4: 0000000000f52ef0 <4> [246.990779] PKRU: 55555554 <4> [246.990780] Call Trace: <4> [246.990781] <TASK> <4> [246.990785] ? lock_acquire+0x60/0x300 <4> [246.990790] ? lock_release+0xd0/0x2b0 <4> [246.990795] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [246.990801] process_one_work+0x239/0x740 <4> [246.990807] worker_thread+0x200/0x3f0 <4> [246.990810] ? __pfx_worker_thread+0x10/0x10 <4> [246.990813] kthread+0x10d/0x150 <4> [246.990815] ? __pfx_kthread+0x10/0x10 <4> [246.990818] ret_from_fork+0x3bd/0x470 <4> [246.990820] ? __pfx_kthread+0x10/0x10 <4> [246.990823] ret_from_fork_asm+0x1a/0x30 <4> [246.990831] </TASK> <4> [246.990832] irq event stamp: 257027 <4> [246.990833] hardirqs last enabled at (257033): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [246.990835] hardirqs last disabled at (257038): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [246.990837] softirqs last enabled at (255210): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.990840] softirqs last disabled at (255205): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [246.990842] ---[ end trace 0000000000000000 ]--- <6> [246.990844] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [246.990927] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [246.990934] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [246.991215] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [246.991438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [246.991539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [246.991649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [246.991743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [246.991831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [246.991919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [246.992006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [246.992094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [246.992175] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [246.992276] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [246.992370] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [246.993420] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [247.003646] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [247.003903] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [247.004839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [247.004924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [247.005006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [247.005086] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [247.005165] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [247.005244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [247.005323] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [247.005401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [247.005478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [247.005556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [247.005639] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [247.005717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [247.005794] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [247.005870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [247.005947] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [247.006024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [247.006099] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [247.006174] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [247.006249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [247.006336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [247.006422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [247.006505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [247.006585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [247.006675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [247.006756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [247.006834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [247.006912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [247.006990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [247.007068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [247.007148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [247.007229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [247.007309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [247.007389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [247.007468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [247.007554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [247.007642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [247.007726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [247.007807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [247.007886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [247.007964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [247.008042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [247.008119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [247.008195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [247.008273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [247.008353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [247.008432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [247.008510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [247.008588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [247.008678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [247.008756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [247.008836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [247.008913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [247.008991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [247.009068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [247.009144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [247.009222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [247.009299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [247.009375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [247.009450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [247.009528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [247.009605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [247.009693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [247.009771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [247.009847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [247.009924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [247.010001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [247.010078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [247.010157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [247.010241] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [247.010367] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [247.010371] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38227, lrc_seqno=38227, guc_id=0, flags=0x73 in no process [-1] <7> [247.010374] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.011293] ------------[ cut here ]------------ <4> [247.011294] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.011296] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:7/708 <4> [247.011377] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.011444] <4> [247.011446] CPU: 1 UID: 0 PID: 708 Comm: kworker/u64:7 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.011449] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.011451] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.011452] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.011458] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.011533] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.011535] RSP: 0018:ffffc900016c3ca0 EFLAGS: 00010246 <4> [247.011537] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.011539] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.011540] RBP: ffffc900016c3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.011541] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.011542] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.011544] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [247.011545] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.011547] CR2: 0000718d911e3000 CR3: 0000000136bff000 CR4: 0000000000f52ef0 <4> [247.011548] PKRU: 55555554 <4> [247.011549] Call Trace: <4> [247.011551] <TASK> <4> [247.011555] ? lock_acquire+0x60/0x300 <4> [247.011560] ? lock_release+0xd0/0x2b0 <4> [247.011564] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.011570] process_one_work+0x239/0x740 <4> [247.011577] worker_thread+0x200/0x3f0 <4> [247.011580] ? __pfx_worker_thread+0x10/0x10 <4> [247.011583] kthread+0x10d/0x150 <4> [247.011585] ? __pfx_kthread+0x10/0x10 <4> [247.011588] ret_from_fork+0x3bd/0x470 <4> [247.011590] ? __pfx_kthread+0x10/0x10 <4> [247.011593] ret_from_fork_asm+0x1a/0x30 <4> [247.011601] </TASK> <4> [247.011602] irq event stamp: 331731 <4> [247.011603] hardirqs last enabled at (331737): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.011605] hardirqs last disabled at (331742): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.011607] softirqs last enabled at (330560): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.011610] softirqs last disabled at (330555): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.011612] ---[ end trace 0000000000000000 ]--- <6> [247.011614] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [247.011716] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [247.011722] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [247.011996] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [247.012106] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [247.012217] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [247.012430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [247.012524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [247.012620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [247.012731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [247.012822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [247.012911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [247.013000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [247.013090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [247.013175] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [247.013276] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [247.013370] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [247.014404] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [247.024640] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [247.024896] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [247.025895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [247.025981] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [247.026062] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [247.026144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [247.026222] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [247.026301] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [247.026380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [247.026458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [247.026536] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [247.026614] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [247.026709] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [247.026787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [247.026863] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [247.026940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [247.027016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [247.027091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [247.027167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [247.027244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [247.027320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [247.027407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [247.027491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [247.027571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [247.027658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [247.027738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [247.027818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [247.027895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [247.027971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [247.028048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [247.028125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [247.028203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [247.028283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [247.028360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [247.028439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [247.028517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [247.028601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [247.028697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [247.028781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [247.028864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [247.028944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [247.029021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [247.029099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [247.029177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [247.029253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [247.029330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [247.029409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [247.029485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [247.029563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [247.029648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [247.029725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [247.029801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [247.029881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [247.029958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [247.030036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [247.030111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [247.030186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [247.030263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [247.030341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [247.030417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [247.030493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [247.030571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [247.030649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [247.030725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [247.030803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [247.030882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [247.030962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [247.031040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [247.031117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [247.031192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [247.031271] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [247.031394] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [247.031399] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38227, lrc_seqno=38227, guc_id=0, flags=0x73 in no process [-1] <7> [247.031401] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.031469] ------------[ cut here ]------------ <4> [247.031470] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.031471] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:7/708 <4> [247.031559] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.031623] <4> [247.031625] CPU: 1 UID: 0 PID: 708 Comm: kworker/u64:7 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.031628] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.031629] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.031631] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.031639] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.031716] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.031718] RSP: 0018:ffffc900016c3ca0 EFLAGS: 00010246 <4> [247.031720] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.031721] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.031723] RBP: ffffc900016c3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.031724] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.031725] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.031726] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [247.031728] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.031729] CR2: 0000718d911e3000 CR3: 000000011613b000 CR4: 0000000000f52ef0 <4> [247.031731] PKRU: 55555554 <4> [247.031732] Call Trace: <4> [247.031733] <TASK> <4> [247.031737] ? lock_acquire+0x60/0x300 <4> [247.031742] ? lock_release+0xd0/0x2b0 <4> [247.031746] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.031753] process_one_work+0x239/0x740 <4> [247.031759] worker_thread+0x200/0x3f0 <4> [247.031762] ? __pfx_worker_thread+0x10/0x10 <4> [247.031765] kthread+0x10d/0x150 <4> [247.031767] ? __pfx_kthread+0x10/0x10 <4> [247.031770] ret_from_fork+0x3bd/0x470 <4> [247.031772] ? __pfx_kthread+0x10/0x10 <4> [247.031775] ret_from_fork_asm+0x1a/0x30 <4> [247.031782] </TASK> <4> [247.031783] irq event stamp: 334923 <4> [247.031784] hardirqs last enabled at (334929): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.031786] hardirqs last disabled at (334934): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.031788] softirqs last enabled at (333654): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.031791] softirqs last disabled at (333645): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.031793] ---[ end trace 0000000000000000 ]--- <7> [247.032908] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [247.033020] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [247.034902] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 0) -> ( 0 - 1989), size 0 -> 1989 <7> [247.035047] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:153:plane 1C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm <7> [247.035171] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:153:plane 1C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 1, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [247.035290] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:153:plane 1C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 16, 49, 145, 145, 273, 273, 273, 273, 30, 241, 255 <7> [247.035406] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:153:plane 1C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 19, 55, 161, 161, 302, 302, 0, 0, 31, 267, 267 <7> [247.035541] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 594000 num active planes 1 <7> [247.035734] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000 <7> [247.035855] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000 <7> [247.035964] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624 <5> [247.047417] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38228, lrc_seqno=38228, guc_id=0, flags=0x73 in no process [-1] <7> [247.047421] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.047497] ------------[ cut here ]------------ <4> [247.047498] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.047499] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:7/708 <4> [247.047581] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.047657] <4> [247.047660] CPU: 2 UID: 0 PID: 708 Comm: kworker/u64:7 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.047663] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.047665] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.047667] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.047673] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.047751] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.047753] RSP: 0000:ffffc900016c3ca0 EFLAGS: 00010246 <4> [247.047755] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.047757] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.047758] RBP: ffffc900016c3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.047760] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.047761] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.047763] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [247.047765] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.047766] CR2: 000000c000427000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [247.047768] PKRU: 55555554 <4> [247.047769] Call Trace: <4> [247.047771] <TASK> <4> [247.047775] ? lock_acquire+0x60/0x300 <4> [247.047781] ? lock_release+0xd0/0x2b0 <4> [247.047786] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.047792] process_one_work+0x239/0x740 <4> [247.047799] worker_thread+0x200/0x3f0 <4> [247.047802] ? __pfx_worker_thread+0x10/0x10 <4> [247.047805] kthread+0x10d/0x150 <4> [247.047808] ? __pfx_kthread+0x10/0x10 <4> [247.047811] ret_from_fork+0x3bd/0x470 <4> [247.047813] ? __pfx_kthread+0x10/0x10 <4> [247.047816] ret_from_fork_asm+0x1a/0x30 <4> [247.047824] </TASK> <4> [247.047825] irq event stamp: 336227 <4> [247.047827] hardirqs last enabled at (336233): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.047829] hardirqs last disabled at (336238): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.047831] softirqs last enabled at (335898): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.047834] softirqs last disabled at (335873): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.047837] ---[ end trace 0000000000000000 ]--- <6> [247.047839] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [247.047915] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [247.047923] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [247.048099] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [247.048365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [247.048513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [247.048673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [247.048773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [247.048869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [247.048960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [247.049050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [247.049140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [247.049226] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [247.049328] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [247.049422] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [247.050459] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [247.060645] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [247.060902] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [247.061933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [247.062021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [247.062104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [247.062186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [247.062266] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [247.062345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [247.062423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [247.062501] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [247.062578] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [247.062661] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [247.062738] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [247.062813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [247.062890] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [247.062967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [247.063042] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [247.063118] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [247.063193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [247.063267] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [247.063342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [247.063430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [247.063514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [247.063596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [247.063689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [247.063771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [247.063851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [247.063929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [247.064009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [247.064092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [247.064172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [247.064253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [247.064334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [247.064414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [247.064494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [247.064573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [247.064664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [247.064750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [247.064837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [247.064917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [247.064998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [247.065076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [247.065153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [247.065230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [247.065306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [247.065383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [247.065462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [247.065540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [247.065617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [247.065703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [247.065779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [247.065856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [247.065934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [247.066011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [247.066088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [247.066165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [247.066244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [247.066323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [247.066400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [247.066476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [247.066551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [247.066630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [247.066719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [247.066797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [247.066872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [247.066947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [247.067023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [247.067101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [247.067179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [247.067255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [247.067335] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [247.067459] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [247.067463] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38228, lrc_seqno=38228, guc_id=0, flags=0x73 in no process [-1] <7> [247.067465] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.067533] ------------[ cut here ]------------ <4> [247.067534] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.067535] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:4/203 <4> [247.067614] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.067683] <4> [247.067685] CPU: 2 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.067688] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.067690] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.067691] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.067697] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.067773] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.067775] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [247.067777] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.067778] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.067779] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.067780] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.067782] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.067783] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [247.067785] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.067786] CR2: 000000c000427000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [247.067787] PKRU: 55555554 <4> [247.067789] Call Trace: <4> [247.067790] <TASK> <4> [247.067794] ? lock_acquire+0x60/0x300 <4> [247.067799] ? lock_release+0xd0/0x2b0 <4> [247.067803] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.067809] process_one_work+0x239/0x740 <4> [247.067816] worker_thread+0x200/0x3f0 <4> [247.067819] ? __pfx_worker_thread+0x10/0x10 <4> [247.067822] kthread+0x10d/0x150 <4> [247.067824] ? __pfx_kthread+0x10/0x10 <4> [247.067827] ret_from_fork+0x3bd/0x470 <4> [247.067829] ? __pfx_kthread+0x10/0x10 <4> [247.067832] ret_from_fork_asm+0x1a/0x30 <4> [247.067839] </TASK> <4> [247.067840] irq event stamp: 260459 <4> [247.067841] hardirqs last enabled at (260465): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.067844] hardirqs last disabled at (260470): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.067845] softirqs last enabled at (259368): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.067848] softirqs last disabled at (259363): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.067851] ---[ end trace 0000000000000000 ]--- <6> [247.067852] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [247.067928] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [247.067934] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [247.068339] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [247.068549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [247.068644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [247.068738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [247.068828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [247.068916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [247.069003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [247.069089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [247.069177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [247.069259] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [247.069360] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [247.069454] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [247.070490] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [247.081218] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [247.081475] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [247.082499] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [247.082584] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [247.082674] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [247.082755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [247.082834] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [247.082912] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [247.082988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [247.083066] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [247.083143] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [247.083218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [247.083294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [247.083370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [247.083446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [247.083522] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [247.083597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [247.083681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [247.083757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [247.083834] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [247.083909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [247.083994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [247.084077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [247.084157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [247.084235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [247.084314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [247.084392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [247.084470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [247.084553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [247.084630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [247.084721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [247.084802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [247.084883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [247.084960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [247.085039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [247.085117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [247.085202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [247.085287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [247.085372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [247.085453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [247.085532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [247.085609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [247.085694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [247.085770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [247.085846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [247.085922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [247.086001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [247.086079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [247.086156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [247.086233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [247.086309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [247.086386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [247.086465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [247.086540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [247.086617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [247.086705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [247.086781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [247.086858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [247.086935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [247.087012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [247.087091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [247.087172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [247.087251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [247.087330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [247.087408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [247.087485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [247.087562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [247.087641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [247.087717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [247.087791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [247.087868] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [247.087988] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [247.087992] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38228, lrc_seqno=38228, guc_id=0, flags=0x73 in no process [-1] <7> [247.087994] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.088061] ------------[ cut here ]------------ <4> [247.088063] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.088064] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:4/203 <4> [247.088142] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.088204] <4> [247.088206] CPU: 2 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.088209] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.088210] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.088212] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.088217] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.088293] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.088295] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [247.088297] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.088299] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.088300] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.088301] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.088302] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.088304] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [247.088305] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.088307] CR2: 000000c000427000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [247.088308] PKRU: 55555554 <4> [247.088309] Call Trace: <4> [247.088310] <TASK> <4> [247.088314] ? lock_acquire+0x60/0x300 <4> [247.088319] ? lock_release+0xd0/0x2b0 <4> [247.088324] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.088330] process_one_work+0x239/0x740 <4> [247.088336] worker_thread+0x200/0x3f0 <4> [247.088339] ? __pfx_worker_thread+0x10/0x10 <4> [247.088342] kthread+0x10d/0x150 <4> [247.088344] ? __pfx_kthread+0x10/0x10 <4> [247.088347] ret_from_fork+0x3bd/0x470 <4> [247.088349] ? __pfx_kthread+0x10/0x10 <4> [247.088352] ret_from_fork_asm+0x1a/0x30 <4> [247.088359] </TASK> <4> [247.088360] irq event stamp: 263625 <4> [247.088361] hardirqs last enabled at (263631): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.088363] hardirqs last disabled at (263636): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.088365] softirqs last enabled at (262756): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.088368] softirqs last disabled at (262749): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.088370] ---[ end trace 0000000000000000 ]--- <7> [247.089422] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [247.089536] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [247.095026] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38236, lrc_seqno=38236, guc_id=0, flags=0x73 in no process [-1] <7> [247.095031] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.095109] ------------[ cut here ]------------ <4> [247.095110] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.095112] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:4/203 <4> [247.095197] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.095262] <4> [247.095264] CPU: 11 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.095267] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.095268] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.095270] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.095275] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.095355] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.095357] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [247.095359] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.095361] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.095362] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.095363] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.095364] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.095366] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [247.095367] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.095369] CR2: 0000718d921a7000 CR3: 00000001227a0000 CR4: 0000000000f52ef0 <4> [247.095370] PKRU: 55555554 <4> [247.095371] Call Trace: <4> [247.095373] <TASK> <4> [247.095376] ? lock_acquire+0x60/0x300 <4> [247.095382] ? lock_release+0xd0/0x2b0 <4> [247.095387] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.095392] process_one_work+0x239/0x740 <4> [247.095399] worker_thread+0x200/0x3f0 <4> [247.095402] ? __pfx_worker_thread+0x10/0x10 <4> [247.095405] kthread+0x10d/0x150 <4> [247.095407] ? __pfx_kthread+0x10/0x10 <4> [247.095410] ret_from_fork+0x3bd/0x470 <4> [247.095412] ? __pfx_kthread+0x10/0x10 <4> [247.095415] ret_from_fork_asm+0x1a/0x30 <4> [247.095422] </TASK> <4> [247.095424] irq event stamp: 264927 <4> [247.095425] hardirqs last enabled at (264933): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.095427] hardirqs last disabled at (264938): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.095429] softirqs last enabled at (264030): [<ffffffff8133ad53>] kernel_fpu_end+0x53/0x70 <4> [247.095431] softirqs last disabled at (264028): [<ffffffff8133b464>] kernel_fpu_begin_mask+0xc4/0x120 <4> [247.095434] ---[ end trace 0000000000000000 ]--- <6> [247.095436] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [247.095513] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [247.095520] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [247.095807] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [247.096022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [247.096119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [247.096220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [247.096312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [247.096403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [247.096492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [247.096582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [247.096693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [247.096778] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [247.096880] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [247.096976] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [247.098011] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [247.108641] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [247.108903] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [247.109919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [247.110007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [247.110090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [247.110172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [247.110252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [247.110331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [247.110408] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [247.110484] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [247.110560] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [247.110644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [247.110723] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [247.110799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [247.110875] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [247.110949] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [247.111025] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [247.111101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [247.111176] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [247.111252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [247.111327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [247.111414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [247.111500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [247.111582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [247.111672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [247.111754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [247.111835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [247.111912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [247.111989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [247.112071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [247.112151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [247.112235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [247.112317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [247.112397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [247.112476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [247.112555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [247.112643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [247.112728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [247.112811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [247.112891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [247.112971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [247.113046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [247.113123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [247.113202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [247.113280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [247.113359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [247.113438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [247.113516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [247.113595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [247.113681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [247.113757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [247.113835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [247.113914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [247.113990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [247.114067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [247.114148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [247.114228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [247.114309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [247.114387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [247.114463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [247.114538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [247.114617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [247.114732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [247.114810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [247.114887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [247.114963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [247.115039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [247.115117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [247.115191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [247.115268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [247.115347] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [247.115470] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [247.115474] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38236, lrc_seqno=38236, guc_id=0, flags=0x73 in no process [-1] <7> [247.115477] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.115545] ------------[ cut here ]------------ <4> [247.115546] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.115547] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:4/203 <4> [247.115626] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.115694] <4> [247.115696] CPU: 11 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.115700] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.115701] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.115702] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.115708] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.115783] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.115785] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [247.115787] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.115789] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.115790] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.115791] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.115793] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.115794] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [247.115796] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.115797] CR2: 0000718d921a7000 CR3: 00000001227a0000 CR4: 0000000000f52ef0 <4> [247.115798] PKRU: 55555554 <4> [247.115799] Call Trace: <4> [247.115801] <TASK> <4> [247.115804] ? lock_acquire+0x60/0x300 <4> [247.115809] ? lock_release+0xd0/0x2b0 <4> [247.115814] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.115820] process_one_work+0x239/0x740 <4> [247.115826] worker_thread+0x200/0x3f0 <4> [247.115830] ? __pfx_worker_thread+0x10/0x10 <4> [247.115832] kthread+0x10d/0x150 <4> [247.115834] ? __pfx_kthread+0x10/0x10 <4> [247.115837] ret_from_fork+0x3bd/0x470 <4> [247.115840] ? __pfx_kthread+0x10/0x10 <4> [247.115842] ret_from_fork_asm+0x1a/0x30 <4> [247.115850] </TASK> <4> [247.115851] irq event stamp: 268309 <4> [247.115852] hardirqs last enabled at (268315): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.115854] hardirqs last disabled at (268320): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.115856] softirqs last enabled at (267406): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.115859] softirqs last disabled at (267243): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.115862] ---[ end trace 0000000000000000 ]--- <6> [247.115863] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [247.115939] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [247.115945] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [247.116329] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [247.116539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [247.116629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [247.116736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [247.116825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [247.116911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [247.116996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [247.117082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [247.117169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [247.117252] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [247.117353] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [247.117446] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [247.118478] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [247.129206] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [247.129462] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [247.130421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [247.130508] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [247.130590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [247.130679] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [247.130759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [247.130836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [247.130914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [247.130990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [247.131065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [247.131142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [247.131217] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [247.131293] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [247.131369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [247.131445] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [247.131521] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [247.131598] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [247.131691] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [247.131768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [247.131844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [247.131929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [247.132017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [247.132100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [247.132180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [247.132261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [247.132341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [247.132419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [247.132497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [247.132575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [247.132656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [247.132736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [247.132818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [247.132897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [247.132977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [247.133057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [247.133142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [247.133227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [247.133311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [247.133393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [247.133473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [247.133550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [247.133629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [247.133719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [247.133796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [247.133875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [247.133955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [247.134034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [247.134112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [247.134189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [247.134266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [247.134346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [247.134426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [247.134504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [247.134583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [247.134666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [247.134743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [247.134821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [247.134898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [247.134975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [247.135051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [247.135130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [247.135207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [247.135285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [247.135361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [247.135436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [247.135514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [247.135591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [247.135682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [247.135764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [247.135847] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [247.135968] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [247.135971] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38236, lrc_seqno=38236, guc_id=0, flags=0x73 in no process [-1] <7> [247.135974] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.136041] ------------[ cut here ]------------ <4> [247.136042] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.136043] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:4/203 <4> [247.136122] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.136185] <4> [247.136187] CPU: 11 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.136190] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.136191] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.136193] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.136198] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.136274] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.136276] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [247.136278] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.136280] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.136281] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.136282] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.136283] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.136285] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [247.136286] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.136288] CR2: 0000718d921a7000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [247.136289] PKRU: 55555554 <4> [247.136290] Call Trace: <4> [247.136291] <TASK> <4> [247.136295] ? lock_acquire+0x60/0x300 <4> [247.136300] ? lock_release+0xd0/0x2b0 <4> [247.136305] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.136311] process_one_work+0x239/0x740 <4> [247.136317] worker_thread+0x200/0x3f0 <4> [247.136320] ? __pfx_worker_thread+0x10/0x10 <4> [247.136323] kthread+0x10d/0x150 <4> [247.136325] ? __pfx_kthread+0x10/0x10 <4> [247.136328] ret_from_fork+0x3bd/0x470 <4> [247.136330] ? __pfx_kthread+0x10/0x10 <4> [247.136333] ret_from_fork_asm+0x1a/0x30 <4> [247.136340] </TASK> <4> [247.136341] irq event stamp: 271469 <4> [247.136343] hardirqs last enabled at (271475): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.136345] hardirqs last disabled at (271480): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.136346] softirqs last enabled at (270606): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.136349] softirqs last disabled at (270595): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.136352] ---[ end trace 0000000000000000 ]--- <7> [247.137661] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [247.137785] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [247.147212] xe 0000:03:00.0: [drm:i915_fifo_underrun_reset_write [xe]] Re-arming FIFO underruns on pipe C <7> [247.231612] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1989) -> ( 0 - 1515), size 1989 -> 1515 <7> [247.232269] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb ( 0 - 0) -> (1515 - 1989), size 0 -> 474 <7> [247.232770] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm <7> [247.233195] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [247.233616] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 <7> [247.234076] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 <7> [247.234470] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm <7> [247.234901] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [247.235289] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 <7> [247.235692] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 <7> [247.236142] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 1188000 num active planes 2 <7> [247.236309] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 1248 qgv_peak_bw: 48000 <7> [247.236413] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 1248 qgv_peak_bw: 48000 <7> [247.236512] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 1248 <5> [247.281457] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38237, lrc_seqno=38237, guc_id=0, flags=0x73 in no process [-1] <7> [247.281482] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.281985] ------------[ cut here ]------------ <4> [247.281993] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.282001] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:4/203 <4> [247.282470] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.282880] <4> [247.282893] CPU: 11 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.282910] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.282917] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.282924] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.282958] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.283391] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.283401] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [247.283414] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.283422] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.283429] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.283435] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.283441] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.283448] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [247.283456] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.283463] CR2: 0000718d921a7000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [247.283470] PKRU: 55555554 <4> [247.283476] Call Trace: <4> [247.283482] <TASK> <4> [247.283502] ? lock_acquire+0x60/0x300 <4> [247.283531] ? lock_release+0xd0/0x2b0 <4> [247.283556] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.283590] process_one_work+0x239/0x740 <4> [247.283625] worker_thread+0x200/0x3f0 <4> [247.283665] ? __pfx_worker_thread+0x10/0x10 <4> [247.283679] kthread+0x10d/0x150 <4> [247.283690] ? __pfx_kthread+0x10/0x10 <4> [247.283705] ret_from_fork+0x3bd/0x470 <4> [247.283717] ? __pfx_kthread+0x10/0x10 <4> [247.283731] ret_from_fork_asm+0x1a/0x30 <4> [247.283770] </TASK> <4> [247.283777] irq event stamp: 272363 <4> [247.283783] hardirqs last enabled at (272369): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.283796] hardirqs last disabled at (272374): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.283805] softirqs last enabled at (271598): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.283822] softirqs last disabled at (271593): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.283836] ---[ end trace 0000000000000000 ]--- <6> [247.283846] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [247.284269] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [247.284331] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [247.284435] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [247.285139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [247.285681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [247.286235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [247.286724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [247.287206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [247.287687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [247.288181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [247.288658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [247.289157] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [247.289703] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [247.290216] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [247.292065] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [247.303078] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [247.303414] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [247.304552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [247.304677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [247.304783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [247.304887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [247.304991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [247.305093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [247.305188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [247.305283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [247.305377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [247.305467] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [247.305557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [247.305647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [247.305735] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [247.305822] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [247.305906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [247.305988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [247.306070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [247.306152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [247.306235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [247.306328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [247.306418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [247.306505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [247.306591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [247.306686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [247.306772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [247.306856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [247.306939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [247.307021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [247.307103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [247.307187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [247.307272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [247.307356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [247.307440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [247.307524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [247.307614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [247.307713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [247.307804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [247.307890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [247.307975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [247.308058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [247.308141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [247.308223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [247.308305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [247.308388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [247.308473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [247.308556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [247.308642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [247.308725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [247.308806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [247.308889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [247.308974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [247.309055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [247.309138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [247.309220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [247.309301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [247.309383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [247.309465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [247.309546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [247.309625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [247.309723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [247.309805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [247.309887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [247.309969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [247.310050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [247.310135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [247.310222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [247.310306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [247.310388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [247.310473] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [247.310620] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [247.310624] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38237, lrc_seqno=38237, guc_id=0, flags=0x73 in no process [-1] <7> [247.310627] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.311561] ------------[ cut here ]------------ <4> [247.311563] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.311564] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:4/203 <4> [247.311664] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.311755] <4> [247.311757] CPU: 11 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.311760] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.311761] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.311763] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.311769] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.311851] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.311853] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [247.311855] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.311856] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.311858] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.311859] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.311860] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.311862] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [247.311863] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.311864] CR2: 0000718d921a7000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [247.311866] PKRU: 55555554 <4> [247.311867] Call Trace: <4> [247.311868] <TASK> <4> [247.311872] ? lock_acquire+0x60/0x300 <4> [247.311878] ? lock_release+0xd0/0x2b0 <4> [247.311883] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.311889] process_one_work+0x239/0x740 <4> [247.311896] worker_thread+0x200/0x3f0 <4> [247.311899] ? __pfx_worker_thread+0x10/0x10 <4> [247.311901] kthread+0x10d/0x150 <4> [247.311904] ? __pfx_kthread+0x10/0x10 <4> [247.311907] ret_from_fork+0x3bd/0x470 <4> [247.311909] ? __pfx_kthread+0x10/0x10 <4> [247.311912] ret_from_fork_asm+0x1a/0x30 <4> [247.311919] </TASK> <4> [247.311921] irq event stamp: 275585 <4> [247.311922] hardirqs last enabled at (275591): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.311924] hardirqs last disabled at (275596): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.311925] softirqs last enabled at (274816): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.311929] softirqs last disabled at (274809): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.311931] ---[ end trace 0000000000000000 ]--- <6> [247.311933] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [247.312013] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [247.312019] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [247.312432] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [247.312548] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [247.312691] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [247.312908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [247.313006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [247.313105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [247.313198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [247.313289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [247.313378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [247.313468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [247.313561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [247.313652] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [247.313760] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [247.313860] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [247.314902] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [247.324640] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [247.324905] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [247.326075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [247.326166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [247.326250] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [247.326334] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [247.326416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [247.326500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [247.326583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [247.326675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [247.326760] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [247.326843] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [247.326925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [247.327006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [247.327087] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [247.327169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [247.327249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [247.327334] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [247.327416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [247.327497] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [247.327578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [247.327674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [247.327765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [247.327852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [247.327936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [247.328021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [247.328107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [247.328191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [247.328274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [247.328357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [247.328438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [247.328521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [247.328606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [247.328697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [247.328783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [247.328867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [247.328957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [247.329048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [247.329138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [247.329225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [247.329311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [247.329394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [247.329479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [247.329562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [247.329645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [247.329729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [247.329813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [247.329897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [247.329981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [247.330064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [247.330145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [247.330228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [247.330313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [247.330399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [247.330484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [247.330568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [247.330653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [247.330738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [247.330821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [247.330900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [247.330980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [247.331063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [247.331145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [247.331227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [247.331308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [247.331388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [247.331470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [247.331552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [247.331635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [247.331717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [247.331799] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [247.331925] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [247.331929] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38237, lrc_seqno=38237, guc_id=0, flags=0x73 in no process [-1] <7> [247.331931] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.332002] ------------[ cut here ]------------ <4> [247.332003] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.332005] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:4/203 <4> [247.332087] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.332152] <4> [247.332154] CPU: 11 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.332157] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.332158] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.332160] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.332165] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.332246] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.332248] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [247.332250] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.332251] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.332253] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.332254] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.332255] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.332256] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [247.332258] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.332259] CR2: 0000718d921a7000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [247.332261] PKRU: 55555554 <4> [247.332262] Call Trace: <4> [247.332263] <TASK> <4> [247.332267] ? lock_acquire+0x60/0x300 <4> [247.332272] ? lock_release+0xd0/0x2b0 <4> [247.332277] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.332283] process_one_work+0x239/0x740 <4> [247.332290] worker_thread+0x200/0x3f0 <4> [247.332293] ? __pfx_worker_thread+0x10/0x10 <4> [247.332296] kthread+0x10d/0x150 <4> [247.332298] ? __pfx_kthread+0x10/0x10 <4> [247.332301] ret_from_fork+0x3bd/0x470 <4> [247.332303] ? __pfx_kthread+0x10/0x10 <4> [247.332306] ret_from_fork_asm+0x1a/0x30 <4> [247.332313] </TASK> <4> [247.332314] irq event stamp: 278741 <4> [247.332316] hardirqs last enabled at (278747): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.332318] hardirqs last disabled at (278752): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.332319] softirqs last enabled at (277882): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.332322] softirqs last disabled at (277877): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.332325] ---[ end trace 0000000000000000 ]--- <7> [247.333586] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [247.333725] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [247.339579] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38245, lrc_seqno=38245, guc_id=0, flags=0x73 in no process [-1] <7> [247.339584] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.339686] ------------[ cut here ]------------ <4> [247.339688] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.339689] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:4/203 <4> [247.339780] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.339846] <4> [247.339848] CPU: 6 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.339852] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.339853] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.339855] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.339861] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.339945] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.339947] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [247.339950] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.339952] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.339953] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.339955] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.339956] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.339957] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [247.339959] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.339961] CR2: 00007fe398465000 CR3: 0000000136bff000 CR4: 0000000000f52ef0 <4> [247.339963] PKRU: 55555554 <4> [247.339964] Call Trace: <4> [247.339965] <TASK> <4> [247.339970] ? lock_acquire+0x60/0x300 <4> [247.339975] ? lock_release+0xd0/0x2b0 <4> [247.339980] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.339987] process_one_work+0x239/0x740 <4> [247.339994] worker_thread+0x200/0x3f0 <4> [247.339997] ? __pfx_worker_thread+0x10/0x10 <4> [247.340000] kthread+0x10d/0x150 <4> [247.340003] ? __pfx_kthread+0x10/0x10 <4> [247.340006] ret_from_fork+0x3bd/0x470 <4> [247.340009] ? __pfx_kthread+0x10/0x10 <4> [247.340012] ret_from_fork_asm+0x1a/0x30 <4> [247.340020] </TASK> <4> [247.340021] irq event stamp: 280111 <4> [247.340023] hardirqs last enabled at (280117): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.340025] hardirqs last disabled at (280122): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.340027] softirqs last enabled at (277882): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.340031] softirqs last disabled at (277877): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.340034] ---[ end trace 0000000000000000 ]--- <6> [247.340036] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [247.340117] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [247.340124] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [247.340665] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [247.340882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [247.340985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [247.341089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [247.341185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [247.341282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [247.341372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [247.341463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [247.341556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [247.341654] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [247.341762] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [247.341863] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [247.342918] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [247.353641] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [247.353904] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [247.354852] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [247.354946] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [247.355032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [247.355116] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [247.355197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [247.355279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [247.355360] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [247.355444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [247.355528] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [247.355611] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [247.355703] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [247.355784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [247.355865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [247.355946] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [247.356025] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [247.356103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [247.356182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [247.356264] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [247.356344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [247.356438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [247.356529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [247.356613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [247.356704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [247.356788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [247.356871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [247.356954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [247.357036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [247.357117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [247.357199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [247.357284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [247.357371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [247.357458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [247.357544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [247.357629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [247.357734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [247.357825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [247.357915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [247.358001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [247.358085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [247.358168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [247.358253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [247.358335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [247.358415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [247.358498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [247.358583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [247.358675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [247.358759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [247.358841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [247.358922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [247.359004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [247.359087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [247.359173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [247.359256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [247.359338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [247.359419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [247.359502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [247.359584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [247.359671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [247.359753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [247.359837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [247.359920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [247.360004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [247.360086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [247.360167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [247.360250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [247.360332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [247.360413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [247.360494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [247.360578] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [247.360714] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [247.360719] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38245, lrc_seqno=38245, guc_id=0, flags=0x73 in no process [-1] <7> [247.360721] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.360793] ------------[ cut here ]------------ <4> [247.360794] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.360796] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:4/203 <4> [247.360877] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.360942] <4> [247.360944] CPU: 6 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.360947] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.360949] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.360950] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.360956] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.361038] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.361040] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [247.361042] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.361044] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.361045] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.361046] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.361047] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.361049] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [247.361050] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.361052] CR2: 00007fe398465000 CR3: 0000000136bff000 CR4: 0000000000f52ef0 <4> [247.361053] PKRU: 55555554 <4> [247.361054] Call Trace: <4> [247.361055] <TASK> <4> [247.361059] ? lock_acquire+0x60/0x300 <4> [247.361064] ? lock_release+0xd0/0x2b0 <4> [247.361069] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.361076] process_one_work+0x239/0x740 <4> [247.361083] worker_thread+0x200/0x3f0 <4> [247.361086] ? __pfx_worker_thread+0x10/0x10 <4> [247.361088] kthread+0x10d/0x150 <4> [247.361091] ? __pfx_kthread+0x10/0x10 <4> [247.361094] ret_from_fork+0x3bd/0x470 <4> [247.361096] ? __pfx_kthread+0x10/0x10 <4> [247.361099] ret_from_fork_asm+0x1a/0x30 <4> [247.361106] </TASK> <4> [247.361107] irq event stamp: 283273 <4> [247.361108] hardirqs last enabled at (283279): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.361111] hardirqs last disabled at (283284): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.361112] softirqs last enabled at (282270): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.361115] softirqs last disabled at (282263): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.361118] ---[ end trace 0000000000000000 ]--- <6> [247.361119] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [247.361199] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [247.361206] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [247.362444] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [247.362566] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [247.362692] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [247.362918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [247.363020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [247.363176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [247.363312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [247.363478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [247.363615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [247.363802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [247.363915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [247.364013] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [247.364118] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [247.364215] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [247.365253] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [247.375640] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [247.375898] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [247.376890] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [247.376977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [247.377059] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [247.377141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [247.377221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [247.377300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [247.377379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [247.377457] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [247.377535] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [247.377619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [247.377714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [247.377792] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [247.377870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [247.377947] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [247.378023] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [247.378101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [247.378181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [247.378258] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [247.378335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [247.378422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [247.378508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [247.378590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [247.378678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [247.378759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [247.378839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [247.378918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [247.378996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [247.379073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [247.379150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [247.379230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [247.379311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [247.379390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [247.379469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [247.379548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [247.379636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [247.379720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [247.379804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [247.379885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [247.379966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [247.380044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [247.380123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [247.380200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [247.380276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [247.380355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [247.380433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [247.380510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [247.380588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [247.380676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [247.380753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [247.380830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [247.380909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [247.380985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [247.381062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [247.381138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [247.381213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [247.381290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [247.381367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [247.381442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [247.381517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [247.381596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [247.381688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [247.381766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [247.381843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [247.381917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [247.381994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [247.382071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [247.382145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [247.382220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [247.382299] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [247.382425] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [247.382429] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38245, lrc_seqno=38245, guc_id=0, flags=0x73 in no process [-1] <7> [247.382432] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.383361] ------------[ cut here ]------------ <4> [247.383363] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.383364] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:2/121 <4> [247.383443] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.383510] <4> [247.383512] CPU: 1 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.383516] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.383517] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.383518] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.383525] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.383600] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.383602] RSP: 0018:ffffc9000056fca0 EFLAGS: 00010246 <4> [247.383604] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.383606] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.383607] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.383608] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.383609] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.383610] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [247.383612] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.383613] CR2: 0000718d911e3000 CR3: 0000000136bff000 CR4: 0000000000f52ef0 <4> [247.383615] PKRU: 55555554 <4> [247.383616] Call Trace: <4> [247.383617] <TASK> <4> [247.383621] ? lock_acquire+0x60/0x300 <4> [247.383627] ? lock_release+0xd0/0x2b0 <4> [247.383635] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.383642] process_one_work+0x239/0x740 <4> [247.383649] worker_thread+0x200/0x3f0 <4> [247.383652] ? __pfx_worker_thread+0x10/0x10 <4> [247.383655] kthread+0x10d/0x150 <4> [247.383657] ? __pfx_kthread+0x10/0x10 <4> [247.383660] ret_from_fork+0x3bd/0x470 <4> [247.383663] ? __pfx_kthread+0x10/0x10 <4> [247.383665] ret_from_fork_asm+0x1a/0x30 <4> [247.383673] </TASK> <4> [247.383675] irq event stamp: 730757 <4> [247.383676] hardirqs last enabled at (730763): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.383678] hardirqs last disabled at (730768): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.383680] softirqs last enabled at (729848): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.383683] softirqs last disabled at (729835): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.383685] ---[ end trace 0000000000000000 ]--- <7> [247.383724] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [247.383834] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [247.385434] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1515) -> ( 0 - 1989), size 1515 -> 1989 <7> [247.385539] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb (1515 - 1989) -> ( 0 - 0), size 474 -> 0 <7> [247.385630] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [247.385731] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [247.385819] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [247.385900] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [247.385977] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [247.386054] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [247.386128] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [247.386201] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [247.386294] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 594000 num active planes 1 <7> [247.386412] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000 <7> [247.386525] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000 <7> [247.386640] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624 <7> [247.397668] xe 0000:03:00.0: [drm:i915_fifo_underrun_reset_write [xe]] Re-arming FIFO underruns on pipe C <7> [247.481597] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1989) -> ( 0 - 1515), size 1989 -> 1515 <7> [247.482248] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb ( 0 - 0) -> (1515 - 1989), size 0 -> 474 <7> [247.482742] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm <7> [247.483166] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [247.483578] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 <7> [247.484047] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 <7> [247.484456] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm <7> [247.484892] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [247.485287] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 <7> [247.485698] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 <7> [247.486161] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 1188000 num active planes 2 <7> [247.486444] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 1248 qgv_peak_bw: 48000 <7> [247.486546] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 1248 qgv_peak_bw: 48000 <7> [247.486650] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 1248 <5> [247.531464] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38246, lrc_seqno=38246, guc_id=0, flags=0x73 in no process [-1] <7> [247.531492] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.532022] ------------[ cut here ]------------ <4> [247.532030] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.532039] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#13: kworker/u64:2/121 <4> [247.532564] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.533007] <4> [247.533022] CPU: 13 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.533042] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.533051] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.533061] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.533097] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.533592] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.533603] RSP: 0018:ffffc9000056fca0 EFLAGS: 00010246 <4> [247.533616] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.533625] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.533650] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.533659] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.533667] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.533676] FS: 0000000000000000(0000) GS:ffff8888db303000(0000) knlGS:0000000000000000 <4> [247.533685] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.533693] CR2: 0000718d91dbf000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [247.533703] PKRU: 55555554 <4> [247.533709] Call Trace: <4> [247.533717] <TASK> <4> [247.533744] ? lock_acquire+0x60/0x300 <4> [247.533779] ? lock_release+0xd0/0x2b0 <4> [247.533812] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.533854] process_one_work+0x239/0x740 <4> [247.533900] worker_thread+0x200/0x3f0 <4> [247.533919] ? __pfx_worker_thread+0x10/0x10 <4> [247.533935] kthread+0x10d/0x150 <4> [247.533948] ? __pfx_kthread+0x10/0x10 <4> [247.533969] ret_from_fork+0x3bd/0x470 <4> [247.533982] ? __pfx_kthread+0x10/0x10 <4> [247.533999] ret_from_fork_asm+0x1a/0x30 <4> [247.534051] </TASK> <4> [247.534060] irq event stamp: 732151 <4> [247.534068] hardirqs last enabled at (732157): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.534082] hardirqs last disabled at (732162): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.534093] softirqs last enabled at (731386): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.534111] softirqs last disabled at (731381): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.534125] ---[ end trace 0000000000000000 ]--- <6> [247.534135] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [247.534656] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [247.534724] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [247.534862] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [247.535602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [247.536256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [247.536838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [247.537314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [247.537855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [247.538323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [247.538850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [247.539299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [247.539752] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [247.540266] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [247.540799] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [247.542922] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [247.553654] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [247.553985] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [247.555088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [247.555200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [247.555305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [247.555398] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [247.555486] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [247.555574] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [247.555675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [247.555762] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [247.555847] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [247.555929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [247.556011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [247.556092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [247.556172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [247.556251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [247.556327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [247.556398] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [247.556468] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [247.556539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [247.556608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [247.556700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [247.556783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [247.556857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [247.556935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [247.557014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [247.557088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [247.557160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [247.557230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [247.557299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [247.557369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [247.557442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [247.557517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [247.557589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [247.557668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [247.557741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [247.557818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [247.557895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [247.557972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [247.558045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [247.558124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [247.558197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [247.558269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [247.558341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [247.558410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [247.558481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [247.558558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [247.558641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [247.558787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [247.558919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [247.559026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [247.559136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [247.559257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [247.559376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [247.559495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [247.559591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [247.559685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [247.559763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [247.559837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [247.559910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [247.559982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [247.560056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [247.560129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [247.560202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [247.560274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [247.560344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [247.560417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [247.560488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [247.560558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [247.560629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [247.560725] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [247.560849] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [247.560854] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38246, lrc_seqno=38246, guc_id=0, flags=0x73 in no process [-1] <7> [247.560857] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.560920] ------------[ cut here ]------------ <4> [247.560921] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.560922] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [247.560995] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.561060] <4> [247.561062] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.561065] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.561066] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.561068] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.561074] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.561144] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.561146] RSP: 0018:ffffc9000056fca0 EFLAGS: 00010246 <4> [247.561148] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.561149] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.561150] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.561151] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.561152] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.561154] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [247.561155] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.561156] CR2: 000000c00030c000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [247.561158] PKRU: 55555554 <4> [247.561159] Call Trace: <4> [247.561160] <TASK> <4> [247.561164] ? lock_acquire+0x60/0x300 <4> [247.561170] ? lock_release+0xd0/0x2b0 <4> [247.561174] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.561180] process_one_work+0x239/0x740 <4> [247.561187] worker_thread+0x200/0x3f0 <4> [247.561190] ? __pfx_worker_thread+0x10/0x10 <4> [247.561192] kthread+0x10d/0x150 <4> [247.561195] ? __pfx_kthread+0x10/0x10 <4> [247.561197] ret_from_fork+0x3bd/0x470 <4> [247.561200] ? __pfx_kthread+0x10/0x10 <4> [247.561203] ret_from_fork_asm+0x1a/0x30 <4> [247.561210] </TASK> <4> [247.561211] irq event stamp: 735355 <4> [247.561212] hardirqs last enabled at (735361): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.561215] hardirqs last disabled at (735366): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.561216] softirqs last enabled at (734504): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.561219] softirqs last disabled at (734497): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.561222] ---[ end trace 0000000000000000 ]--- <6> [247.561224] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [247.561294] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [247.561300] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [247.562539] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [247.562647] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [247.562757] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [247.562978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [247.563077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [247.563172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [247.563261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [247.563348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [247.563436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [247.563522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [247.563608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [247.563705] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [247.563812] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [247.563903] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [247.564926] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [247.575650] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [247.575910] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [247.576868] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [247.576951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [247.577030] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [247.577109] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [247.577186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [247.577260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [247.577335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [247.577409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [247.577482] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [247.577557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [247.577629] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [247.577722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [247.577800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [247.577879] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [247.577953] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [247.578026] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [247.578099] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [247.578173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [247.578247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [247.578330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [247.578410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [247.578494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [247.578575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [247.578660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [247.578747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [247.578827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [247.578904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [247.578979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [247.579055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [247.579133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [247.579213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [247.579291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [247.579369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [247.579450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [247.579533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [247.579616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [247.579714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [247.579805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [247.579891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [247.579968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [247.580044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [247.580118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [247.580191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [247.580265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [247.580341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [247.580416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [247.580491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [247.580565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [247.580641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [247.580721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [247.580802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [247.580877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [247.580950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [247.581025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [247.581098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [247.581172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [247.581246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [247.581318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [247.581391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [247.581467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [247.581540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [247.581615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [247.581701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [247.581782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [247.581866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [247.581940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [247.582014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [247.582088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [247.582164] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [247.582283] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [247.582287] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38246, lrc_seqno=38246, guc_id=0, flags=0x73 in no process [-1] <7> [247.582290] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.582356] ------------[ cut here ]------------ <4> [247.582357] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.582358] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:4/203 <4> [247.582436] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.582506] <4> [247.582508] CPU: 6 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.582511] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.582512] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.582514] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.582520] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.582600] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.582602] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [247.582604] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.582606] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.582607] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.582608] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.582610] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.582611] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [247.582612] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.582614] CR2: 00007fe398465000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [247.582615] PKRU: 55555554 <4> [247.582617] Call Trace: <4> [247.582618] <TASK> <4> [247.582622] ? lock_acquire+0x60/0x300 <4> [247.582628] ? lock_release+0xd0/0x2b0 <4> [247.582635] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.582642] process_one_work+0x239/0x740 <4> [247.582650] worker_thread+0x200/0x3f0 <4> [247.582653] ? __pfx_worker_thread+0x10/0x10 <4> [247.582656] kthread+0x10d/0x150 <4> [247.582659] ? __pfx_kthread+0x10/0x10 <4> [247.582662] ret_from_fork+0x3bd/0x470 <4> [247.582664] ? __pfx_kthread+0x10/0x10 <4> [247.582667] ret_from_fork_asm+0x1a/0x30 <4> [247.582675] </TASK> <4> [247.582676] irq event stamp: 286879 <4> [247.582677] hardirqs last enabled at (286885): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.582680] hardirqs last disabled at (286890): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.582682] softirqs last enabled at (285806): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.582685] softirqs last disabled at (285801): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.582688] ---[ end trace 0000000000000000 ]--- <7> [247.583700] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [247.583823] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [247.590808] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38254, lrc_seqno=38254, guc_id=0, flags=0x73 in no process [-1] <7> [247.590811] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.590889] ------------[ cut here ]------------ <4> [247.590890] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.590891] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:4/203 <4> [247.590977] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.591043] <4> [247.591045] CPU: 6 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.591048] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.591049] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.591051] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.591057] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.591138] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.591140] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [247.591142] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.591143] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.591144] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.591146] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.591147] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.591148] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [247.591150] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.591151] CR2: 00007fe398465000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [247.591153] PKRU: 55555554 <4> [247.591154] Call Trace: <4> [247.591155] <TASK> <4> [247.591159] ? lock_acquire+0x60/0x300 <4> [247.591164] ? lock_release+0xd0/0x2b0 <4> [247.591169] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.591174] process_one_work+0x239/0x740 <4> [247.591181] worker_thread+0x200/0x3f0 <4> [247.591184] ? __pfx_worker_thread+0x10/0x10 <4> [247.591187] kthread+0x10d/0x150 <4> [247.591190] ? __pfx_kthread+0x10/0x10 <4> [247.591193] ret_from_fork+0x3bd/0x470 <4> [247.591195] ? __pfx_kthread+0x10/0x10 <4> [247.591198] ret_from_fork_asm+0x1a/0x30 <4> [247.591206] </TASK> <4> [247.591207] irq event stamp: 287897 <4> [247.591208] hardirqs last enabled at (287903): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.591210] hardirqs last disabled at (287908): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.591212] softirqs last enabled at (285806): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.591215] softirqs last disabled at (285801): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.591217] ---[ end trace 0000000000000000 ]--- <6> [247.591219] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [247.591300] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [247.591307] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [247.591724] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [247.591949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [247.592052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [247.592154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [247.592248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [247.592341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [247.592431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [247.592519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [247.592607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [247.592700] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [247.592801] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [247.592896] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [247.593933] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [247.604640] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [247.604897] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [247.605903] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [247.605991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [247.606072] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [247.606151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [247.606229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [247.606307] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [247.606384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [247.606462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [247.606538] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [247.606615] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [247.606704] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [247.606779] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [247.606855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [247.606929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [247.607003] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [247.607078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [247.607156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [247.607233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [247.607308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [247.607395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [247.607479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [247.607561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [247.607643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [247.607724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [247.607803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [247.607882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [247.607960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [247.608037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [247.608114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [247.608203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [247.608282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [247.608360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [247.608439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [247.608518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [247.608603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [247.608695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [247.608779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [247.608860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [247.608945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [247.609023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [247.609099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [247.609174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [247.609248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [247.609326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [247.609405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [247.609483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [247.609562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [247.609641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [247.609717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [247.609795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [247.609875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [247.609952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [247.610030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [247.610108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [247.610183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [247.610260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [247.610337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [247.610412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [247.610485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [247.610563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [247.610641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [247.610718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [247.610792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [247.610868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [247.610945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [247.611021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [247.611096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [247.611169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [247.611247] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [247.611373] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [247.611377] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38254, lrc_seqno=38254, guc_id=0, flags=0x73 in no process [-1] <7> [247.611380] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.611447] ------------[ cut here ]------------ <4> [247.611449] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.611450] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:7/708 <4> [247.611536] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.611604] <4> [247.611607] CPU: 4 UID: 0 PID: 708 Comm: kworker/u64:7 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.611610] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.611611] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.611613] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.611619] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.611706] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.611708] RSP: 0018:ffffc900016c3ca0 EFLAGS: 00010246 <4> [247.611711] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.611713] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.611714] RBP: ffffc900016c3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.611715] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.611717] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.611718] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [247.611720] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.611722] CR2: 00007fe398466000 CR3: 0000000136bff000 CR4: 0000000000f52ef0 <4> [247.611723] PKRU: 55555554 <4> [247.611724] Call Trace: <4> [247.611725] <TASK> <4> [247.611730] ? lock_acquire+0x60/0x300 <4> [247.611735] ? lock_release+0xd0/0x2b0 <4> [247.611740] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.611746] process_one_work+0x239/0x740 <4> [247.611753] worker_thread+0x200/0x3f0 <4> [247.611756] ? __pfx_worker_thread+0x10/0x10 <4> [247.611759] kthread+0x10d/0x150 <4> [247.611761] ? __pfx_kthread+0x10/0x10 <4> [247.611764] ret_from_fork+0x3bd/0x470 <4> [247.611767] ? __pfx_kthread+0x10/0x10 <4> [247.611769] ret_from_fork_asm+0x1a/0x30 <4> [247.611777] </TASK> <4> [247.611778] irq event stamp: 343027 <4> [247.611780] hardirqs last enabled at (343033): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.611782] hardirqs last disabled at (343038): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.611784] softirqs last enabled at (341852): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.611787] softirqs last disabled at (341845): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.611789] ---[ end trace 0000000000000000 ]--- <6> [247.612349] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [247.612562] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [247.612574] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [247.613024] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [247.613135] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [247.613246] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [247.613471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [247.613572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [247.613688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [247.613780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [247.613868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [247.613956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [247.614044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [247.614132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [247.614216] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [247.614316] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [247.614411] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [247.615447] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [247.625640] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [247.625896] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [247.626970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [247.627070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [247.627159] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [247.627245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [247.627327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [247.627407] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [247.627485] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [247.627563] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [247.627650] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [247.627728] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [247.627806] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [247.627882] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [247.627959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [247.628097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [247.628217] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [247.628337] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [247.628458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [247.628582] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [247.628728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [247.628864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [247.628997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [247.629110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [247.629197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [247.629282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [247.629366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [247.629450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [247.629531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [247.629610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [247.629700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [247.629782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [247.629863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [247.629943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [247.630023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [247.630102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [247.630187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [247.630272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [247.630357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [247.630438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [247.630518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [247.630596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [247.630688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [247.630767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [247.630844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [247.630923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [247.631002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [247.631084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [247.631164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [247.631244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [247.631322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [247.631401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [247.631481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [247.631560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [247.631648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [247.631728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [247.631805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [247.631884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [247.631962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [247.632039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [247.632117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [247.632200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [247.632279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [247.632356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [247.632432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [247.632508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [247.632586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [247.632674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [247.632750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [247.632826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [247.632905] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [247.633030] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [247.633035] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38254, lrc_seqno=38254, guc_id=0, flags=0x73 in no process [-1] <7> [247.633038] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.633108] ------------[ cut here ]------------ <4> [247.633109] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.633111] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:8/983 <4> [247.633189] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.633254] <4> [247.633257] CPU: 2 UID: 0 PID: 983 Comm: kworker/u64:8 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.633260] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.633261] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.633263] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.633269] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.633345] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.633347] RSP: 0018:ffffc90003173ca0 EFLAGS: 00010246 <4> [247.633349] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.633351] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.633352] RBP: ffffc90003173db0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.633353] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.633354] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.633356] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [247.633357] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.633359] CR2: 000000c000427000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [247.633360] PKRU: 55555554 <4> [247.633361] Call Trace: <4> [247.633362] <TASK> <4> [247.633367] ? lock_acquire+0x60/0x300 <4> [247.633372] ? lock_release+0xd0/0x2b0 <4> [247.633377] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.633383] process_one_work+0x239/0x740 <4> [247.633390] worker_thread+0x200/0x3f0 <4> [247.633393] ? __pfx_worker_thread+0x10/0x10 <4> [247.633395] kthread+0x10d/0x150 <4> [247.633397] ? __pfx_kthread+0x10/0x10 <4> [247.633400] ret_from_fork+0x3bd/0x470 <4> [247.633403] ? __pfx_kthread+0x10/0x10 <4> [247.633405] ret_from_fork_asm+0x1a/0x30 <4> [247.633413] </TASK> <4> [247.633414] irq event stamp: 1391975 <4> [247.633415] hardirqs last enabled at (1391981): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.633417] hardirqs last disabled at (1391986): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.633419] softirqs last enabled at (1391106): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.633422] softirqs last disabled at (1391099): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.633424] ---[ end trace 0000000000000000 ]--- <7> [247.634505] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [247.634671] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [247.636027] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1515) -> ( 0 - 1989), size 1515 -> 1989 <7> [247.636125] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb (1515 - 1989) -> ( 0 - 0), size 474 -> 0 <7> [247.636213] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [247.636297] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [247.636377] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [247.636456] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [247.636536] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [247.636611] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [247.636697] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [247.636768] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [247.636853] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 594000 num active planes 1 <7> [247.636964] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000 <7> [247.637069] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000 <7> [247.637171] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624 <7> [247.647362] xe 0000:03:00.0: [drm:i915_fifo_underrun_reset_write [xe]] Re-arming FIFO underruns on pipe C <7> [247.731766] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1989) -> ( 0 - 1515), size 1989 -> 1515 <7> [247.732318] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb ( 0 - 0) -> (1515 - 1989), size 0 -> 474 <7> [247.732821] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm <7> [247.733244] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [247.733679] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 <7> [247.734079] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 <7> [247.734469] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm <7> [247.734900] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [247.735289] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 <7> [247.735698] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 <7> [247.736143] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 1188000 num active planes 2 <7> [247.736432] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1989) -> ( 0 - 1515), size 1989 -> 1515 <7> [247.736505] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb ( 0 - 0) -> (1515 - 1989), size 0 -> 474 <7> [247.736574] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm <7> [247.736652] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [247.736729] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 <7> [247.736803] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 <7> [247.736870] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm <7> [247.736935] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [247.737000] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 <7> [247.737066] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 <7> [247.737136] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 1188000 num active planes 2 <7> [247.737239] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 1248 qgv_peak_bw: 48000 <7> [247.737341] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 1248 qgv_peak_bw: 48000 <7> [247.737438] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 1248 <5> [247.781783] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38255, lrc_seqno=38255, guc_id=0, flags=0x73 in no process [-1] <7> [247.781810] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.782246] ------------[ cut here ]------------ <4> [247.782254] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.782262] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:7/708 <4> [247.782796] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.783222] <4> [247.783236] CPU: 1 UID: 0 PID: 708 Comm: kworker/u64:7 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.783253] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.783260] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.783269] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.783300] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.783726] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.783737] RSP: 0018:ffffc900016c3ca0 EFLAGS: 00010246 <4> [247.783752] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.783761] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.783769] RBP: ffffc900016c3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.783777] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.783784] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.783793] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [247.783802] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.783810] CR2: 0000718d911e3000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [247.783819] PKRU: 55555554 <4> [247.783826] Call Trace: <4> [247.783833] <TASK> <4> [247.783856] ? lock_acquire+0x60/0x300 <4> [247.783884] ? lock_release+0xd0/0x2b0 <4> [247.783910] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.783941] process_one_work+0x239/0x740 <4> [247.783976] worker_thread+0x200/0x3f0 <4> [247.783993] ? __pfx_worker_thread+0x10/0x10 <4> [247.784008] kthread+0x10d/0x150 <4> [247.784021] ? __pfx_kthread+0x10/0x10 <4> [247.784036] ret_from_fork+0x3bd/0x470 <4> [247.784049] ? __pfx_kthread+0x10/0x10 <4> [247.784062] ret_from_fork_asm+0x1a/0x30 <4> [247.784102] </TASK> <4> [247.784108] irq event stamp: 344771 <4> [247.784116] hardirqs last enabled at (344777): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.784128] hardirqs last disabled at (344782): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.784136] softirqs last enabled at (344026): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.784152] softirqs last disabled at (344019): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.784165] ---[ end trace 0000000000000000 ]--- <6> [247.784176] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [247.784572] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [247.784621] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [247.784717] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [247.785309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [247.785853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [247.786338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [247.786848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [247.787293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [247.787497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [247.787585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [247.787689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [247.787773] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [247.787874] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [247.787961] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [247.789024] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [247.799820] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [247.800181] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [247.801362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [247.801518] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [247.801675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [247.801818] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [247.801955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [247.802092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [247.802224] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [247.802354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [247.802475] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [247.802600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [247.802744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [247.802865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [247.802985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [247.803104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [247.803225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [247.803340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [247.803455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [247.803566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [247.803687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [247.803811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [247.803933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [247.804050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [247.804160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [247.804269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [247.804384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [247.804488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [247.804588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [247.804703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [247.804800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [247.804899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [247.804994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [247.805088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [247.805183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [247.805276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [247.805372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [247.805464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [247.805557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [247.805649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [247.805737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [247.805821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [247.805904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [247.805986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [247.806068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [247.806152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [247.806234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [247.806311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [247.806387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [247.806462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [247.806537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [247.806613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [247.806705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [247.806783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [247.806859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [247.806934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [247.807010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [247.807087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [247.807167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [247.807245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [247.807322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [247.807401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [247.807477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [247.807555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [247.807635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [247.807714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [247.807791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [247.807868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [247.807944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [247.808019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [247.808099] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [247.808224] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [247.808229] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38255, lrc_seqno=38255, guc_id=0, flags=0x73 in no process [-1] <7> [247.808232] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.808299] ------------[ cut here ]------------ <4> [247.808300] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.808302] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:7/708 <4> [247.808380] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.808445] <4> [247.808448] CPU: 1 UID: 0 PID: 708 Comm: kworker/u64:7 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.808451] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.808452] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.808453] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.808459] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.808535] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.808537] RSP: 0018:ffffc900016c3ca0 EFLAGS: 00010246 <4> [247.808540] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.808541] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.808542] RBP: ffffc900016c3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.808544] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.808545] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.808546] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [247.808548] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.808549] CR2: 0000718d911e3000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [247.808551] PKRU: 55555554 <4> [247.808552] Call Trace: <4> [247.808553] <TASK> <4> [247.808557] ? lock_acquire+0x60/0x300 <4> [247.808563] ? lock_release+0xd0/0x2b0 <4> [247.808567] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.808573] process_one_work+0x239/0x740 <4> [247.808580] worker_thread+0x200/0x3f0 <4> [247.808583] ? __pfx_worker_thread+0x10/0x10 <4> [247.808586] kthread+0x10d/0x150 <4> [247.808588] ? __pfx_kthread+0x10/0x10 <4> [247.808591] ret_from_fork+0x3bd/0x470 <4> [247.808594] ? __pfx_kthread+0x10/0x10 <4> [247.808596] ret_from_fork_asm+0x1a/0x30 <4> [247.808604] </TASK> <4> [247.808605] irq event stamp: 347915 <4> [247.808606] hardirqs last enabled at (347921): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.808608] hardirqs last disabled at (347926): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.808610] softirqs last enabled at (346714): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.808613] softirqs last disabled at (346707): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.808615] ---[ end trace 0000000000000000 ]--- <6> [247.808617] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [247.808713] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [247.808719] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [247.809125] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [247.809335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [247.809426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [247.809519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [247.809610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [247.809713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [247.809798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [247.809883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [247.809970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [247.810054] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [247.810154] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [247.810247] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [247.811282] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [247.821988] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [247.822244] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [247.823244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [247.823329] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [247.823409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [247.823488] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [247.823566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [247.823652] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [247.823735] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [247.823811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [247.823888] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [247.823964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [247.824038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [247.824115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [247.824189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [247.824265] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [247.824340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [247.824415] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [247.824490] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [247.824565] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [247.824646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [247.824732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [247.824816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [247.824897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [247.824977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [247.825057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [247.825135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [247.825212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [247.825287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [247.825363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [247.825438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [247.825517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [247.825597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [247.825689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [247.825768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [247.825848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [247.825933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [247.826016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [247.826100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [247.826180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [247.826261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [247.826339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [247.826417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [247.826497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [247.826575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [247.826664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [247.826745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [247.826823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [247.826900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [247.826977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [247.827053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [247.827130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [247.827210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [247.827288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [247.827365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [247.827440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [247.827516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [247.827593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [247.827685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [247.827760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [247.827834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [247.827913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [247.827991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [247.828069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [247.828146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [247.828222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [247.828299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [247.828376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [247.828450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [247.828524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [247.828602] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [247.828733] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [247.828737] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38255, lrc_seqno=38255, guc_id=0, flags=0x73 in no process [-1] <7> [247.828740] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.828807] ------------[ cut here ]------------ <4> [247.828808] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.828809] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:7/708 <4> [247.828886] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.828952] <4> [247.828954] CPU: 1 UID: 0 PID: 708 Comm: kworker/u64:7 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.828957] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.828958] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.828960] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.828965] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.829041] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.829042] RSP: 0018:ffffc900016c3ca0 EFLAGS: 00010246 <4> [247.829045] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.829046] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.829047] RBP: ffffc900016c3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.829048] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.829050] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.829051] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [247.829053] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.829054] CR2: 0000718d911e3000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [247.829055] PKRU: 55555554 <4> [247.829057] Call Trace: <4> [247.829058] <TASK> <4> [247.829061] ? lock_acquire+0x60/0x300 <4> [247.829066] ? lock_release+0xd0/0x2b0 <4> [247.829071] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.829077] process_one_work+0x239/0x740 <4> [247.829083] worker_thread+0x200/0x3f0 <4> [247.829087] ? __pfx_worker_thread+0x10/0x10 <4> [247.829089] kthread+0x10d/0x150 <4> [247.829091] ? __pfx_kthread+0x10/0x10 <4> [247.829094] ret_from_fork+0x3bd/0x470 <4> [247.829096] ? __pfx_kthread+0x10/0x10 <4> [247.829099] ret_from_fork_asm+0x1a/0x30 <4> [247.829107] </TASK> <4> [247.829108] irq event stamp: 351085 <4> [247.829109] hardirqs last enabled at (351091): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.829111] hardirqs last disabled at (351096): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.829113] softirqs last enabled at (349970): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.829116] softirqs last disabled at (349963): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.829118] ---[ end trace 0000000000000000 ]--- <7> [247.830470] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [247.830582] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [247.836294] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38263, lrc_seqno=38263, guc_id=0, flags=0x73 in no process [-1] <7> [247.836297] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.836368] ------------[ cut here ]------------ <4> [247.836369] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.836370] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:7/708 <4> [247.836450] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.836514] <4> [247.836516] CPU: 1 UID: 0 PID: 708 Comm: kworker/u64:7 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.836519] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.836520] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.836521] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.836527] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.836603] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.836605] RSP: 0018:ffffc900016c3ca0 EFLAGS: 00010246 <4> [247.836607] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.836608] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.836609] RBP: ffffc900016c3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.836611] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.836612] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.836613] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [247.836615] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.836616] CR2: 0000718d911e3000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [247.836618] PKRU: 55555554 <4> [247.836619] Call Trace: <4> [247.836620] <TASK> <4> [247.836623] ? lock_acquire+0x60/0x300 <4> [247.836628] ? lock_release+0xd0/0x2b0 <4> [247.836638] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.836644] process_one_work+0x239/0x740 <4> [247.836651] worker_thread+0x200/0x3f0 <4> [247.836654] ? __pfx_worker_thread+0x10/0x10 <4> [247.836657] kthread+0x10d/0x150 <4> [247.836659] ? __pfx_kthread+0x10/0x10 <4> [247.836662] ret_from_fork+0x3bd/0x470 <4> [247.836665] ? __pfx_kthread+0x10/0x10 <4> [247.836667] ret_from_fork_asm+0x1a/0x30 <4> [247.836675] </TASK> <4> [247.836676] irq event stamp: 352421 <4> [247.836677] hardirqs last enabled at (352427): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.836679] hardirqs last disabled at (352432): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.836681] softirqs last enabled at (352360): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.836684] softirqs last disabled at (352353): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.836687] ---[ end trace 0000000000000000 ]--- <6> [247.836688] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [247.836764] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [247.836770] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [247.837069] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [247.837279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [247.837369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [247.837465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [247.837556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [247.837648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [247.837733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [247.837818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [247.837905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [247.837988] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [247.838088] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [247.838180] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [247.839216] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [247.849943] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [247.850200] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [247.851199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [247.851285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [247.851365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [247.851445] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [247.851523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [247.851600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [247.851685] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [247.851761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [247.851840] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [247.851915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [247.851991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [247.852065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [247.852140] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [247.852216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [247.852292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [247.852366] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [247.852441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [247.852514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [247.852588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [247.852682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [247.852768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [247.852849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [247.852929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [247.853009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [247.853088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [247.853166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [247.853244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [247.853320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [247.853397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [247.853477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [247.853562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [247.853647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [247.853728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [247.853808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [247.853893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [247.853979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [247.854064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [247.854146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [247.854227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [247.854305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [247.854384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [247.854461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [247.854538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [247.854615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [247.854713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [247.854793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [247.854873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [247.854952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [247.855030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [247.855109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [247.855190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [247.855267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [247.855345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [247.855422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [247.855498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [247.855576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [247.855657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [247.855733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [247.855809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [247.855887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [247.855965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [247.856041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [247.856118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [247.856193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [247.856269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [247.856345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [247.856420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [247.856495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [247.856573] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [247.856701] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [247.856705] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38263, lrc_seqno=38263, guc_id=0, flags=0x73 in no process [-1] <7> [247.856707] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.856776] ------------[ cut here ]------------ <4> [247.856777] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.856778] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:7/708 <4> [247.856856] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.856920] <4> [247.856922] CPU: 1 UID: 0 PID: 708 Comm: kworker/u64:7 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.856925] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.856926] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.856928] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.856933] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.857009] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.857011] RSP: 0018:ffffc900016c3ca0 EFLAGS: 00010246 <4> [247.857013] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.857014] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.857016] RBP: ffffc900016c3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.857017] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.857018] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.857019] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [247.857021] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.857022] CR2: 0000718d911e3000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [247.857024] PKRU: 55555554 <4> [247.857025] Call Trace: <4> [247.857026] <TASK> <4> [247.857030] ? lock_acquire+0x60/0x300 <4> [247.857035] ? lock_release+0xd0/0x2b0 <4> [247.857039] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.857046] process_one_work+0x239/0x740 <4> [247.857052] worker_thread+0x200/0x3f0 <4> [247.857055] ? __pfx_worker_thread+0x10/0x10 <4> [247.857058] kthread+0x10d/0x150 <4> [247.857060] ? __pfx_kthread+0x10/0x10 <4> [247.857063] ret_from_fork+0x3bd/0x470 <4> [247.857065] ? __pfx_kthread+0x10/0x10 <4> [247.857068] ret_from_fork_asm+0x1a/0x30 <4> [247.857076] </TASK> <4> [247.857077] irq event stamp: 355549 <4> [247.857078] hardirqs last enabled at (355555): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.857080] hardirqs last disabled at (355560): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.857082] softirqs last enabled at (354538): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.857084] softirqs last disabled at (354529): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.857087] ---[ end trace 0000000000000000 ]--- <6> [247.857089] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [247.857164] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [247.857170] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [247.858416] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [247.858531] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [247.858647] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [247.858884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [247.858995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [247.859102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [247.859199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [247.859293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [247.859385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [247.859477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [247.859569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [247.859662] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [247.859770] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [247.859870] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [247.860911] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [247.871641] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [247.871906] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [247.872934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [247.873027] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [247.873113] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [247.873197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [247.873279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [247.873361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [247.873443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [247.873524] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [247.873605] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [247.873695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [247.873776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [247.873857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [247.873938] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [247.874019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [247.874100] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [247.874181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [247.874262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [247.874343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [247.874423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [247.874514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [247.874604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [247.874699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [247.874785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [247.874871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [247.874956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [247.875038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [247.875121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [247.875208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [247.875293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [247.875379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [247.875465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [247.875551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [247.875639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [247.875725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [247.875815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [247.875905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [247.875995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [247.876085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [247.876173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [247.876258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [247.876342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [247.876425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [247.876508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [247.876593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [247.876687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [247.876770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [247.876853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [247.876936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [247.877016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [247.877101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [247.877192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [247.877278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [247.877362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [247.877444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [247.877526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [247.877609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [247.877699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [247.877781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [247.877862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [247.877945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [247.878027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [247.878108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [247.878190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [247.878270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [247.878352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [247.878431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [247.878512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [247.878592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [247.878692] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [247.878820] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [247.878825] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38263, lrc_seqno=38263, guc_id=0, flags=0x73 in no process [-1] <7> [247.878828] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [247.878900] ------------[ cut here ]------------ <4> [247.878901] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [247.878902] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:4/203 <4> [247.878986] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [247.879052] <4> [247.879054] CPU: 6 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [247.879058] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [247.879059] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [247.879060] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [247.879066] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [247.879147] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [247.879149] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [247.879151] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [247.879152] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [247.879154] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [247.879155] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [247.879156] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [247.879157] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [247.879159] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [247.879160] CR2: 00007fe398467000 CR3: 00000001227a0000 CR4: 0000000000f52ef0 <4> [247.879162] PKRU: 55555554 <4> [247.879163] Call Trace: <4> [247.879164] <TASK> <4> [247.879168] ? lock_acquire+0x60/0x300 <4> [247.879174] ? lock_release+0xd0/0x2b0 <4> [247.879179] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [247.879185] process_one_work+0x239/0x740 <4> [247.879192] worker_thread+0x200/0x3f0 <4> [247.879195] ? __pfx_worker_thread+0x10/0x10 <4> [247.879198] kthread+0x10d/0x150 <4> [247.879200] ? __pfx_kthread+0x10/0x10 <4> [247.879203] ret_from_fork+0x3bd/0x470 <4> [247.879205] ? __pfx_kthread+0x10/0x10 <4> [247.879208] ret_from_fork_asm+0x1a/0x30 <4> [247.879216] </TASK> <4> [247.879217] irq event stamp: 291735 <4> [247.879218] hardirqs last enabled at (291741): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [247.879220] hardirqs last disabled at (291746): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [247.879222] softirqs last enabled at (290884): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.879225] softirqs last disabled at (290827): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [247.879228] ---[ end trace 0000000000000000 ]--- <7> [247.880487] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [247.880612] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [247.881455] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1515) -> ( 0 - 1989), size 1515 -> 1989 <7> [247.881553] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb (1515 - 1989) -> ( 0 - 0), size 474 -> 0 <7> [247.881649] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [247.881726] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [247.881801] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [247.881873] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [247.881945] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [247.882015] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [247.882084] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [247.882154] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [247.882239] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 594000 num active planes 1 <7> [247.882430] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1515) -> ( 0 - 1989), size 1515 -> 1989 <7> [247.882512] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb (1515 - 1989) -> ( 0 - 0), size 474 -> 0 <7> [247.882588] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [247.882678] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [247.882752] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [247.882824] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [247.882895] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [247.882964] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [247.883034] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [247.883103] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [247.883177] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 594000 num active planes 1 <7> [247.883283] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000 <7> [247.883387] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000 <7> [247.883490] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624 <7> [247.897302] xe 0000:03:00.0: [drm:i915_fifo_underrun_reset_write [xe]] Re-arming FIFO underruns on pipe C <7> [247.981621] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1989) -> ( 0 - 1515), size 1989 -> 1515 <7> [247.982292] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb ( 0 - 0) -> (1515 - 1989), size 0 -> 474 <7> [247.982805] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm <7> [247.983232] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [247.983669] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 <7> [247.984069] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 <7> [247.984460] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm <7> [247.984886] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [247.985268] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 <7> [247.985667] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 <7> [247.986110] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 1188000 num active planes 2 <7> [247.986450] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1989) -> ( 0 - 1515), size 1989 -> 1515 <7> [247.986530] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb ( 0 - 0) -> (1515 - 1989), size 0 -> 474 <7> [247.986605] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm <7> [247.986687] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [247.986759] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 <7> [247.986829] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 <7> [247.986899] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm <7> [247.986970] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [247.987038] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 <7> [247.987105] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 <7> [247.987178] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 1188000 num active planes 2 <7> [247.987281] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 1248 qgv_peak_bw: 48000 <7> [247.987381] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 1248 qgv_peak_bw: 48000 <7> [247.987479] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 1248 <5> [248.031584] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38264, lrc_seqno=38264, guc_id=0, flags=0x73 in no process [-1] <7> [248.031612] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [248.032143] ------------[ cut here ]------------ <4> [248.032151] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [248.032160] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#12: kworker/u64:7/708 <4> [248.032698] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [248.033094] <4> [248.033110] CPU: 12 UID: 0 PID: 708 Comm: kworker/u64:7 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [248.033129] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [248.033137] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [248.033148] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [248.033184] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [248.033710] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [248.033721] RSP: 0018:ffffc900016c3ca0 EFLAGS: 00010246 <4> [248.033734] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [248.033744] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [248.033753] RBP: ffffc900016c3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [248.033762] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [248.033771] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [248.033781] FS: 0000000000000000(0000) GS:ffff8888db283000(0000) knlGS:0000000000000000 <4> [248.033792] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [248.033801] CR2: 0000718d92135000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [248.033810] PKRU: 55555554 <4> [248.033818] Call Trace: <4> [248.033825] <TASK> <4> [248.033853] ? lock_acquire+0x60/0x300 <4> [248.033887] ? lock_release+0xd0/0x2b0 <4> [248.033920] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [248.033963] process_one_work+0x239/0x740 <4> [248.034009] worker_thread+0x200/0x3f0 <4> [248.034029] ? __pfx_worker_thread+0x10/0x10 <4> [248.034045] kthread+0x10d/0x150 <4> [248.034060] ? __pfx_kthread+0x10/0x10 <4> [248.034079] ret_from_fork+0x3bd/0x470 <4> [248.034093] ? __pfx_kthread+0x10/0x10 <4> [248.034110] ret_from_fork_asm+0x1a/0x30 <4> [248.034163] </TASK> <4> [248.034171] irq event stamp: 357401 <4> [248.034178] hardirqs last enabled at (357407): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [248.034193] hardirqs last disabled at (357412): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [248.034203] softirqs last enabled at (356636): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.034221] softirqs last disabled at (356631): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.034236] ---[ end trace 0000000000000000 ]--- <6> [248.034246] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [248.034766] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [248.034803] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [248.035168] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [248.035926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [248.036532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [248.037131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [248.037613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [248.038138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [248.038584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [248.039116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [248.039579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [248.040140] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [248.040741] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [248.041259] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [248.043143] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [248.053662] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [248.053960] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [248.055052] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [248.055155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [248.055243] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [248.055328] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [248.055413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [248.055499] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [248.055585] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [248.055684] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [248.055772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [248.055859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [248.055948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [248.056039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [248.056129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [248.056219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [248.056309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [248.056393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [248.056477] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [248.056561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [248.056643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [248.056735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [248.056825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [248.056912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [248.056997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [248.057083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [248.057171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [248.057254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [248.057337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [248.057420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [248.057502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [248.057587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [248.057681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [248.057765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [248.057850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [248.057933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [248.058022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [248.058111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [248.058200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [248.058286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [248.058371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [248.058453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [248.058537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [248.058618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [248.058711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [248.058794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [248.058877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [248.058959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [248.059046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [248.059128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [248.059209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [248.059291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [248.059380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [248.059465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [248.059552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [248.059640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [248.059723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [248.059806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [248.059889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [248.059971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [248.060052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [248.060136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [248.060218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [248.060301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [248.060383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [248.060464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [248.060546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [248.060627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [248.060723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [248.060806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [248.060891] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [248.061020] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [248.061025] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38264, lrc_seqno=38264, guc_id=0, flags=0x73 in no process [-1] <7> [248.061028] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [248.061101] ------------[ cut here ]------------ <4> [248.061103] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [248.061104] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:7/708 <4> [248.061188] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [248.061255] <4> [248.061257] CPU: 3 UID: 0 PID: 708 Comm: kworker/u64:7 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [248.061261] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [248.061262] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [248.061263] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [248.061270] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [248.061352] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [248.061354] RSP: 0018:ffffc900016c3ca0 EFLAGS: 00010246 <4> [248.061356] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [248.061358] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [248.061359] RBP: ffffc900016c3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [248.061360] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [248.061362] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [248.061363] FS: 0000000000000000(0000) GS:ffff8888dae03000(0000) knlGS:0000000000000000 <4> [248.061365] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [248.061366] CR2: 0000718d911e3000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [248.061368] PKRU: 55555554 <4> [248.061369] Call Trace: <4> [248.061370] <TASK> <4> [248.061374] ? lock_acquire+0x60/0x300 <4> [248.061380] ? lock_release+0xd0/0x2b0 <4> [248.061385] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [248.061391] process_one_work+0x239/0x740 <4> [248.061399] worker_thread+0x200/0x3f0 <4> [248.061402] ? __pfx_worker_thread+0x10/0x10 <4> [248.061405] kthread+0x10d/0x150 <4> [248.061407] ? __pfx_kthread+0x10/0x10 <4> [248.061410] ret_from_fork+0x3bd/0x470 <4> [248.061413] ? __pfx_kthread+0x10/0x10 <4> [248.061416] ret_from_fork_asm+0x1a/0x30 <4> [248.061424] </TASK> <4> [248.061425] irq event stamp: 360619 <4> [248.061426] hardirqs last enabled at (360625): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [248.061429] hardirqs last disabled at (360630): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [248.061430] softirqs last enabled at (359596): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.061434] softirqs last disabled at (359589): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.061436] ---[ end trace 0000000000000000 ]--- <6> [248.061438] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [248.062543] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [248.062558] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [248.062771] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [248.062891] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [248.063009] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [248.063245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [248.063353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [248.063459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [248.063556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [248.063655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [248.063750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [248.063843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [248.063937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [248.064026] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [248.064133] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [248.064233] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [248.065272] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [248.075640] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [248.075894] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [248.076986] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [248.077070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [248.077148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [248.077228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [248.077305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [248.077381] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [248.077458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [248.077535] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [248.077611] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [248.077693] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [248.077768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [248.077840] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [248.077910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [248.077982] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [248.078054] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [248.078127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [248.078203] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [248.078276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [248.078349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [248.078432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [248.078513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [248.078592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [248.078678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [248.078763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [248.078841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [248.078916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [248.078991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [248.079066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [248.079141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [248.079218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [248.079296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [248.079373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [248.079450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [248.079527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [248.079610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [248.079703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [248.079792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [248.079873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [248.079955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [248.080032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [248.080109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [248.080184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [248.080258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [248.080334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [248.080410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [248.080484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [248.080560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [248.080639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [248.080722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [248.080800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [248.080878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [248.080953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [248.081029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [248.081105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [248.081179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [248.081254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [248.081330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [248.081404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [248.081476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [248.081551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [248.081625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [248.081718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [248.081800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [248.081874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [248.081949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [248.082024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [248.082100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [248.082175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [248.082252] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [248.082369] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [248.082373] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38264, lrc_seqno=38264, guc_id=0, flags=0x73 in no process [-1] <7> [248.082375] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [248.082441] ------------[ cut here ]------------ <4> [248.082442] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [248.082443] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:4/203 <4> [248.082519] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [248.082578] <4> [248.082580] CPU: 6 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [248.082583] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [248.082584] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [248.082586] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [248.082592] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [248.082676] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [248.082679] RSP: 0000:ffffc9000162fca0 EFLAGS: 00010246 <4> [248.082681] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [248.082683] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [248.082684] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [248.082685] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [248.082686] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [248.082688] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [248.082689] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [248.082690] CR2: 00007fe398469000 CR3: 0000000136bff000 CR4: 0000000000f52ef0 <4> [248.082692] PKRU: 55555554 <4> [248.082693] Call Trace: <4> [248.082694] <TASK> <4> [248.082697] ? lock_acquire+0x60/0x300 <4> [248.082703] ? lock_release+0xd0/0x2b0 <4> [248.082707] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [248.082713] process_one_work+0x239/0x740 <4> [248.082719] worker_thread+0x200/0x3f0 <4> [248.082722] ? __pfx_worker_thread+0x10/0x10 <4> [248.082725] kthread+0x10d/0x150 <4> [248.082727] ? __pfx_kthread+0x10/0x10 <4> [248.082730] ret_from_fork+0x3bd/0x470 <4> [248.082733] ? __pfx_kthread+0x10/0x10 <4> [248.082735] ret_from_fork_asm+0x1a/0x30 <4> [248.082742] </TASK> <4> [248.082743] irq event stamp: 295393 <4> [248.082745] hardirqs last enabled at (295399): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [248.082747] hardirqs last disabled at (295404): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [248.082748] softirqs last enabled at (295232): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.082752] softirqs last disabled at (295217): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.082754] ---[ end trace 0000000000000000 ]--- <7> [248.084056] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [248.084174] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [248.090443] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38272, lrc_seqno=38272, guc_id=0, flags=0x73 in no process [-1] <7> [248.090446] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [248.090523] ------------[ cut here ]------------ <4> [248.090525] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [248.090526] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:4/203 <4> [248.090608] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [248.090678] <4> [248.090680] CPU: 6 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [248.090683] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [248.090684] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [248.090685] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [248.090692] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [248.090774] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [248.090776] RSP: 0000:ffffc9000162fca0 EFLAGS: 00010246 <4> [248.090778] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [248.090779] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [248.090781] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [248.090782] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [248.090783] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [248.090784] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [248.090786] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [248.090787] CR2: 00007fe398469000 CR3: 00000001227a0000 CR4: 0000000000f52ef0 <4> [248.090789] PKRU: 55555554 <4> [248.090790] Call Trace: <4> [248.090791] <TASK> <4> [248.090795] ? lock_acquire+0x60/0x300 <4> [248.090800] ? lock_release+0xd0/0x2b0 <4> [248.090805] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [248.090811] process_one_work+0x239/0x740 <4> [248.090818] worker_thread+0x200/0x3f0 <4> [248.090821] ? __pfx_worker_thread+0x10/0x10 <4> [248.090823] kthread+0x10d/0x150 <4> [248.090826] ? __pfx_kthread+0x10/0x10 <4> [248.090829] ret_from_fork+0x3bd/0x470 <4> [248.090831] ? __pfx_kthread+0x10/0x10 <4> [248.090834] ret_from_fork_asm+0x1a/0x30 <4> [248.090841] </TASK> <4> [248.090843] irq event stamp: 296453 <4> [248.090844] hardirqs last enabled at (296459): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [248.090846] hardirqs last disabled at (296464): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [248.090847] softirqs last enabled at (295902): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.090851] softirqs last disabled at (295895): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.090853] ---[ end trace 0000000000000000 ]--- <6> [248.090855] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [248.090937] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [248.090943] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [248.091336] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [248.091549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [248.091659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [248.091762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [248.091857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [248.091953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [248.092047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [248.092141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [248.092234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [248.092323] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [248.092430] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [248.092529] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [248.093578] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [248.103640] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [248.103910] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [248.104917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [248.105010] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [248.105095] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [248.105179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [248.105264] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [248.105346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [248.105426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [248.105508] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [248.105586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [248.105675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [248.105757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [248.105836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [248.105915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [248.105993] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [248.106071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [248.106150] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [248.106230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [248.106307] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [248.106385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [248.106475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [248.106565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [248.106654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [248.106739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [248.106826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [248.106911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [248.106994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [248.107078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [248.107160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [248.107243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [248.107329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [248.107415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [248.107500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [248.107584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [248.107677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [248.107769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [248.107857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [248.107946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [248.108033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [248.108117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [248.108199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [248.108280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [248.108363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [248.108444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [248.108526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [248.108610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [248.108699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [248.108782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [248.108863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [248.108943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [248.109026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [248.109109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [248.109189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [248.109271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [248.109353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [248.109434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [248.109516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [248.109598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [248.109684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [248.109764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [248.109846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [248.109926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [248.110006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [248.110087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [248.110167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [248.110250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [248.110331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [248.110411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [248.110490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [248.110573] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [248.110706] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [248.110710] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38272, lrc_seqno=38272, guc_id=0, flags=0x73 in no process [-1] <7> [248.110713] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [248.110784] ------------[ cut here ]------------ <4> [248.110785] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [248.110786] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:4/203 <4> [248.110869] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [248.110933] <4> [248.110935] CPU: 6 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [248.110938] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [248.110939] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [248.110941] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [248.110947] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [248.111026] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [248.111028] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [248.111030] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [248.111031] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [248.111033] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [248.111034] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [248.111035] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [248.111037] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [248.111038] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [248.111039] CR2: 00007fe398469000 CR3: 00000001227a0000 CR4: 0000000000f52ef0 <4> [248.111041] PKRU: 55555554 <4> [248.111042] Call Trace: <4> [248.111043] <TASK> <4> [248.111047] ? lock_acquire+0x60/0x300 <4> [248.111053] ? lock_release+0xd0/0x2b0 <4> [248.111058] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [248.111064] process_one_work+0x239/0x740 <4> [248.111071] worker_thread+0x200/0x3f0 <4> [248.111074] ? __pfx_worker_thread+0x10/0x10 <4> [248.111076] kthread+0x10d/0x150 <4> [248.111079] ? __pfx_kthread+0x10/0x10 <4> [248.111082] ret_from_fork+0x3bd/0x470 <4> [248.111084] ? __pfx_kthread+0x10/0x10 <4> [248.111087] ret_from_fork_asm+0x1a/0x30 <4> [248.111094] </TASK> <4> [248.111095] irq event stamp: 299595 <4> [248.111097] hardirqs last enabled at (299601): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [248.111099] hardirqs last disabled at (299606): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [248.111100] softirqs last enabled at (298592): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.111104] softirqs last disabled at (298585): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.111106] ---[ end trace 0000000000000000 ]--- <6> [248.111108] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [248.111187] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [248.111194] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [248.112427] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [248.112550] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [248.112814] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [248.113049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [248.113158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [248.113266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [248.113364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [248.113460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [248.113553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [248.113656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [248.113751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [248.113841] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [248.113949] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [248.114051] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [248.115094] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [248.125639] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [248.125901] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [248.126914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [248.127009] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [248.127096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [248.127181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [248.127263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [248.127344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [248.127425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [248.127506] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [248.127588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [248.127679] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [248.127762] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [248.127841] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [248.127920] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [248.127999] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [248.128078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [248.128159] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [248.128242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [248.128326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [248.128406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [248.128496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [248.128586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [248.128681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [248.128767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [248.128861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [248.128947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [248.129029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [248.129111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [248.129192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [248.129276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [248.129360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [248.129445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [248.129530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [248.129613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [248.129707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [248.129797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [248.129886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [248.129975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [248.130059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [248.130148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [248.130230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [248.130316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [248.130401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [248.130483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [248.130567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [248.130656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [248.130740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [248.130823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [248.130906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [248.130987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [248.131070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [248.131153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [248.131235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [248.131316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [248.131398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [248.131478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [248.131561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [248.131646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [248.131727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [248.131807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [248.131891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [248.131971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [248.132053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [248.132133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [248.132213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [248.132295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [248.132377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [248.132456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [248.132537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [248.132620] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [248.132762] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [248.132766] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38272, lrc_seqno=38272, guc_id=0, flags=0x73 in no process [-1] <7> [248.132769] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [248.132840] ------------[ cut here ]------------ <4> [248.132841] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [248.132843] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:7/708 <4> [248.132926] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [248.132991] <4> [248.132994] CPU: 4 UID: 0 PID: 708 Comm: kworker/u64:7 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [248.132997] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [248.132998] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [248.133000] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [248.133006] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [248.133086] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [248.133088] RSP: 0018:ffffc900016c3ca0 EFLAGS: 00010246 <4> [248.133091] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [248.133092] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [248.133094] RBP: ffffc900016c3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [248.133095] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [248.133096] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [248.133097] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [248.133099] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [248.133101] CR2: 0000718d911e3000 CR3: 0000000136bff000 CR4: 0000000000f52ef0 <4> [248.133102] PKRU: 55555554 <4> [248.133103] Call Trace: <4> [248.133104] <TASK> <4> [248.133108] ? lock_acquire+0x60/0x300 <4> [248.133114] ? lock_release+0xd0/0x2b0 <4> [248.133118] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [248.133125] process_one_work+0x239/0x740 <4> [248.133131] worker_thread+0x200/0x3f0 <4> [248.133134] ? __pfx_worker_thread+0x10/0x10 <4> [248.133137] kthread+0x10d/0x150 <4> [248.133139] ? __pfx_kthread+0x10/0x10 <4> [248.133142] ret_from_fork+0x3bd/0x470 <4> [248.133144] ? __pfx_kthread+0x10/0x10 <4> [248.133147] ret_from_fork_asm+0x1a/0x30 <4> [248.133154] </TASK> <4> [248.133156] irq event stamp: 364113 <4> [248.133157] hardirqs last enabled at (364119): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [248.133159] hardirqs last disabled at (364124): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [248.133161] softirqs last enabled at (363184): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.133163] softirqs last disabled at (363177): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.133166] ---[ end trace 0000000000000000 ]--- <7> [248.134277] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [248.134410] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [248.135155] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1515) -> ( 0 - 1989), size 1515 -> 1989 <7> [248.135260] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb (1515 - 1989) -> ( 0 - 0), size 474 -> 0 <7> [248.135350] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [248.135433] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.135513] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.135592] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.135682] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [248.135760] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.135837] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.135912] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.136003] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 594000 num active planes 1 <7> [248.136122] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000 <7> [248.136235] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000 <7> [248.136343] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624 <7> [248.147383] xe 0000:03:00.0: [drm:i915_fifo_underrun_reset_write [xe]] Re-arming FIFO underruns on pipe C <7> [248.231718] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1989) -> ( 0 - 1515), size 1989 -> 1515 <7> [248.232276] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb ( 0 - 0) -> (1515 - 1989), size 0 -> 474 <7> [248.232771] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm <7> [248.233196] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [248.233602] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 <7> [248.234062] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 <7> [248.234459] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm <7> [248.234889] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [248.235274] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 <7> [248.235685] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 <7> [248.236132] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 1188000 num active planes 2 <7> [248.236435] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 1248 qgv_peak_bw: 48000 <7> [248.236540] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 1248 qgv_peak_bw: 48000 <7> [248.236643] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 1248 <5> [248.281808] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38273, lrc_seqno=38273, guc_id=0, flags=0x73 in no process [-1] <7> [248.281832] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [248.282224] ------------[ cut here ]------------ <4> [248.282231] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [248.282239] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [248.282753] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [248.283387] <4> [248.283405] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [248.283429] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [248.283439] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [248.283450] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [248.283496] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [248.284243] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [248.284258] RSP: 0018:ffffc9000056fca0 EFLAGS: 00010246 <4> [248.284278] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [248.284291] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [248.284302] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [248.284313] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [248.284324] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [248.284336] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [248.284349] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [248.284360] CR2: 000000c00030c000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [248.284373] PKRU: 55555554 <4> [248.284382] Call Trace: <4> [248.284393] <TASK> <4> [248.284429] ? lock_acquire+0x60/0x300 <4> [248.284472] ? lock_release+0xd0/0x2b0 <4> [248.284516] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [248.284568] process_one_work+0x239/0x740 <4> [248.284624] worker_thread+0x200/0x3f0 <4> [248.284665] ? __pfx_worker_thread+0x10/0x10 <4> [248.284688] kthread+0x10d/0x150 <4> [248.284704] ? __pfx_kthread+0x10/0x10 <4> [248.284729] ret_from_fork+0x3bd/0x470 <4> [248.284746] ? __pfx_kthread+0x10/0x10 <4> [248.284768] ret_from_fork_asm+0x1a/0x30 <4> [248.284837] </TASK> <4> [248.284847] irq event stamp: 737355 <4> [248.284857] hardirqs last enabled at (737361): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [248.284874] hardirqs last disabled at (737366): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [248.284889] softirqs last enabled at (736606): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.284910] softirqs last disabled at (736599): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.284928] ---[ end trace 0000000000000000 ]--- <6> [248.285050] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [248.285709] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [248.285893] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [248.286027] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [248.286789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [248.287443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [248.287988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [248.288446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [248.288924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [248.289350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [248.289815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [248.290245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [248.290678] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [248.291188] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [248.291587] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [248.292620] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [248.303436] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [248.304614] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [248.306147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [248.306364] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [248.306565] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [248.306785] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [248.306975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [248.307161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [248.307344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [248.307529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [248.307735] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [248.307913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [248.308088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [248.308261] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [248.308426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [248.308591] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [248.308771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [248.308926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [248.309086] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [248.309244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [248.309394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [248.309561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [248.309737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [248.309900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [248.310051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [248.310202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [248.310343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [248.310486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [248.310625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [248.310777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [248.310908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [248.311037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [248.311165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [248.311292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [248.311416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [248.311537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [248.311665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [248.311787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [248.311908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [248.312025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [248.312141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [248.312253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [248.312364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [248.312473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [248.312581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [248.312694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [248.312801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [248.312901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [248.312997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [248.313095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [248.313192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [248.313290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [248.313386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [248.313481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [248.313570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [248.313664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [248.313749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [248.313834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [248.313919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [248.314001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [248.314085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [248.314174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [248.314255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [248.314337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [248.314419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [248.314496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [248.314573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [248.314657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [248.314738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [248.314812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [248.314889] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [248.315010] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [248.315015] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38273, lrc_seqno=38273, guc_id=0, flags=0x73 in no process [-1] <7> [248.315017] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [248.315088] ------------[ cut here ]------------ <4> [248.315089] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [248.315090] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:2/121 <4> [248.315168] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [248.315230] <4> [248.315232] CPU: 6 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [248.315235] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [248.315236] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [248.315237] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [248.315243] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [248.315317] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [248.315318] RSP: 0018:ffffc9000056fca0 EFLAGS: 00010246 <4> [248.315320] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [248.315322] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [248.315323] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [248.315324] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [248.315325] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [248.315326] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [248.315328] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [248.315329] CR2: 00007fe39846a000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [248.315330] PKRU: 55555554 <4> [248.315331] Call Trace: <4> [248.315332] <TASK> <4> [248.315336] ? lock_acquire+0x60/0x300 <4> [248.315342] ? lock_release+0xd0/0x2b0 <4> [248.315346] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [248.315352] process_one_work+0x239/0x740 <4> [248.315358] worker_thread+0x200/0x3f0 <4> [248.315361] ? __pfx_worker_thread+0x10/0x10 <4> [248.315364] kthread+0x10d/0x150 <4> [248.315366] ? __pfx_kthread+0x10/0x10 <4> [248.315369] ret_from_fork+0x3bd/0x470 <4> [248.315371] ? __pfx_kthread+0x10/0x10 <4> [248.315373] ret_from_fork_asm+0x1a/0x30 <4> [248.315380] </TASK> <4> [248.315381] irq event stamp: 740593 <4> [248.315383] hardirqs last enabled at (740599): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [248.315385] hardirqs last disabled at (740604): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [248.315386] softirqs last enabled at (739724): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.315389] softirqs last disabled at (739717): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.315391] ---[ end trace 0000000000000000 ]--- <6> [248.315393] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [248.315466] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [248.315472] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [248.316871] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [248.317022] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [248.317149] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [248.317361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [248.317451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [248.317542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [248.317627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [248.317735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [248.317819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [248.317898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [248.317977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [248.318052] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [248.318145] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [248.318231] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [248.319252] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [248.329997] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [248.330250] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [248.331188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [248.331268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [248.331342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [248.331415] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [248.331487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [248.331557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [248.331627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [248.331717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [248.331793] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [248.331870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [248.331946] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [248.332022] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [248.332098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [248.332173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [248.332247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [248.332322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [248.332397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [248.332473] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [248.332547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [248.332678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [248.332821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [248.332946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [248.333068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [248.333196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [248.333332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [248.333464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [248.333561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [248.333653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [248.333734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [248.333818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [248.333900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [248.333980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [248.334061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [248.334140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [248.334226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [248.334311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [248.334397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [248.334483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [248.334566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [248.334651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [248.334731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [248.334809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [248.334887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [248.334966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [248.335045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [248.335123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [248.335200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [248.335276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [248.335353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [248.335431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [248.335512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [248.335591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [248.335682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [248.335760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [248.335836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [248.335913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [248.335992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [248.336072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [248.336147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [248.336225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [248.336302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [248.336380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [248.336457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [248.336533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [248.336611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [248.336700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [248.336776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [248.336852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [248.336932] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [248.337055] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [248.337060] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38273, lrc_seqno=38273, guc_id=0, flags=0x73 in no process [-1] <7> [248.337062] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [248.337130] ------------[ cut here ]------------ <4> [248.337131] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [248.337133] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [248.337211] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [248.337276] <4> [248.337278] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [248.337281] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [248.337283] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [248.337284] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [248.337290] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [248.337365] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [248.337367] RSP: 0018:ffffc9000056fca0 EFLAGS: 00010246 <4> [248.337369] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [248.337371] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [248.337372] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [248.337373] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [248.337374] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [248.337376] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [248.337377] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [248.337379] CR2: 000000c00030c000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [248.337380] PKRU: 55555554 <4> [248.337381] Call Trace: <4> [248.337382] <TASK> <4> [248.337386] ? lock_acquire+0x60/0x300 <4> [248.337392] ? lock_release+0xd0/0x2b0 <4> [248.337397] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [248.337403] process_one_work+0x239/0x740 <4> [248.337410] worker_thread+0x200/0x3f0 <4> [248.337413] ? __pfx_worker_thread+0x10/0x10 <4> [248.337416] kthread+0x10d/0x150 <4> [248.337418] ? __pfx_kthread+0x10/0x10 <4> [248.337421] ret_from_fork+0x3bd/0x470 <4> [248.337424] ? __pfx_kthread+0x10/0x10 <4> [248.337426] ret_from_fork_asm+0x1a/0x30 <4> [248.337434] </TASK> <4> [248.337435] irq event stamp: 743779 <4> [248.337436] hardirqs last enabled at (743785): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [248.337438] hardirqs last disabled at (743790): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [248.337440] softirqs last enabled at (742910): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.337443] softirqs last disabled at (742903): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.337445] ---[ end trace 0000000000000000 ]--- <7> [248.338489] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [248.338612] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [248.344429] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38281, lrc_seqno=38281, guc_id=0, flags=0x73 in no process [-1] <7> [248.344436] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [248.344559] ------------[ cut here ]------------ <4> [248.344561] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [248.344563] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#12: kworker/u64:2/121 <4> [248.344699] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [248.344798] <4> [248.344801] CPU: 12 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [248.344806] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [248.344807] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [248.344810] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [248.344819] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [248.344942] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [248.344944] RSP: 0018:ffffc9000056fca0 EFLAGS: 00010246 <4> [248.344948] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [248.344950] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [248.344952] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [248.344953] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [248.344955] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [248.344957] FS: 0000000000000000(0000) GS:ffff8888db283000(0000) knlGS:0000000000000000 <4> [248.344960] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [248.344962] CR2: 0000718d92135000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [248.344964] PKRU: 55555554 <4> [248.344966] Call Trace: <4> [248.344967] <TASK> <4> [248.344974] ? lock_acquire+0x60/0x300 <4> [248.344982] ? lock_release+0xd0/0x2b0 <4> [248.344990] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [248.345000] process_one_work+0x239/0x740 <4> [248.345011] worker_thread+0x200/0x3f0 <4> [248.345016] ? __pfx_worker_thread+0x10/0x10 <4> [248.345020] kthread+0x10d/0x150 <4> [248.345023] ? __pfx_kthread+0x10/0x10 <4> [248.345027] ret_from_fork+0x3bd/0x470 <4> [248.345031] ? __pfx_kthread+0x10/0x10 <4> [248.345035] ret_from_fork_asm+0x1a/0x30 <4> [248.345047] </TASK> <4> [248.345049] irq event stamp: 745281 <4> [248.345050] hardirqs last enabled at (745287): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [248.345053] hardirqs last disabled at (745292): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [248.345056] softirqs last enabled at (744538): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.345060] softirqs last disabled at (744531): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.345064] ---[ end trace 0000000000000000 ]--- <6> [248.345066] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [248.345189] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [248.345198] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [248.345481] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [248.345747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [248.345891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [248.346038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [248.346178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [248.346318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [248.346457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [248.346596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [248.346743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [248.346881] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [248.347029] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [248.347174] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [248.348584] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [248.359378] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [248.359695] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [248.360915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [248.361007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [248.361089] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [248.361167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [248.361242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [248.361314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [248.361386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [248.361455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [248.361526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [248.361597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [248.361685] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [248.361762] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [248.361838] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [248.361914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [248.361992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [248.362068] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [248.362145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [248.362219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [248.362295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [248.362382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [248.362466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [248.362548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [248.362627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [248.362726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [248.362807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [248.362886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [248.362963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [248.363041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [248.363119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [248.363200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [248.363280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [248.363384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [248.363528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [248.363709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [248.363843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [248.363981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [248.364119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [248.364241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [248.364337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [248.364421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [248.364505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [248.364586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [248.364678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [248.364759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [248.364840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [248.364920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [248.365000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [248.365078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [248.365156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [248.365237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [248.365317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [248.365394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [248.365474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [248.365554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [248.365638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [248.365718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [248.365795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [248.365872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [248.365947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [248.366026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [248.366102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [248.366178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [248.366254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [248.366329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [248.366405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [248.366481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [248.366556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [248.366631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [248.366725] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [248.366852] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [248.366857] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38281, lrc_seqno=38281, guc_id=0, flags=0x73 in no process [-1] <7> [248.366859] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [248.366926] ------------[ cut here ]------------ <4> [248.366928] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [248.366929] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [248.367008] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [248.367072] <4> [248.367074] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [248.367077] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [248.367078] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [248.367080] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [248.367086] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [248.367161] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [248.367163] RSP: 0018:ffffc9000056fca0 EFLAGS: 00010246 <4> [248.367166] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [248.367167] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [248.367169] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [248.367170] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [248.367171] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [248.367172] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [248.367174] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [248.367175] CR2: 000000c00030c000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [248.367177] PKRU: 55555554 <4> [248.367178] Call Trace: <4> [248.367179] <TASK> <4> [248.367183] ? lock_acquire+0x60/0x300 <4> [248.367188] ? lock_release+0xd0/0x2b0 <4> [248.367193] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [248.367199] process_one_work+0x239/0x740 <4> [248.367206] worker_thread+0x200/0x3f0 <4> [248.367209] ? __pfx_worker_thread+0x10/0x10 <4> [248.367211] kthread+0x10d/0x150 <4> [248.367213] ? __pfx_kthread+0x10/0x10 <4> [248.367216] ret_from_fork+0x3bd/0x470 <4> [248.367219] ? __pfx_kthread+0x10/0x10 <4> [248.367221] ret_from_fork_asm+0x1a/0x30 <4> [248.367229] </TASK> <4> [248.367230] irq event stamp: 748417 <4> [248.367231] hardirqs last enabled at (748423): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [248.367233] hardirqs last disabled at (748428): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [248.367235] softirqs last enabled at (747394): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.367238] softirqs last disabled at (747385): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.367240] ---[ end trace 0000000000000000 ]--- <6> [248.367242] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [248.367317] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [248.367323] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [248.367734] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [248.367945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [248.368033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [248.368125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [248.368210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [248.368297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [248.368382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [248.368471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [248.368559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [248.368655] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [248.368757] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [248.368851] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [248.369892] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [248.380622] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [248.380900] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [248.381957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [248.382044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [248.382126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [248.382207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [248.382286] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [248.382364] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [248.382441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [248.382519] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [248.382596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [248.382684] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [248.382761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [248.382837] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [248.382913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [248.382989] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [248.383065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [248.383142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [248.383218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [248.383292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [248.383366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [248.383452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [248.383537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [248.383618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [248.383712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [248.383793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [248.383871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [248.383947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [248.384025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [248.384100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [248.384176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [248.384255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [248.384333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [248.384412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [248.384492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [248.384571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [248.384661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [248.384744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [248.384828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [248.384907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [248.384986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [248.385061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [248.385141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [248.385229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [248.385364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [248.385514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [248.385648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [248.385776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [248.385904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [248.386032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [248.386157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [248.386285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [248.386377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [248.386462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [248.386544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [248.386624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [248.386717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [248.386796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [248.386874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [248.386950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [248.387025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [248.387103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [248.387180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [248.387257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [248.387334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [248.387409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [248.387486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [248.387563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [248.387643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [248.387719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [248.387798] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [248.387921] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [248.387926] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38281, lrc_seqno=38281, guc_id=0, flags=0x73 in no process [-1] <7> [248.387928] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [248.387996] ------------[ cut here ]------------ <4> [248.387997] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [248.387998] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [248.388077] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [248.388141] <4> [248.388143] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [248.388146] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [248.388147] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [248.388149] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [248.388155] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [248.388230] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [248.388232] RSP: 0018:ffffc9000056fca0 EFLAGS: 00010246 <4> [248.388234] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [248.388235] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [248.388237] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [248.388238] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [248.388239] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [248.388240] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [248.388242] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [248.388243] CR2: 000000c00030c000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [248.388245] PKRU: 55555554 <4> [248.388246] Call Trace: <4> [248.388247] <TASK> <4> [248.388251] ? lock_acquire+0x60/0x300 <4> [248.388256] ? lock_release+0xd0/0x2b0 <4> [248.388261] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [248.388267] process_one_work+0x239/0x740 <4> [248.388274] worker_thread+0x200/0x3f0 <4> [248.388277] ? __pfx_worker_thread+0x10/0x10 <4> [248.388279] kthread+0x10d/0x150 <4> [248.388281] ? __pfx_kthread+0x10/0x10 <4> [248.388284] ret_from_fork+0x3bd/0x470 <4> [248.388286] ? __pfx_kthread+0x10/0x10 <4> [248.388289] ret_from_fork_asm+0x1a/0x30 <4> [248.388296] </TASK> <4> [248.388298] irq event stamp: 751577 <4> [248.388299] hardirqs last enabled at (751583): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [248.388301] hardirqs last disabled at (751588): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [248.388302] softirqs last enabled at (750566): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.388305] softirqs last disabled at (750561): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.388308] ---[ end trace 0000000000000000 ]--- <7> [248.389351] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [248.389465] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [248.390268] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1515) -> ( 0 - 1989), size 1515 -> 1989 <7> [248.390367] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb (1515 - 1989) -> ( 0 - 0), size 474 -> 0 <7> [248.390451] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [248.390530] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.390605] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.390695] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.390768] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [248.390839] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.390912] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.390983] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.391067] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 594000 num active planes 1 <7> [248.391176] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000 <7> [248.391283] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000 <7> [248.391386] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624 <7> [248.397629] xe 0000:03:00.0: [drm:i915_fifo_underrun_reset_write [xe]] Re-arming FIFO underruns on pipe C <7> [248.481697] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1989) -> ( 0 - 1515), size 1989 -> 1515 <7> [248.482253] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb ( 0 - 0) -> (1515 - 1989), size 0 -> 474 <7> [248.482764] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm <7> [248.483206] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [248.483616] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 <7> [248.484075] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 <7> [248.484469] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm <7> [248.484895] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [248.485280] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 <7> [248.485673] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 <7> [248.485905] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 1188000 num active planes 2 <7> [248.486016] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 1248 qgv_peak_bw: 48000 <7> [248.486118] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 1248 qgv_peak_bw: 48000 <7> [248.486217] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 1248 <5> [248.531926] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38282, lrc_seqno=38282, guc_id=0, flags=0x73 in no process [-1] <7> [248.531954] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [248.532438] ------------[ cut here ]------------ <4> [248.532445] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [248.532454] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#12: kworker/u64:2/121 <4> [248.533035] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [248.533487] <4> [248.533504] CPU: 12 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [248.533522] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [248.533530] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [248.533540] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [248.533577] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [248.534100] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [248.534112] RSP: 0018:ffffc9000056fca0 EFLAGS: 00010246 <4> [248.534128] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [248.534138] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [248.534147] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [248.534156] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [248.534164] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [248.534174] FS: 0000000000000000(0000) GS:ffff8888db283000(0000) knlGS:0000000000000000 <4> [248.534185] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [248.534194] CR2: 0000718d92135000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [248.534205] PKRU: 55555554 <4> [248.534213] Call Trace: <4> [248.534223] <TASK> <4> [248.534253] ? lock_acquire+0x60/0x300 <4> [248.534287] ? lock_release+0xd0/0x2b0 <4> [248.534320] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [248.534361] process_one_work+0x239/0x740 <4> [248.534408] worker_thread+0x200/0x3f0 <4> [248.534428] ? __pfx_worker_thread+0x10/0x10 <4> [248.534445] kthread+0x10d/0x150 <4> [248.534459] ? __pfx_kthread+0x10/0x10 <4> [248.534478] ret_from_fork+0x3bd/0x470 <4> [248.534492] ? __pfx_kthread+0x10/0x10 <4> [248.534510] ret_from_fork_asm+0x1a/0x30 <4> [248.534562] </TASK> <4> [248.534571] irq event stamp: 752999 <4> [248.534578] hardirqs last enabled at (753005): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [248.534592] hardirqs last disabled at (753010): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [248.534603] softirqs last enabled at (752252): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.534620] softirqs last disabled at (752245): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.534651] ---[ end trace 0000000000000000 ]--- <6> [248.534746] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [248.535274] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [248.535341] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [248.535806] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [248.536485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [248.537061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [248.537581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [248.538142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [248.538608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [248.539121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [248.539585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [248.540114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [248.540565] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [248.541146] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [248.541690] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [248.543442] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [248.554495] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [248.554842] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [248.555897] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [248.556002] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [248.556099] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [248.556194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [248.556288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [248.556378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [248.556465] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [248.556552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [248.556644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [248.556741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [248.556825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [248.556906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [248.556985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [248.557063] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [248.557141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [248.557218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [248.557299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [248.557377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [248.557455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [248.557543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [248.557629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [248.557731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [248.557825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [248.557908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [248.557992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [248.558074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [248.558151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [248.558228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [248.558305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [248.558384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [248.558464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [248.558542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [248.558620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [248.558716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [248.558814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [248.558898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [248.558982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [248.559062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [248.559140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [248.559218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [248.559295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [248.559371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [248.559446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [248.559523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [248.559602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [248.559694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [248.559785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [248.559862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [248.559939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [248.560016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [248.560097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [248.560174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [248.560250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [248.560326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [248.560403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [248.560481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [248.560563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [248.560651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [248.560739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [248.560818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [248.560894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [248.560973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [248.561050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [248.561125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [248.561200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [248.561278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [248.561353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [248.561428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [248.561506] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [248.561704] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [248.561728] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38282, lrc_seqno=38282, guc_id=0, flags=0x73 in no process [-1] <7> [248.561734] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [248.561916] ------------[ cut here ]------------ <4> [248.561919] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [248.561922] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:2/121 <4> [248.562012] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [248.562105] <4> [248.562109] CPU: 2 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [248.562114] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [248.562117] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [248.562119] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [248.562129] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [248.562223] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [248.562226] RSP: 0018:ffffc9000056fca0 EFLAGS: 00010246 <4> [248.562230] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [248.562233] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [248.562235] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [248.562236] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [248.562238] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [248.562239] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [248.562241] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [248.562244] CR2: 000000c000427000 CR3: 0000000136bff000 CR4: 0000000000f52ef0 <4> [248.562246] PKRU: 55555554 <4> [248.562247] Call Trace: <4> [248.562249] <TASK> <4> [248.562254] ? lock_acquire+0x60/0x300 <4> [248.562263] ? lock_release+0xd0/0x2b0 <4> [248.562269] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [248.562276] process_one_work+0x239/0x740 <4> [248.562286] worker_thread+0x200/0x3f0 <4> [248.562290] ? __pfx_worker_thread+0x10/0x10 <4> [248.562293] kthread+0x10d/0x150 <4> [248.562295] ? __pfx_kthread+0x10/0x10 <4> [248.562298] ret_from_fork+0x3bd/0x470 <4> [248.562302] ? __pfx_kthread+0x10/0x10 <4> [248.562304] ret_from_fork_asm+0x1a/0x30 <4> [248.562313] </TASK> <4> [248.562315] irq event stamp: 756255 <4> [248.562316] hardirqs last enabled at (756261): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [248.562319] hardirqs last disabled at (756266): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [248.562321] softirqs last enabled at (755324): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.562324] softirqs last disabled at (755313): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.562327] ---[ end trace 0000000000000000 ]--- <6> [248.562330] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [248.562418] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [248.562430] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [248.562687] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [248.562808] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [248.562919] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [248.563176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [248.563275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [248.563373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [248.563465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [248.563556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [248.563651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [248.563791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [248.563884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [248.563972] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [248.564071] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [248.564165] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [248.565225] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [248.575646] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [248.575921] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [248.576992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [248.577083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [248.577164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [248.577240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [248.577312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [248.577383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [248.577454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [248.577524] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [248.577597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [248.577690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [248.577790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [248.577867] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [248.577944] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [248.578021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [248.578097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [248.578172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [248.578248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [248.578324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [248.578399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [248.578487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [248.578572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [248.578662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [248.578757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [248.578838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [248.578920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [248.579002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [248.579082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [248.579160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [248.579236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [248.579317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [248.579400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [248.579479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [248.579561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [248.579649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [248.579769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [248.579881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [248.579983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [248.580079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [248.580167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [248.580250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [248.580332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [248.580412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [248.580490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [248.580570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [248.580659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [248.580743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [248.580825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [248.580903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [248.580981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [248.581060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [248.581141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [248.581219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [248.581297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [248.581373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [248.581449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [248.581527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [248.581604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [248.581695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [248.581772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [248.581851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [248.581927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [248.582006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [248.582082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [248.582159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [248.582236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [248.582313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [248.582389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [248.582463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [248.582540] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [248.582675] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [248.582680] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38282, lrc_seqno=38282, guc_id=0, flags=0x73 in no process [-1] <7> [248.582683] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [248.582751] ------------[ cut here ]------------ <4> [248.582753] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [248.582754] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [248.582832] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [248.582901] <4> [248.582904] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [248.582907] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [248.582908] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [248.582909] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [248.582916] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [248.582991] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [248.582993] RSP: 0018:ffffc9000056fca0 EFLAGS: 00010246 <4> [248.582995] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [248.582997] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [248.582998] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [248.583000] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [248.583001] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [248.583002] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [248.583004] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [248.583005] CR2: 000000c00030c000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [248.583006] PKRU: 55555554 <4> [248.583008] Call Trace: <4> [248.583009] <TASK> <4> [248.583013] ? lock_acquire+0x60/0x300 <4> [248.583019] ? lock_release+0xd0/0x2b0 <4> [248.583024] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [248.583030] process_one_work+0x239/0x740 <4> [248.583038] worker_thread+0x200/0x3f0 <4> [248.583041] ? __pfx_worker_thread+0x10/0x10 <4> [248.583043] kthread+0x10d/0x150 <4> [248.583046] ? __pfx_kthread+0x10/0x10 <4> [248.583049] ret_from_fork+0x3bd/0x470 <4> [248.583052] ? __pfx_kthread+0x10/0x10 <4> [248.583055] ret_from_fork_asm+0x1a/0x30 <4> [248.583063] </TASK> <4> [248.583064] irq event stamp: 759449 <4> [248.583065] hardirqs last enabled at (759455): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [248.583067] hardirqs last disabled at (759460): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [248.583069] softirqs last enabled at (758526): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.583072] softirqs last disabled at (758517): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.583075] ---[ end trace 0000000000000000 ]--- <7> [248.584390] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [248.584507] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [248.590236] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38290, lrc_seqno=38290, guc_id=0, flags=0x73 in no process [-1] <7> [248.590240] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [248.590319] ------------[ cut here ]------------ <4> [248.590321] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [248.590323] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [248.590407] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [248.590476] <4> [248.590478] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [248.590481] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [248.590483] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [248.590484] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [248.590490] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [248.590569] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [248.590570] RSP: 0018:ffffc9000056fca0 EFLAGS: 00010246 <4> [248.590573] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [248.590574] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [248.590576] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [248.590577] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [248.590578] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [248.590579] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [248.590581] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [248.590582] CR2: 000000c00030c000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [248.590584] PKRU: 55555554 <4> [248.590585] Call Trace: <4> [248.590586] <TASK> <4> [248.590590] ? lock_acquire+0x60/0x300 <4> [248.590596] ? lock_release+0xd0/0x2b0 <4> [248.590601] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [248.590607] process_one_work+0x239/0x740 <4> [248.590614] worker_thread+0x200/0x3f0 <4> [248.590617] ? __pfx_worker_thread+0x10/0x10 <4> [248.590620] kthread+0x10d/0x150 <4> [248.590622] ? __pfx_kthread+0x10/0x10 <4> [248.590625] ret_from_fork+0x3bd/0x470 <4> [248.590628] ? __pfx_kthread+0x10/0x10 <4> [248.590630] ret_from_fork_asm+0x1a/0x30 <4> [248.590644] </TASK> <4> [248.590645] irq event stamp: 760485 <4> [248.590646] hardirqs last enabled at (760491): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [248.590649] hardirqs last disabled at (760496): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [248.590651] softirqs last enabled at (758526): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.590654] softirqs last disabled at (758517): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.590657] ---[ end trace 0000000000000000 ]--- <6> [248.590659] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [248.590737] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [248.590745] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [248.591012] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [248.591282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [248.591429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [248.591575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [248.591723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [248.591864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [248.592002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [248.592141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [248.592283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [248.592419] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [248.592568] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [248.592745] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [248.594116] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [248.604646] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [248.604996] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [248.605988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [248.606087] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [248.606178] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [248.606266] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [248.606351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [248.606435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [248.606518] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [248.606603] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [248.606705] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [248.606790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [248.606874] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [248.606957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [248.607039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [248.607122] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [248.607204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [248.607285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [248.607366] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [248.607446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [248.607528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [248.607622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [248.607728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [248.607819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [248.607907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [248.607989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [248.608071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [248.608154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [248.608235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [248.608317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [248.608399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [248.608482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [248.608568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [248.608660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [248.608744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [248.608828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [248.608917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [248.609006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [248.609094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [248.609178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [248.609263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [248.609345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [248.609428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [248.609508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [248.609590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [248.609682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [248.609767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [248.609850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [248.609931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [248.610011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [248.610094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [248.610180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [248.610267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [248.610351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [248.610435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [248.610518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [248.610617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [248.610713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [248.610797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [248.610878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [248.610959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [248.611043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [248.611124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [248.611206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [248.611288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [248.611387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [248.611475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [248.611560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [248.611647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [248.611728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [248.611813] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [248.611942] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [248.611947] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38290, lrc_seqno=38290, guc_id=0, flags=0x73 in no process [-1] <7> [248.611949] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [248.612022] ------------[ cut here ]------------ <4> [248.612023] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [248.612025] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:4/203 <4> [248.612109] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [248.612175] <4> [248.612177] CPU: 8 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [248.612180] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [248.612181] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [248.612183] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [248.612189] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [248.612272] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [248.612274] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [248.612276] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [248.612278] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [248.612279] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [248.612280] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [248.612282] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [248.612283] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [248.612285] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [248.612286] CR2: 0000718d911e3000 CR3: 0000000156d5c000 CR4: 0000000000f52ef0 <4> [248.612288] PKRU: 55555554 <4> [248.612289] Call Trace: <4> [248.612290] <TASK> <4> [248.612294] ? lock_acquire+0x60/0x300 <4> [248.612300] ? lock_release+0xd0/0x2b0 <4> [248.612305] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [248.612311] process_one_work+0x239/0x740 <4> [248.612318] worker_thread+0x200/0x3f0 <4> [248.612321] ? __pfx_worker_thread+0x10/0x10 <4> [248.612324] kthread+0x10d/0x150 <4> [248.612326] ? __pfx_kthread+0x10/0x10 <4> [248.612329] ret_from_fork+0x3bd/0x470 <4> [248.612332] ? __pfx_kthread+0x10/0x10 <4> [248.612335] ret_from_fork_asm+0x1a/0x30 <4> [248.612343] </TASK> <4> [248.612344] irq event stamp: 304725 <4> [248.612345] hardirqs last enabled at (304731): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [248.612348] hardirqs last disabled at (304736): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [248.612350] softirqs last enabled at (303862): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.612353] softirqs last disabled at (303851): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.612356] ---[ end trace 0000000000000000 ]--- <6> [248.612358] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [248.612438] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [248.612445] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [248.613746] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [248.613858] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [248.613971] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [248.614192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [248.614288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [248.614385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [248.614476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [248.614566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [248.614673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [248.614763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [248.614853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [248.614936] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [248.615037] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [248.615131] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [248.616212] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [248.626952] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [248.627215] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [248.628253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [248.628346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [248.628433] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [248.628520] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [248.628605] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [248.628706] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [248.628789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [248.628870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [248.628951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [248.629033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [248.629114] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [248.629194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [248.629271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [248.629347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [248.629424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [248.629500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [248.629576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [248.629656] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [248.629732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [248.629817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [248.629900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [248.629981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [248.630061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [248.630142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [248.630221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [248.630299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [248.630377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [248.630455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [248.630539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [248.630624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [248.630723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [248.630803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [248.630883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [248.630963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [248.631047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [248.631131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [248.631215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [248.631296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [248.631380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [248.631459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [248.631540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [248.631618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [248.631706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [248.631785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [248.631864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [248.631941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [248.632018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [248.632095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [248.632170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [248.632247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [248.632327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [248.632403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [248.632481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [248.632557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [248.632637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [248.632715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [248.632792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [248.632868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [248.632943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [248.633021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [248.633097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [248.633173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [248.633249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [248.633324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [248.633401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [248.633477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [248.633552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [248.633627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [248.633723] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [248.633848] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [248.633853] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38290, lrc_seqno=38290, guc_id=0, flags=0x73 in no process [-1] <7> [248.633855] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [248.633924] ------------[ cut here ]------------ <4> [248.633926] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [248.633927] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:4/203 <4> [248.634007] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [248.634073] <4> [248.634076] CPU: 9 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [248.634079] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [248.634080] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [248.634081] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [248.634087] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [248.634164] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [248.634166] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [248.634168] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [248.634170] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [248.634171] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [248.634173] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [248.634174] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [248.634175] FS: 0000000000000000(0000) GS:ffff8888db103000(0000) knlGS:0000000000000000 <4> [248.634177] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [248.634178] CR2: 000000c0003ab000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [248.634180] PKRU: 55555554 <4> [248.634181] Call Trace: <4> [248.634182] <TASK> <4> [248.634186] ? lock_acquire+0x60/0x300 <4> [248.634192] ? lock_release+0xd0/0x2b0 <4> [248.634196] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [248.634203] process_one_work+0x239/0x740 <4> [248.634209] worker_thread+0x200/0x3f0 <4> [248.634213] ? __pfx_worker_thread+0x10/0x10 <4> [248.634215] kthread+0x10d/0x150 <4> [248.634218] ? __pfx_kthread+0x10/0x10 <4> [248.634220] ret_from_fork+0x3bd/0x470 <4> [248.634223] ? __pfx_kthread+0x10/0x10 <4> [248.634225] ret_from_fork_asm+0x1a/0x30 <4> [248.634233] </TASK> <4> [248.634234] irq event stamp: 307887 <4> [248.634235] hardirqs last enabled at (307893): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [248.634238] hardirqs last disabled at (307898): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [248.634240] softirqs last enabled at (307036): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.634242] softirqs last disabled at (307031): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.634245] ---[ end trace 0000000000000000 ]--- <7> [248.635511] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [248.635626] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [248.636427] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1515) -> ( 0 - 1989), size 1515 -> 1989 <7> [248.636529] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb (1515 - 1989) -> ( 0 - 0), size 474 -> 0 <7> [248.636613] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [248.636704] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.636778] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.636850] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.636922] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [248.636994] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.637066] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.637136] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.637220] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 594000 num active planes 1 <7> [248.637333] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000 <7> [248.637441] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000 <7> [248.637544] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624 <7> [248.647709] xe 0000:03:00.0: [drm:i915_fifo_underrun_reset_write [xe]] Re-arming FIFO underruns on pipe C <7> [248.731804] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1989) -> ( 0 - 1515), size 1989 -> 1515 <7> [248.732367] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb ( 0 - 0) -> (1515 - 1989), size 0 -> 474 <7> [248.732875] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm <7> [248.733296] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [248.733743] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 <7> [248.734145] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 <7> [248.734538] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm <7> [248.734973] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [248.735361] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 <7> [248.735789] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 <7> [248.736234] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 1188000 num active planes 2 <7> [248.736680] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1989) -> ( 0 - 1515), size 1989 -> 1515 <7> [248.736753] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb ( 0 - 0) -> (1515 - 1989), size 0 -> 474 <7> [248.736821] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm <7> [248.736890] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [248.736955] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 <7> [248.737021] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 <7> [248.737087] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm <7> [248.737151] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [248.737217] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 <7> [248.737282] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 <7> [248.737350] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 1188000 num active planes 2 <7> [248.737454] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 1248 qgv_peak_bw: 48000 <7> [248.737552] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 1248 qgv_peak_bw: 48000 <7> [248.737679] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 1248 <5> [248.781452] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38291, lrc_seqno=38291, guc_id=0, flags=0x73 in no process [-1] <7> [248.781481] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [248.782126] ------------[ cut here ]------------ <4> [248.782138] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [248.782149] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:2/121 <4> [248.782710] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [248.783067] <4> [248.783081] CPU: 9 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [248.783098] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [248.783106] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [248.783115] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [248.783148] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [248.783585] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [248.783594] RSP: 0018:ffffc9000056fca0 EFLAGS: 00010246 <4> [248.783607] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [248.783615] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [248.783621] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [248.783628] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [248.784705] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [248.784714] FS: 0000000000000000(0000) GS:ffff8888db103000(0000) knlGS:0000000000000000 <4> [248.784722] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [248.784729] CR2: 000000c0003ab000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [248.784737] PKRU: 55555554 <4> [248.784743] Call Trace: <4> [248.784749] <TASK> <4> [248.784772] ? lock_acquire+0x60/0x300 <4> [248.784801] ? lock_release+0xd0/0x2b0 <4> [248.784826] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [248.784859] process_one_work+0x239/0x740 <4> [248.784894] worker_thread+0x200/0x3f0 <4> [248.784909] ? __pfx_worker_thread+0x10/0x10 <4> [248.784923] kthread+0x10d/0x150 <4> [248.784934] ? __pfx_kthread+0x10/0x10 <4> [248.784949] ret_from_fork+0x3bd/0x470 <4> [248.784961] ? __pfx_kthread+0x10/0x10 <4> [248.784975] ret_from_fork_asm+0x1a/0x30 <4> [248.785014] </TASK> <4> [248.785020] irq event stamp: 762327 <4> [248.785026] hardirqs last enabled at (762333): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [248.785038] hardirqs last disabled at (762338): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [248.785047] softirqs last enabled at (762210): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.785063] softirqs last disabled at (762205): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.785076] ---[ end trace 0000000000000000 ]--- <6> [248.785087] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [248.785529] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [248.785565] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [248.785779] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [248.786398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [248.786970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [248.787482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [248.787730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [248.787826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [248.787921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [248.788007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [248.788093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [248.788177] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [248.788277] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [248.788369] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [248.789403] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [248.800084] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [248.800464] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [248.801711] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [248.801885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [248.802050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [248.802207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [248.802365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [248.802527] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [248.802697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [248.802859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [248.803025] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [248.803189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [248.803346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [248.803501] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [248.803664] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [248.803821] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [248.803980] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [248.804135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [248.804283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [248.804427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [248.804573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [248.804745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [248.804900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [248.805043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [248.805184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [248.805326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [248.805461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [248.805589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [248.805727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [248.805853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [248.805971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [248.806097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [248.806224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [248.806344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [248.806464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [248.806582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [248.806714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [248.806833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [248.806948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [248.807060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [248.807175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [248.807282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [248.807386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [248.807488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [248.807585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [248.807693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [248.807791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [248.807886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [248.807984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [248.808079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [248.808173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [248.808265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [248.808360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [248.808450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [248.808540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [248.808628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [248.808723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [248.808808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [248.808892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [248.808976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [248.809056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [248.809139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [248.809218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [248.809300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [248.809381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [248.809460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [248.809542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [248.809624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [248.809715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [248.809796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [248.809880] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [248.810010] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [248.810016] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38291, lrc_seqno=38291, guc_id=0, flags=0x73 in no process [-1] <7> [248.810018] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [248.810090] ------------[ cut here ]------------ <4> [248.810091] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [248.810092] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:2/121 <4> [248.810176] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [248.810241] <4> [248.810243] CPU: 9 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [248.810246] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [248.810247] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [248.810249] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [248.810255] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [248.810335] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [248.810336] RSP: 0018:ffffc9000056fca0 EFLAGS: 00010246 <4> [248.810339] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [248.810340] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [248.810341] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [248.810343] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [248.810344] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [248.810345] FS: 0000000000000000(0000) GS:ffff8888db103000(0000) knlGS:0000000000000000 <4> [248.810347] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [248.810348] CR2: 000000c0003ab000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [248.810350] PKRU: 55555554 <4> [248.810351] Call Trace: <4> [248.810352] <TASK> <4> [248.810356] ? lock_acquire+0x60/0x300 <4> [248.810361] ? lock_release+0xd0/0x2b0 <4> [248.810366] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [248.810372] process_one_work+0x239/0x740 <4> [248.810379] worker_thread+0x200/0x3f0 <4> [248.810382] ? __pfx_worker_thread+0x10/0x10 <4> [248.810385] kthread+0x10d/0x150 <4> [248.810388] ? __pfx_kthread+0x10/0x10 <4> [248.810391] ret_from_fork+0x3bd/0x470 <4> [248.810393] ? __pfx_kthread+0x10/0x10 <4> [248.810396] ret_from_fork_asm+0x1a/0x30 <4> [248.810403] </TASK> <4> [248.810404] irq event stamp: 765479 <4> [248.810405] hardirqs last enabled at (765485): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [248.810408] hardirqs last disabled at (765490): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [248.810409] softirqs last enabled at (764462): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.810412] softirqs last disabled at (764455): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.810415] ---[ end trace 0000000000000000 ]--- <6> [248.810417] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [248.811650] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [248.811659] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [248.811745] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [248.811867] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [248.811984] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [248.812210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [248.812312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [248.812413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [248.812505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [248.812594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [248.812718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [248.812808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [248.812897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [248.812982] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [248.813084] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [248.813180] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [248.814216] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [248.824945] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [248.825198] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [248.826200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [248.826279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [248.826354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [248.826429] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [248.826504] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [248.826576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [248.826663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [248.826745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [248.826824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [248.826902] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [248.826979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [248.827057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [248.827133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [248.827209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [248.827285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [248.827361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [248.827437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [248.827513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [248.827588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [248.827685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [248.827771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [248.827854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [248.827938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [248.828020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [248.828103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [248.828182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [248.828260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [248.828336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [248.828416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [248.828498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [248.828580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [248.828669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [248.828749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [248.828830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [248.828914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [248.828998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [248.829082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [248.829162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [248.829241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [248.829317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [248.829395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [248.829531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [248.829699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [248.829829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [248.829958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [248.830089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [248.830217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [248.830340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [248.830428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [248.830512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [248.830596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [248.830710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [248.830796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [248.830878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [248.830957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [248.831036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [248.831115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [248.831193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [248.831270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [248.831350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [248.831428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [248.831507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [248.831591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [248.831681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [248.831762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [248.831841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [248.831918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [248.831994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [248.832074] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [248.832200] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [248.832205] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38291, lrc_seqno=38291, guc_id=0, flags=0x73 in no process [-1] <7> [248.832207] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [248.832277] ------------[ cut here ]------------ <4> [248.832278] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [248.832279] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [248.832359] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [248.832424] <4> [248.832426] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [248.832429] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [248.832431] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [248.832432] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [248.832438] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [248.832521] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [248.832522] RSP: 0018:ffffc9000056fca0 EFLAGS: 00010246 <4> [248.832525] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [248.832526] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [248.832527] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [248.832529] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [248.832530] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [248.832531] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [248.832533] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [248.832534] CR2: 000000c00030c000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [248.832536] PKRU: 55555554 <4> [248.832537] Call Trace: <4> [248.832538] <TASK> <4> [248.832542] ? lock_acquire+0x60/0x300 <4> [248.832547] ? lock_release+0xd0/0x2b0 <4> [248.832552] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [248.832558] process_one_work+0x239/0x740 <4> [248.832564] worker_thread+0x200/0x3f0 <4> [248.832567] ? __pfx_worker_thread+0x10/0x10 <4> [248.832570] kthread+0x10d/0x150 <4> [248.832572] ? __pfx_kthread+0x10/0x10 <4> [248.832575] ret_from_fork+0x3bd/0x470 <4> [248.832578] ? __pfx_kthread+0x10/0x10 <4> [248.832580] ret_from_fork_asm+0x1a/0x30 <4> [248.832588] </TASK> <4> [248.832589] irq event stamp: 768639 <4> [248.832590] hardirqs last enabled at (768645): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [248.832592] hardirqs last disabled at (768650): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [248.832594] softirqs last enabled at (767676): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.832597] softirqs last disabled at (767669): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.832600] ---[ end trace 0000000000000000 ]--- <7> [248.833841] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [248.833955] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [248.840398] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38299, lrc_seqno=38299, guc_id=0, flags=0x73 in no process [-1] <7> [248.840405] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [248.840527] ------------[ cut here ]------------ <4> [248.840529] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [248.840531] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#13: kworker/u64:8/983 <4> [248.840667] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [248.840763] <4> [248.840767] CPU: 13 UID: 0 PID: 983 Comm: kworker/u64:8 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [248.840771] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [248.840773] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [248.840775] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [248.840784] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [248.840905] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [248.840908] RSP: 0018:ffffc90003173ca0 EFLAGS: 00010246 <4> [248.840911] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [248.840913] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [248.840915] RBP: ffffc90003173db0 R08: 0000000000000000 R09: 0000000000000000 <4> [248.840917] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [248.840918] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [248.840920] FS: 0000000000000000(0000) GS:ffff8888db303000(0000) knlGS:0000000000000000 <4> [248.840923] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [248.840925] CR2: 0000718d91dbf000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [248.840927] PKRU: 55555554 <4> [248.840928] Call Trace: <4> [248.840930] <TASK> <4> [248.840937] ? lock_acquire+0x60/0x300 <4> [248.840945] ? lock_release+0xd0/0x2b0 <4> [248.840952] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [248.840962] process_one_work+0x239/0x740 <4> [248.840973] worker_thread+0x200/0x3f0 <4> [248.840978] ? __pfx_worker_thread+0x10/0x10 <4> [248.840981] kthread+0x10d/0x150 <4> [248.840985] ? __pfx_kthread+0x10/0x10 <4> [248.840989] ret_from_fork+0x3bd/0x470 <4> [248.840992] ? __pfx_kthread+0x10/0x10 <4> [248.840996] ret_from_fork_asm+0x1a/0x30 <4> [248.841008] </TASK> <4> [248.841010] irq event stamp: 1399795 <4> [248.841012] hardirqs last enabled at (1399801): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [248.841015] hardirqs last disabled at (1399806): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [248.841018] softirqs last enabled at (1399052): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.841021] softirqs last disabled at (1399045): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.841025] ---[ end trace 0000000000000000 ]--- <6> [248.841037] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [248.841138] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [248.841147] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [248.841447] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [248.841675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [248.841782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [248.841888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [248.841989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [248.842087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [248.842181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [248.842274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [248.842369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [248.842456] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [248.842562] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [248.842744] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [248.843789] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [248.853639] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [248.853902] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [248.854907] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [248.854999] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [248.855083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [248.855168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [248.855254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [248.855338] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [248.855423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [248.855509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [248.855594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [248.855688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [248.855774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [248.855857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [248.855937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [248.856018] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [248.856098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [248.856179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [248.856260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [248.856341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [248.856420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [248.856512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [248.856602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [248.856699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [248.856783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [248.856869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [248.856953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [248.857040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [248.857125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [248.857208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [248.857290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [248.857374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [248.857458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [248.857542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [248.857627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [248.857736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [248.857826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [248.857915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [248.858004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [248.858088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [248.858172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [248.858254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [248.858339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [248.858420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [248.858500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [248.858582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [248.858672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [248.858759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [248.858842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [248.858924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [248.859005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [248.859088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [248.859172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [248.859254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [248.859339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [248.859424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [248.859507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [248.859591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [248.859683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [248.859762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [248.859842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [248.859925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [248.860007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [248.860090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [248.860172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [248.860253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [248.860335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [248.860416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [248.860496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [248.860576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [248.860667] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [248.860797] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [248.860801] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38299, lrc_seqno=38299, guc_id=0, flags=0x73 in no process [-1] <7> [248.860804] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [248.860876] ------------[ cut here ]------------ <4> [248.860878] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [248.860879] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:8/983 <4> [248.860964] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [248.861028] <4> [248.861030] CPU: 6 UID: 0 PID: 983 Comm: kworker/u64:8 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [248.861034] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [248.861035] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [248.861036] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [248.861042] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [248.861123] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [248.861125] RSP: 0018:ffffc90003173ca0 EFLAGS: 00010246 <4> [248.861127] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [248.861129] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [248.861130] RBP: ffffc90003173db0 R08: 0000000000000000 R09: 0000000000000000 <4> [248.861131] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [248.861132] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [248.861134] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [248.861135] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [248.861137] CR2: 0000718d911e3000 CR3: 0000000136bff000 CR4: 0000000000f52ef0 <4> [248.861138] PKRU: 55555554 <4> [248.861139] Call Trace: <4> [248.861140] <TASK> <4> [248.861144] ? lock_acquire+0x60/0x300 <4> [248.861149] ? lock_release+0xd0/0x2b0 <4> [248.861154] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [248.861160] process_one_work+0x239/0x740 <4> [248.861167] worker_thread+0x200/0x3f0 <4> [248.861170] ? __pfx_worker_thread+0x10/0x10 <4> [248.861173] kthread+0x10d/0x150 <4> [248.861175] ? __pfx_kthread+0x10/0x10 <4> [248.861178] ret_from_fork+0x3bd/0x470 <4> [248.861180] ? __pfx_kthread+0x10/0x10 <4> [248.861183] ret_from_fork_asm+0x1a/0x30 <4> [248.861190] </TASK> <4> [248.861191] irq event stamp: 1403427 <4> [248.861193] hardirqs last enabled at (1403433): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [248.861195] hardirqs last disabled at (1403438): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [248.861197] softirqs last enabled at (1402576): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.861200] softirqs last disabled at (1402553): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.861202] ---[ end trace 0000000000000000 ]--- <6> [248.861204] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [248.861284] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [248.861290] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [248.862527] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [248.862658] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [248.862776] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [248.863002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [248.863105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [248.863203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [248.863295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [248.863384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [248.863471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [248.863558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [248.863658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [248.863753] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [248.863855] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [248.863948] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [248.864987] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [248.875977] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [248.876228] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [248.877206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [248.877285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [248.877360] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [248.877434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [248.877507] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [248.877579] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [248.877666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [248.877758] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [248.877840] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [248.877918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [248.877996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [248.878073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [248.878150] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [248.878225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [248.878304] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [248.878382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [248.878457] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [248.878533] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [248.878608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [248.878708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [248.878804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [248.878887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [248.878966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [248.879047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [248.879126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [248.879204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [248.879281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [248.879359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [248.879435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [248.879515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [248.879595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [248.879701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [248.879796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [248.879879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [248.879965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [248.880053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [248.880142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [248.880226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [248.880307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [248.880386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [248.880465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [248.880542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [248.880618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [248.880712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [248.880807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [248.880888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [248.880968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [248.881046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [248.881123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [248.881201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [248.881281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [248.881358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [248.881435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [248.881514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [248.881592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [248.881686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [248.881775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [248.881852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [248.881928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [248.882006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [248.882084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [248.882161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [248.882238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [248.882313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [248.882390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [248.882465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [248.882539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [248.882614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [248.882708] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [248.882843] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [248.882848] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38299, lrc_seqno=38299, guc_id=0, flags=0x73 in no process [-1] <7> [248.882850] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [248.882920] ------------[ cut here ]------------ <4> [248.882921] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [248.882922] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:7/708 <4> [248.883002] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [248.883068] <4> [248.883070] CPU: 5 UID: 0 PID: 708 Comm: kworker/u64:7 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [248.883074] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [248.883075] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [248.883076] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [248.883082] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [248.883158] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [248.883160] RSP: 0018:ffffc900016c3ca0 EFLAGS: 00010246 <4> [248.883162] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [248.883164] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [248.883165] RBP: ffffc900016c3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [248.883166] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [248.883167] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [248.883169] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [248.883170] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [248.883171] CR2: 0000718d91dbf000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [248.883173] PKRU: 55555554 <4> [248.883174] Call Trace: <4> [248.883175] <TASK> <4> [248.883179] ? lock_acquire+0x60/0x300 <4> [248.883184] ? lock_release+0xd0/0x2b0 <4> [248.883189] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [248.883195] process_one_work+0x239/0x740 <4> [248.883202] worker_thread+0x200/0x3f0 <4> [248.883204] ? __pfx_worker_thread+0x10/0x10 <4> [248.883207] kthread+0x10d/0x150 <4> [248.883209] ? __pfx_kthread+0x10/0x10 <4> [248.883212] ret_from_fork+0x3bd/0x470 <4> [248.883214] ? __pfx_kthread+0x10/0x10 <4> [248.883219] ret_from_fork_asm+0x1a/0x30 <4> [248.883232] </TASK> <4> [248.883234] irq event stamp: 369031 <4> [248.883236] hardirqs last enabled at (369037): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [248.883239] hardirqs last disabled at (369042): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [248.883242] softirqs last enabled at (368180): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.883245] softirqs last disabled at (368173): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [248.883248] ---[ end trace 0000000000000000 ]--- <7> [248.884525] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [248.884645] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [248.885428] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1515) -> ( 0 - 1989), size 1515 -> 1989 <7> [248.885536] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb (1515 - 1989) -> ( 0 - 0), size 474 -> 0 <7> [248.885629] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [248.885734] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.885820] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.885900] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.885981] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [248.886060] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.886138] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.886213] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.886303] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 594000 num active planes 1 <7> [248.886505] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1515) -> ( 0 - 1989), size 1515 -> 1989 <7> [248.886585] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb (1515 - 1989) -> ( 0 - 0), size 474 -> 0 <7> [248.886681] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [248.886758] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.886833] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.886907] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.886980] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [248.887053] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.887126] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.887197] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [248.887275] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 594000 num active planes 1 <7> [248.887389] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000 <7> [248.887502] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000 <7> [248.887609] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624 <7> [248.897665] xe 0000:03:00.0: [drm:i915_fifo_underrun_reset_write [xe]] Re-arming FIFO underruns on pipe C <7> [248.981719] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1989) -> ( 0 - 1515), size 1989 -> 1515 <7> [248.982275] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb ( 0 - 0) -> (1515 - 1989), size 0 -> 474 <7> [248.982775] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm <7> [248.983200] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [248.983607] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 <7> [248.984066] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 <7> [248.984456] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm <7> [248.984884] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [248.985268] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 <7> [248.985669] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 <7> [248.986117] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 1188000 num active planes 2 <7> [248.986393] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1989) -> ( 0 - 1515), size 1989 -> 1515 <7> [248.986474] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb ( 0 - 0) -> (1515 - 1989), size 0 -> 474 <7> [248.986548] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm <7> [248.986620] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [248.986707] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 <7> [248.986778] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 <7> [248.986847] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm <7> [248.986915] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [248.986982] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 <7> [248.987047] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 <7> [248.987116] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 1188000 num active planes 2 <7> [248.987217] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 1248 qgv_peak_bw: 48000 <7> [248.987317] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 1248 qgv_peak_bw: 48000 <7> [248.987413] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 1248 <5> [249.032056] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38300, lrc_seqno=38300, guc_id=0, flags=0x73 in no process [-1] <7> [249.032081] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [249.032475] ------------[ cut here ]------------ <4> [249.032482] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [249.032490] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:7/708 <4> [249.032980] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [249.033327] <4> [249.033340] CPU: 5 UID: 0 PID: 708 Comm: kworker/u64:7 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [249.033357] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [249.033363] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [249.033372] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [249.033402] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [249.033850] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [249.033860] RSP: 0018:ffffc900016c3ca0 EFLAGS: 00010246 <4> [249.033873] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [249.033882] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [249.033890] RBP: ffffc900016c3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [249.033897] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [249.033904] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [249.033911] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [249.033920] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [249.033929] CR2: 0000718d91dbf000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [249.033937] PKRU: 55555554 <4> [249.033944] Call Trace: <4> [249.033951] <TASK> <4> [249.033974] ? lock_acquire+0x60/0x300 <4> [249.034002] ? lock_release+0xd0/0x2b0 <4> [249.034028] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [249.034059] process_one_work+0x239/0x740 <4> [249.034096] worker_thread+0x200/0x3f0 <4> [249.034112] ? __pfx_worker_thread+0x10/0x10 <4> [249.034127] kthread+0x10d/0x150 <4> [249.034140] ? __pfx_kthread+0x10/0x10 <4> [249.034155] ret_from_fork+0x3bd/0x470 <4> [249.034168] ? __pfx_kthread+0x10/0x10 <4> [249.034182] ret_from_fork_asm+0x1a/0x30 <4> [249.034222] </TASK> <4> [249.034228] irq event stamp: 369917 <4> [249.034234] hardirqs last enabled at (369923): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [249.034247] hardirqs last disabled at (369928): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [249.034257] softirqs last enabled at (369172): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.034273] softirqs last disabled at (369167): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.034287] ---[ end trace 0000000000000000 ]--- <6> [249.034298] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [249.034709] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [249.034771] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [249.034860] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [249.036342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [249.037087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [249.037607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [249.037733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [249.037825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [249.037954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [249.038092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [249.038175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [249.038309] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [249.038438] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [249.038547] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [249.039575] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [249.050309] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [249.050677] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [249.052113] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [249.052302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [249.052485] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [249.052694] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [249.052878] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [249.053065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [249.053250] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [249.053427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [249.053600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [249.053805] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [249.053970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [249.054134] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [249.054295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [249.054450] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [249.054604] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [249.054779] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [249.054928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [249.055078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [249.055225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [249.055387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [249.055545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [249.055715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [249.055860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [249.056006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [249.056150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [249.056291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [249.056422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [249.056554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [249.056696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [249.056825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [249.056953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [249.057077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [249.057202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [249.057321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [249.057447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [249.057566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [249.057694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [249.057808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [249.057922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [249.058031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [249.058142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [249.058243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [249.058343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [249.058446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [249.058550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [249.058653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [249.058751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [249.058849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [249.058941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [249.059037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [249.059135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [249.059234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [249.059330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [249.059421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [249.059512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [249.059600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [249.059697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [249.059784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [249.059868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [249.059956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [249.060042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [249.060128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [249.060213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [249.060293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [249.060372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [249.060451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [249.060526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [249.060601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [249.060687] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [249.060811] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [249.060816] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38300, lrc_seqno=38300, guc_id=0, flags=0x73 in no process [-1] <7> [249.060818] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [249.060886] ------------[ cut here ]------------ <4> [249.060887] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [249.060889] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:7/708 <4> [249.060967] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [249.061032] <4> [249.061034] CPU: 5 UID: 0 PID: 708 Comm: kworker/u64:7 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [249.061037] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [249.061038] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [249.061040] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [249.061045] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [249.061121] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [249.061123] RSP: 0018:ffffc900016c3ca0 EFLAGS: 00010246 <4> [249.061125] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [249.061127] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [249.061128] RBP: ffffc900016c3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [249.061129] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [249.061130] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [249.061132] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [249.061133] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [249.061135] CR2: 0000718d91dbf000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [249.061136] PKRU: 55555554 <4> [249.061137] Call Trace: <4> [249.061138] <TASK> <4> [249.061142] ? lock_acquire+0x60/0x300 <4> [249.061147] ? lock_release+0xd0/0x2b0 <4> [249.061152] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [249.061158] process_one_work+0x239/0x740 <4> [249.061165] worker_thread+0x200/0x3f0 <4> [249.061168] ? __pfx_worker_thread+0x10/0x10 <4> [249.061171] kthread+0x10d/0x150 <4> [249.061173] ? __pfx_kthread+0x10/0x10 <4> [249.061176] ret_from_fork+0x3bd/0x470 <4> [249.061178] ? __pfx_kthread+0x10/0x10 <4> [249.061181] ret_from_fork_asm+0x1a/0x30 <4> [249.061188] </TASK> <4> [249.061190] irq event stamp: 373089 <4> [249.061191] hardirqs last enabled at (373095): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [249.061193] hardirqs last disabled at (373100): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [249.061194] softirqs last enabled at (372238): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.061197] softirqs last disabled at (372231): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.061200] ---[ end trace 0000000000000000 ]--- <6> [249.061201] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [249.061279] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [249.061285] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [249.062577] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [249.062698] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [249.062812] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [249.063089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [249.063236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [249.063382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [249.063523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [249.063685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [249.063834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [249.063955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [249.064062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [249.064159] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [249.064267] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [249.064370] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [249.065414] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [249.075652] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [249.075915] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [249.077102] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [249.077192] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [249.077275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [249.077355] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [249.077433] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [249.077511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [249.077587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [249.077671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [249.077754] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [249.077836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [249.077918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [249.077999] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [249.078080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [249.078156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [249.078230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [249.078302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [249.078376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [249.078449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [249.078523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [249.078609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [249.078706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [249.078789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [249.078866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [249.078945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [249.079023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [249.079098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [249.079174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [249.079249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [249.079323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [249.079401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [249.079483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [249.079562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [249.079647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [249.079730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [249.079820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [249.079904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [249.079987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [249.080068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [249.080148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [249.080223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [249.080298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [249.080372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [249.080450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [249.080526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [249.080602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [249.080686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [249.080769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [249.080850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [249.080928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [249.081003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [249.081080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [249.081153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [249.081232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [249.081309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [249.081385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [249.081461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [249.081535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [249.081608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [249.081691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [249.081775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [249.081856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [249.081931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [249.082006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [249.082080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [249.082156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [249.082230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [249.082303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [249.082375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [249.082451] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [249.082570] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [249.082575] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38300, lrc_seqno=38300, guc_id=0, flags=0x73 in no process [-1] <7> [249.082577] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [249.082660] ------------[ cut here ]------------ <4> [249.082661] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [249.082663] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:7/708 <4> [249.082747] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [249.082812] <4> [249.082814] CPU: 8 UID: 0 PID: 708 Comm: kworker/u64:7 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [249.082817] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [249.082819] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [249.082820] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [249.082826] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [249.082902] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [249.082904] RSP: 0018:ffffc900016c3ca0 EFLAGS: 00010246 <4> [249.082906] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [249.082907] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [249.082908] RBP: ffffc900016c3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [249.082909] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [249.082910] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [249.082912] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [249.082913] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [249.082914] CR2: 0000718d911e3000 CR3: 0000000136bff000 CR4: 0000000000f52ef0 <4> [249.082916] PKRU: 55555554 <4> [249.082917] Call Trace: <4> [249.082918] <TASK> <4> [249.082921] ? lock_acquire+0x60/0x300 <4> [249.082926] ? lock_release+0xd0/0x2b0 <4> [249.082930] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [249.082936] process_one_work+0x239/0x740 <4> [249.082942] worker_thread+0x200/0x3f0 <4> [249.082945] ? __pfx_worker_thread+0x10/0x10 <4> [249.082947] kthread+0x10d/0x150 <4> [249.082949] ? __pfx_kthread+0x10/0x10 <4> [249.082952] ret_from_fork+0x3bd/0x470 <4> [249.082954] ? __pfx_kthread+0x10/0x10 <4> [249.082957] ret_from_fork_asm+0x1a/0x30 <4> [249.082963] </TASK> <4> [249.082964] irq event stamp: 376301 <4> [249.082965] hardirqs last enabled at (376307): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [249.082968] hardirqs last disabled at (376312): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [249.082969] softirqs last enabled at (375540): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.082972] softirqs last disabled at (375519): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.082974] ---[ end trace 0000000000000000 ]--- <7> [249.084321] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [249.084447] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [249.090273] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38308, lrc_seqno=38308, guc_id=0, flags=0x73 in no process [-1] <7> [249.090277] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [249.090359] ------------[ cut here ]------------ <4> [249.090361] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [249.090362] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:8/983 <4> [249.090449] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [249.090516] <4> [249.090518] CPU: 6 UID: 0 PID: 983 Comm: kworker/u64:8 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [249.090521] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [249.090523] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [249.090524] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [249.090530] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [249.090609] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [249.090611] RSP: 0018:ffffc90003173ca0 EFLAGS: 00010246 <4> [249.090614] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [249.090615] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [249.090616] RBP: ffffc90003173db0 R08: 0000000000000000 R09: 0000000000000000 <4> [249.090617] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [249.090619] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [249.090620] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [249.090622] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [249.090623] CR2: 0000718d911e3000 CR3: 0000000136bff000 CR4: 0000000000f52ef0 <4> [249.090625] PKRU: 55555554 <4> [249.090626] Call Trace: <4> [249.090627] <TASK> <4> [249.090639] ? lock_acquire+0x60/0x300 <4> [249.090645] ? lock_release+0xd0/0x2b0 <4> [249.090650] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [249.090656] process_one_work+0x239/0x740 <4> [249.090663] worker_thread+0x200/0x3f0 <4> [249.090666] ? __pfx_worker_thread+0x10/0x10 <4> [249.090669] kthread+0x10d/0x150 <4> [249.090671] ? __pfx_kthread+0x10/0x10 <4> [249.090674] ret_from_fork+0x3bd/0x470 <4> [249.090676] ? __pfx_kthread+0x10/0x10 <4> [249.090679] ret_from_fork_asm+0x1a/0x30 <4> [249.090687] </TASK> <4> [249.090688] irq event stamp: 1404713 <4> [249.090689] hardirqs last enabled at (1404719): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [249.090691] hardirqs last disabled at (1404724): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [249.090693] softirqs last enabled at (1404640): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.090696] softirqs last disabled at (1404623): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.090699] ---[ end trace 0000000000000000 ]--- <6> [249.090701] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [249.090778] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [249.090785] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [249.091192] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [249.091418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [249.091521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [249.091622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [249.091743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [249.091835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [249.091923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [249.092009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [249.092097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [249.092179] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [249.092280] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [249.092374] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [249.093417] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [249.103640] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [249.103898] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [249.104838] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [249.104927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [249.105009] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [249.105091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [249.105170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [249.105249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [249.105328] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [249.105404] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [249.105480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [249.105558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [249.105641] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [249.105731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [249.105808] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [249.105884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [249.105960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [249.106035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [249.106110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [249.106185] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [249.106262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [249.106359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [249.106445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [249.106528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [249.106609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [249.106707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [249.106800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [249.106880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [249.106979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [249.107102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [249.107187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [249.107269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [249.107355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [249.107438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [249.107519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [249.107598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [249.107707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [249.107801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [249.107886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [249.107966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [249.108047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [249.108124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [249.108202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [249.108278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [249.108353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [249.108429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [249.108512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [249.108591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [249.108682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [249.108784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [249.108862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [249.108939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [249.109019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [249.109096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [249.109174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [249.109250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [249.109326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [249.109403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [249.109479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [249.109555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [249.109629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [249.109729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [249.109819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [249.109898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [249.109975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [249.110049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [249.110125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [249.110200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [249.110275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [249.110352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [249.110430] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [249.110553] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [249.110558] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38308, lrc_seqno=38308, guc_id=0, flags=0x73 in no process [-1] <7> [249.110560] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [249.110628] ------------[ cut here ]------------ <4> [249.110629] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [249.110631] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:7/708 <4> [249.110730] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [249.110814] <4> [249.110816] CPU: 11 UID: 0 PID: 708 Comm: kworker/u64:7 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [249.110820] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [249.110821] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [249.110822] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [249.110828] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [249.110908] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [249.110910] RSP: 0018:ffffc900016c3ca0 EFLAGS: 00010246 <4> [249.110912] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [249.110913] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [249.110914] RBP: ffffc900016c3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [249.110916] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [249.110917] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [249.110918] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [249.110920] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [249.110921] CR2: 0000718d911e3000 CR3: 00000001227a0000 CR4: 0000000000f52ef0 <4> [249.110923] PKRU: 55555554 <4> [249.110924] Call Trace: <4> [249.110925] <TASK> <4> [249.110929] ? lock_acquire+0x60/0x300 <4> [249.110934] ? lock_release+0xd0/0x2b0 <4> [249.110939] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [249.110945] process_one_work+0x239/0x740 <4> [249.110952] worker_thread+0x200/0x3f0 <4> [249.110955] ? __pfx_worker_thread+0x10/0x10 <4> [249.110957] kthread+0x10d/0x150 <4> [249.110960] ? __pfx_kthread+0x10/0x10 <4> [249.110963] ret_from_fork+0x3bd/0x470 <4> [249.110965] ? __pfx_kthread+0x10/0x10 <4> [249.110968] ret_from_fork_asm+0x1a/0x30 <4> [249.110975] </TASK> <4> [249.110976] irq event stamp: 380029 <4> [249.110978] hardirqs last enabled at (380035): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [249.110980] hardirqs last disabled at (380040): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [249.110981] softirqs last enabled at (379286): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.110984] softirqs last disabled at (379273): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.110987] ---[ end trace 0000000000000000 ]--- <6> [249.111793] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [249.112136] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [249.112148] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [249.112242] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [249.112358] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [249.112474] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [249.112772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [249.112919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [249.113066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [249.113208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [249.113348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [249.113486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [249.113626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [249.113789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [249.113906] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [249.114022] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [249.114129] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [249.115173] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [249.125639] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [249.125900] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [249.126855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [249.126948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [249.127035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [249.127121] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [249.127205] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [249.127289] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [249.127372] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [249.127458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [249.127541] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [249.127623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [249.127724] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [249.127806] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [249.127887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [249.127967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [249.128047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [249.128128] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [249.128210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [249.128291] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [249.128371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [249.128464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [249.128555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [249.128646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [249.128731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [249.128817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [249.128903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [249.128986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [249.129073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [249.129160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [249.129245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [249.129332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [249.129420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [249.129505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [249.129591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [249.129685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [249.129778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [249.129869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [249.129961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [249.130048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [249.130136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [249.130219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [249.130303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [249.130385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [249.130466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [249.130551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [249.130640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [249.130724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [249.130809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [249.130892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [249.130972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [249.131054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [249.131144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [249.131228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [249.131311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [249.131393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [249.131473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [249.131557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [249.131645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [249.131728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [249.131809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [249.131902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [249.131984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [249.132068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [249.132149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [249.132231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [249.132315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [249.132398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [249.132479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [249.132558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [249.132647] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [249.132774] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [249.132779] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38308, lrc_seqno=38308, guc_id=0, flags=0x73 in no process [-1] <7> [249.132781] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [249.132853] ------------[ cut here ]------------ <4> [249.132854] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [249.132855] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:4/203 <4> [249.132939] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [249.133005] <4> [249.133007] CPU: 8 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [249.133010] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [249.133011] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [249.133013] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [249.133019] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [249.133100] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [249.133102] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [249.133104] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [249.133105] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [249.133107] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [249.133108] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [249.133109] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [249.133111] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [249.133112] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [249.133114] CR2: 0000718d911e3000 CR3: 00000001227a0000 CR4: 0000000000f52ef0 <4> [249.133115] PKRU: 55555554 <4> [249.133116] Call Trace: <4> [249.133117] <TASK> <4> [249.133121] ? lock_acquire+0x60/0x300 <4> [249.133127] ? lock_release+0xd0/0x2b0 <4> [249.133132] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [249.133138] process_one_work+0x239/0x740 <4> [249.133145] worker_thread+0x200/0x3f0 <4> [249.133148] ? __pfx_worker_thread+0x10/0x10 <4> [249.133150] kthread+0x10d/0x150 <4> [249.133153] ? __pfx_kthread+0x10/0x10 <4> [249.133155] ret_from_fork+0x3bd/0x470 <4> [249.133158] ? __pfx_kthread+0x10/0x10 <4> [249.133161] ret_from_fork_asm+0x1a/0x30 <4> [249.133168] </TASK> <4> [249.133170] irq event stamp: 313345 <4> [249.133171] hardirqs last enabled at (313351): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [249.133173] hardirqs last disabled at (313356): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [249.133175] softirqs last enabled at (312494): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.133178] softirqs last disabled at (312483): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.133180] ---[ end trace 0000000000000000 ]--- <7> [249.134439] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [249.134561] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [249.135337] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1515) -> ( 0 - 1989), size 1515 -> 1989 <7> [249.135433] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb (1515 - 1989) -> ( 0 - 0), size 474 -> 0 <7> [249.135516] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [249.135593] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.135679] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.135751] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.135823] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [249.135894] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.135965] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.136037] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.136123] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 594000 num active planes 1 <7> [249.136232] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000 <7> [249.136338] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000 <7> [249.136442] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624 <7> [249.147309] xe 0000:03:00.0: [drm:i915_fifo_underrun_reset_write [xe]] Re-arming FIFO underruns on pipe C <7> [249.231526] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1989) -> ( 0 - 1515), size 1989 -> 1515 <7> [249.232178] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb ( 0 - 0) -> (1515 - 1989), size 0 -> 474 <7> [249.232669] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm <7> [249.233095] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [249.233513] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 <7> [249.233966] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 <7> [249.234366] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm <7> [249.234796] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [249.235181] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 <7> [249.235565] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 <7> [249.236048] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 1188000 num active planes 2 <7> [249.236167] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 1248 qgv_peak_bw: 48000 <7> [249.236269] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 1248 qgv_peak_bw: 48000 <7> [249.236368] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 1248 <5> [249.281448] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38309, lrc_seqno=38309, guc_id=0, flags=0x73 in no process [-1] <7> [249.281476] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [249.282142] ------------[ cut here ]------------ <4> [249.282153] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [249.282163] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:8/983 <4> [249.282767] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [249.283156] <4> [249.283170] CPU: 8 UID: 0 PID: 983 Comm: kworker/u64:8 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [249.283188] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [249.283196] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [249.283204] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [249.283237] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [249.283711] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [249.283721] RSP: 0018:ffffc90003173ca0 EFLAGS: 00010246 <4> [249.283733] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [249.283741] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [249.283748] RBP: ffffc90003173db0 R08: 0000000000000000 R09: 0000000000000000 <4> [249.283755] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [249.283761] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [249.283770] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [249.283778] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [249.283786] CR2: 0000718d911e3000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [249.283795] PKRU: 55555554 <4> [249.283802] Call Trace: <4> [249.283809] <TASK> <4> [249.283832] ? lock_acquire+0x60/0x300 <4> [249.283860] ? lock_release+0xd0/0x2b0 <4> [249.283884] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [249.283915] process_one_work+0x239/0x740 <4> [249.283950] worker_thread+0x200/0x3f0 <4> [249.283967] ? __pfx_worker_thread+0x10/0x10 <4> [249.283982] kthread+0x10d/0x150 <4> [249.283993] ? __pfx_kthread+0x10/0x10 <4> [249.284009] ret_from_fork+0x3bd/0x470 <4> [249.284022] ? __pfx_kthread+0x10/0x10 <4> [249.284037] ret_from_fork_asm+0x1a/0x30 <4> [249.284076] </TASK> <4> [249.284082] irq event stamp: 1406567 <4> [249.284089] hardirqs last enabled at (1406573): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [249.284101] hardirqs last disabled at (1406578): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [249.284109] softirqs last enabled at (1405822): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.284125] softirqs last disabled at (1405815): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.284139] ---[ end trace 0000000000000000 ]--- <6> [249.284151] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [249.284729] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [249.284790] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [249.285123] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [249.285771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [249.286285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [249.286818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [249.287234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [249.287321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [249.287408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [249.287495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [249.287583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [249.287674] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [249.287780] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [249.287872] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [249.288907] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [249.299758] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [249.300181] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [249.301499] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [249.301703] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [249.301878] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [249.302044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [249.302212] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [249.302385] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [249.302556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [249.302741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [249.302926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [249.303104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [249.303281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [249.303458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [249.303624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [249.303815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [249.303979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [249.304136] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [249.304293] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [249.304447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [249.304596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [249.304793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [249.304958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [249.305115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [249.305259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [249.305404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [249.305553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [249.305710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [249.305849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [249.305979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [249.306110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [249.306237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [249.306367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [249.306494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [249.306621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [249.306763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [249.306897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [249.307023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [249.307147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [249.307264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [249.307381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [249.307493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [249.307604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [249.307717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [249.307822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [249.307925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [249.308028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [249.308128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [249.308225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [249.308322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [249.308419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [249.308519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [249.308616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [249.308723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [249.308818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [249.308909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [249.308998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [249.309088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [249.309175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [249.309260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [249.309345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [249.309433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [249.309518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [249.309598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [249.309688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [249.309771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [249.309850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [249.309928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [249.310004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [249.310079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [249.310157] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [249.310279] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [249.310283] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38309, lrc_seqno=38309, guc_id=0, flags=0x73 in no process [-1] <7> [249.310286] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [249.310353] ------------[ cut here ]------------ <4> [249.310354] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [249.310355] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:8/983 <4> [249.310433] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [249.310494] <4> [249.310496] CPU: 8 UID: 0 PID: 983 Comm: kworker/u64:8 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [249.310499] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [249.310500] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [249.310501] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [249.310507] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [249.310591] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [249.310593] RSP: 0018:ffffc90003173ca0 EFLAGS: 00010246 <4> [249.310595] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [249.310596] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [249.310597] RBP: ffffc90003173db0 R08: 0000000000000000 R09: 0000000000000000 <4> [249.310598] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [249.310599] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [249.310601] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [249.310602] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [249.310603] CR2: 0000718d911e3000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [249.310605] PKRU: 55555554 <4> [249.310606] Call Trace: <4> [249.310607] <TASK> <4> [249.310611] ? lock_acquire+0x60/0x300 <4> [249.310615] ? lock_release+0xd0/0x2b0 <4> [249.310620] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [249.310625] process_one_work+0x239/0x740 <4> [249.310635] worker_thread+0x200/0x3f0 <4> [249.310638] ? __pfx_worker_thread+0x10/0x10 <4> [249.310640] kthread+0x10d/0x150 <4> [249.310642] ? __pfx_kthread+0x10/0x10 <4> [249.310645] ret_from_fork+0x3bd/0x470 <4> [249.310647] ? __pfx_kthread+0x10/0x10 <4> [249.310650] ret_from_fork_asm+0x1a/0x30 <4> [249.310657] </TASK> <4> [249.310658] irq event stamp: 1409799 <4> [249.310659] hardirqs last enabled at (1409805): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [249.310662] hardirqs last disabled at (1409810): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [249.310663] softirqs last enabled at (1408908): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.310666] softirqs last disabled at (1408897): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.310669] ---[ end trace 0000000000000000 ]--- <6> [249.311593] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [249.311680] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [249.311692] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [249.311748] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [249.311855] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [249.311962] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [249.312174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [249.312267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [249.312361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [249.312450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [249.312536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [249.312619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [249.312719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [249.312811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [249.312899] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [249.313005] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [249.313105] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [249.314143] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [249.324639] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [249.324898] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [249.325969] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [249.326060] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [249.326143] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [249.326220] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [249.326297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [249.326373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [249.326449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [249.326527] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [249.326602] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [249.326690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [249.326773] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [249.326854] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [249.326934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [249.327015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [249.327096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [249.327175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [249.327256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [249.327335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [249.327415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [249.327502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [249.327591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [249.327696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [249.327781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [249.327867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [249.327952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [249.328034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [249.328117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [249.328200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [249.328282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [249.328367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [249.328453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [249.328537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [249.328620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [249.328717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [249.328823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [249.328914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [249.329003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [249.329090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [249.329175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [249.329257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [249.329339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [249.329421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [249.329500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [249.329583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [249.329674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [249.329758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [249.329841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [249.329923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [249.330004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [249.330087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [249.330172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [249.330253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [249.330336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [249.330417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [249.330499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [249.330581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [249.330671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [249.330752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [249.330837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [249.330925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [249.331008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [249.331092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [249.331174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [249.331255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [249.331338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [249.331421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [249.331502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [249.331583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [249.331676] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [249.331804] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [249.331808] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38309, lrc_seqno=38309, guc_id=0, flags=0x73 in no process [-1] <7> [249.331810] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [249.331881] ------------[ cut here ]------------ <4> [249.331882] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [249.331884] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:8/983 <4> [249.331969] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [249.332032] <4> [249.332034] CPU: 8 UID: 0 PID: 983 Comm: kworker/u64:8 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [249.332037] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [249.332038] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [249.332039] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [249.332045] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [249.332125] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [249.332127] RSP: 0018:ffffc90003173ca0 EFLAGS: 00010246 <4> [249.332129] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [249.332131] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [249.332132] RBP: ffffc90003173db0 R08: 0000000000000000 R09: 0000000000000000 <4> [249.332133] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [249.332135] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [249.332136] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [249.332138] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [249.332139] CR2: 0000718d911e3000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [249.332140] PKRU: 55555554 <4> [249.332142] Call Trace: <4> [249.332143] <TASK> <4> [249.332147] ? lock_acquire+0x60/0x300 <4> [249.332152] ? lock_release+0xd0/0x2b0 <4> [249.332157] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [249.332163] process_one_work+0x239/0x740 <4> [249.332169] worker_thread+0x200/0x3f0 <4> [249.332172] ? __pfx_worker_thread+0x10/0x10 <4> [249.332175] kthread+0x10d/0x150 <4> [249.332177] ? __pfx_kthread+0x10/0x10 <4> [249.332180] ret_from_fork+0x3bd/0x470 <4> [249.332182] ? __pfx_kthread+0x10/0x10 <4> [249.332185] ret_from_fork_asm+0x1a/0x30 <4> [249.332193] </TASK> <4> [249.332194] irq event stamp: 1413059 <4> [249.332195] hardirqs last enabled at (1413065): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [249.332197] hardirqs last disabled at (1413070): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [249.332199] softirqs last enabled at (1412208): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.332202] softirqs last disabled at (1412197): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.332204] ---[ end trace 0000000000000000 ]--- <7> [249.333496] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [249.333621] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [249.339258] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38317, lrc_seqno=38317, guc_id=0, flags=0x73 in no process [-1] <7> [249.339261] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [249.339341] ------------[ cut here ]------------ <4> [249.339343] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [249.339344] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:8/983 <4> [249.339426] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [249.339492] <4> [249.339495] CPU: 8 UID: 0 PID: 983 Comm: kworker/u64:8 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [249.339497] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [249.339498] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [249.339500] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [249.339505] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [249.339584] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [249.339586] RSP: 0018:ffffc90003173ca0 EFLAGS: 00010246 <4> [249.339588] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [249.339589] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [249.339591] RBP: ffffc90003173db0 R08: 0000000000000000 R09: 0000000000000000 <4> [249.339592] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [249.339593] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [249.339594] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [249.339596] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [249.339597] CR2: 0000718d911e3000 CR3: 0000000136bff000 CR4: 0000000000f52ef0 <4> [249.339599] PKRU: 55555554 <4> [249.339600] Call Trace: <4> [249.339601] <TASK> <4> [249.339604] ? lock_acquire+0x60/0x300 <4> [249.339610] ? lock_release+0xd0/0x2b0 <4> [249.339614] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [249.339620] process_one_work+0x239/0x740 <4> [249.339627] worker_thread+0x200/0x3f0 <4> [249.339630] ? __pfx_worker_thread+0x10/0x10 <4> [249.339637] kthread+0x10d/0x150 <4> [249.339639] ? __pfx_kthread+0x10/0x10 <4> [249.339642] ret_from_fork+0x3bd/0x470 <4> [249.339645] ? __pfx_kthread+0x10/0x10 <4> [249.339648] ret_from_fork_asm+0x1a/0x30 <4> [249.339656] </TASK> <4> [249.339657] irq event stamp: 1414085 <4> [249.339658] hardirqs last enabled at (1414091): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [249.339660] hardirqs last disabled at (1414096): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [249.339662] softirqs last enabled at (1414044): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.339665] softirqs last disabled at (1414039): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.339668] ---[ end trace 0000000000000000 ]--- <6> [249.339670] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [249.339749] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [249.339757] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [249.340039] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [249.340262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [249.340365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [249.340465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [249.340557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [249.340657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [249.340753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [249.340845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [249.340935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [249.341019] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [249.341121] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [249.341216] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [249.342255] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [249.352639] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [249.352899] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [249.353902] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [249.353987] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [249.354068] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [249.354149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [249.354229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [249.354309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [249.354387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [249.354465] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [249.354545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [249.354623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [249.354715] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [249.354791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [249.354868] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [249.354944] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [249.355021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [249.355096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [249.355171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [249.355244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [249.355318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [249.355403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [249.355485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [249.355566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [249.355654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [249.355736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [249.355816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [249.355894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [249.355971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [249.356047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [249.356123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [249.356201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [249.356281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [249.356359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [249.356436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [249.356514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [249.356596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [249.356687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [249.356771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [249.356851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [249.356932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [249.357010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [249.357091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [249.357172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [249.357249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [249.357327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [249.357405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [249.357484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [249.357562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [249.357646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [249.357723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [249.357799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [249.357883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [249.357960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [249.358039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [249.358119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [249.358199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [249.358277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [249.358359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [249.358436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [249.358512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [249.358589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [249.358676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [249.358755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [249.358835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [249.358912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [249.358990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [249.359069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [249.359145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [249.359223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [249.359302] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [249.359426] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [249.359430] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38317, lrc_seqno=38317, guc_id=0, flags=0x73 in no process [-1] <7> [249.359433] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [249.359677] ------------[ cut here ]------------ <4> [249.359682] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [249.359686] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:7/708 <4> [249.360055] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [249.360200] <4> [249.360206] CPU: 1 UID: 0 PID: 708 Comm: kworker/u64:7 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [249.360216] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [249.360218] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [249.360220] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [249.360238] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [249.360408] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [249.360410] RSP: 0018:ffffc900016c3ca0 EFLAGS: 00010246 <4> [249.360412] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [249.360414] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [249.360415] RBP: ffffc900016c3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [249.360416] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [249.360417] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [249.360419] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [249.360420] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [249.360422] CR2: 0000718d911e3000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [249.360423] PKRU: 55555554 <4> [249.360424] Call Trace: <4> [249.360425] <TASK> <4> [249.360430] ? lock_acquire+0x60/0x300 <4> [249.360438] ? lock_release+0xd0/0x2b0 <4> [249.360447] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [249.360457] process_one_work+0x239/0x740 <4> [249.360469] worker_thread+0x200/0x3f0 <4> [249.360473] ? __pfx_worker_thread+0x10/0x10 <4> [249.360477] kthread+0x10d/0x150 <4> [249.360480] ? __pfx_kthread+0x10/0x10 <4> [249.360485] ret_from_fork+0x3bd/0x470 <4> [249.360488] ? __pfx_kthread+0x10/0x10 <4> [249.360491] ret_from_fork_asm+0x1a/0x30 <4> [249.360504] </TASK> <4> [249.360506] irq event stamp: 385433 <4> [249.360508] hardirqs last enabled at (385439): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [249.360512] hardirqs last disabled at (385444): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [249.360515] softirqs last enabled at (384526): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.360519] softirqs last disabled at (384515): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.360523] ---[ end trace 0000000000000000 ]--- <7> [249.360455] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [249.360526] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [249.360663] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [249.360676] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [249.360618] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [249.360848] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [249.361073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [249.361222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [249.361366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [249.361501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [249.361641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [249.361742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [249.361834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [249.361926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [249.362012] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [249.362114] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [249.362209] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [249.363246] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [249.373983] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [249.374241] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [249.375263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [249.375348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [249.375427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [249.375509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [249.375588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [249.375680] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [249.375757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [249.375835] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [249.375915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [249.375991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [249.376066] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [249.376142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [249.376218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [249.376294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [249.376370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [249.376446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [249.376521] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [249.376596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [249.376680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [249.376766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [249.376849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [249.376931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [249.377010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [249.377090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [249.377170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [249.377248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [249.377325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [249.377403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [249.377480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [249.377560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [249.377643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [249.377722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [249.377802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [249.377882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [249.377968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [249.378053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [249.378136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [249.378218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [249.378298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [249.378376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [249.378453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [249.378531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [249.378606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [249.378693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [249.378772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [249.378851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [249.378930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [249.379006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [249.379082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [249.379160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [249.379244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [249.379321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [249.379402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [249.379482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [249.379557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [249.379639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [249.379717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [249.379793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [249.379869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [249.379947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [249.380023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [249.380101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [249.380176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [249.380255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [249.380332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [249.380413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [249.380489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [249.380566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [249.380648] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [249.380770] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [249.380775] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38317, lrc_seqno=38317, guc_id=0, flags=0x73 in no process [-1] <7> [249.380777] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [249.380845] ------------[ cut here ]------------ <4> [249.380846] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [249.380848] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:8/983 <4> [249.380927] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [249.380994] <4> [249.380996] CPU: 11 UID: 0 PID: 983 Comm: kworker/u64:8 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [249.380999] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [249.381000] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [249.381002] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [249.381007] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [249.381085] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [249.381087] RSP: 0018:ffffc90003173ca0 EFLAGS: 00010246 <4> [249.381090] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [249.381091] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [249.381093] RBP: ffffc90003173db0 R08: 0000000000000000 R09: 0000000000000000 <4> [249.381094] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [249.381096] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [249.381097] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [249.381099] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [249.381101] CR2: 0000718d911e3000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [249.381103] PKRU: 55555554 <4> [249.381104] Call Trace: <4> [249.381105] <TASK> <4> [249.381109] ? lock_acquire+0x60/0x300 <4> [249.381115] ? lock_release+0xd0/0x2b0 <4> [249.381120] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [249.381126] process_one_work+0x239/0x740 <4> [249.381133] worker_thread+0x200/0x3f0 <4> [249.381137] ? __pfx_worker_thread+0x10/0x10 <4> [249.381139] kthread+0x10d/0x150 <4> [249.381142] ? __pfx_kthread+0x10/0x10 <4> [249.381145] ret_from_fork+0x3bd/0x470 <4> [249.381148] ? __pfx_kthread+0x10/0x10 <4> [249.381151] ret_from_fork_asm+0x1a/0x30 <4> [249.381159] </TASK> <4> [249.381160] irq event stamp: 1417557 <4> [249.381161] hardirqs last enabled at (1417563): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [249.381164] hardirqs last disabled at (1417568): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [249.381166] softirqs last enabled at (1416622): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.381169] softirqs last disabled at (1416615): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.381172] ---[ end trace 0000000000000000 ]--- <7> [249.382433] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [249.382559] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [249.383336] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1515) -> ( 0 - 1989), size 1515 -> 1989 <7> [249.383434] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb (1515 - 1989) -> ( 0 - 0), size 474 -> 0 <7> [249.383519] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [249.383597] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.383686] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.383762] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.383836] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [249.383909] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.383984] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.384056] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.384142] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 594000 num active planes 1 <7> [249.384253] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000 <7> [249.384358] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000 <7> [249.384460] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624 <7> [249.397756] xe 0000:03:00.0: [drm:i915_fifo_underrun_reset_write [xe]] Re-arming FIFO underruns on pipe C <7> [249.481687] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1989) -> ( 0 - 1515), size 1989 -> 1515 <7> [249.482250] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb ( 0 - 0) -> (1515 - 1989), size 0 -> 474 <7> [249.482760] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm <7> [249.483187] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [249.483591] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 <7> [249.484068] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 <7> [249.484475] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm <7> [249.484921] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [249.485316] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 <7> [249.485729] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 <7> [249.486186] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 1188000 num active planes 2 <7> [249.486556] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 1248 qgv_peak_bw: 48000 <7> [249.486686] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 1248 qgv_peak_bw: 48000 <7> [249.486790] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 1248 <5> [249.531912] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38318, lrc_seqno=38318, guc_id=0, flags=0x73 in no process [-1] <7> [249.531938] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [249.532371] ------------[ cut here ]------------ <4> [249.532378] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [249.532386] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:2/121 <4> [249.532936] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [249.533315] <4> [249.533330] CPU: 11 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [249.533347] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [249.533355] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [249.533364] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [249.533395] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [249.533868] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [249.533878] RSP: 0018:ffffc9000056fca0 EFLAGS: 00010246 <4> [249.533893] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [249.533902] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [249.533910] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [249.533917] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [249.533925] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [249.533932] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [249.533942] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [249.533949] CR2: 0000718d911e3000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [249.533958] PKRU: 55555554 <4> [249.533966] Call Trace: <4> [249.533974] <TASK> <4> [249.533997] ? lock_acquire+0x60/0x300 <4> [249.534026] ? lock_release+0xd0/0x2b0 <4> [249.534052] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [249.534085] process_one_work+0x239/0x740 <4> [249.534120] worker_thread+0x200/0x3f0 <4> [249.534137] ? __pfx_worker_thread+0x10/0x10 <4> [249.534152] kthread+0x10d/0x150 <4> [249.534165] ? __pfx_kthread+0x10/0x10 <4> [249.534181] ret_from_fork+0x3bd/0x470 <4> [249.534194] ? __pfx_kthread+0x10/0x10 <4> [249.534210] ret_from_fork_asm+0x1a/0x30 <4> [249.534251] </TASK> <4> [249.534257] irq event stamp: 770703 <4> [249.534264] hardirqs last enabled at (770709): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [249.534276] hardirqs last disabled at (770714): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [249.534284] softirqs last enabled at (769958): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.534301] softirqs last disabled at (769951): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.534315] ---[ end trace 0000000000000000 ]--- <6> [249.534325] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [249.534783] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [249.534831] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [249.535223] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [249.535915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [249.536430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [249.537033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [249.537513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [249.537872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [249.537960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [249.538045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [249.538133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [249.538215] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [249.538320] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [249.538420] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [249.539560] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [249.550372] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [249.550785] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [249.552715] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [249.552906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [249.553080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [249.553253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [249.553425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [249.553605] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [249.553813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [249.553992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [249.554168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [249.554343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [249.554517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [249.554703] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [249.554874] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [249.555040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [249.555206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [249.555365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [249.555521] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [249.555688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [249.555837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [249.556009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [249.556176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [249.556333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [249.556481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [249.556626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [249.556796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [249.556938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [249.557074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [249.557210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [249.557346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [249.557480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [249.557616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [249.557764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [249.557893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [249.558015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [249.558142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [249.558268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [249.558387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [249.558503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [249.558618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [249.558742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [249.558851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [249.558960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [249.559064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [249.559172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [249.559277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [249.559381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [249.559483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [249.559581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [249.559686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [249.559783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [249.559881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [249.559973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [249.560063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [249.560151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [249.560239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [249.560330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [249.560419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [249.560502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [249.560590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [249.560687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [249.560773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [249.560858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [249.560940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [249.561020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [249.561103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [249.561184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [249.561263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [249.561342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [249.561425] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [249.561556] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [249.561561] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38318, lrc_seqno=38318, guc_id=0, flags=0x73 in no process [-1] <7> [249.561564] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [249.561652] ------------[ cut here ]------------ <4> [249.561656] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [249.561659] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [249.562089] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [249.562214] <4> [249.562219] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [249.562225] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [249.562227] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [249.562230] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [249.562249] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [249.562507] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [249.562509] RSP: 0018:ffffc9000056fca0 EFLAGS: 00010246 <4> [249.562511] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [249.562513] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [249.562514] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [249.562515] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [249.562516] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [249.562518] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [249.562519] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [249.562521] CR2: 00007fe39846f000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [249.562522] PKRU: 55555554 <4> [249.562523] Call Trace: <4> [249.562525] <TASK> <4> [249.562529] ? lock_acquire+0x60/0x300 <4> [249.562535] ? lock_release+0xd0/0x2b0 <4> [249.562540] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [249.562547] process_one_work+0x239/0x740 <4> [249.562556] worker_thread+0x200/0x3f0 <4> [249.562560] ? __pfx_worker_thread+0x10/0x10 <4> [249.562564] kthread+0x10d/0x150 <4> [249.562568] ? __pfx_kthread+0x10/0x10 <4> [249.562573] ret_from_fork+0x3bd/0x470 <4> [249.562577] ? __pfx_kthread+0x10/0x10 <4> [249.562582] ret_from_fork_asm+0x1a/0x30 <4> [249.562595] </TASK> <4> [249.562597] irq event stamp: 773913 <4> [249.562599] hardirqs last enabled at (773919): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [249.562602] hardirqs last disabled at (773924): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [249.562605] softirqs last enabled at (772790): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.562609] softirqs last disabled at (772783): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.562613] ---[ end trace 0000000000000000 ]--- <7> [249.562585] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [249.562672] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [249.562777] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [249.562786] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [249.562759] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [249.562957] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [249.563177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [249.563282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [249.563387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [249.563483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [249.563577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [249.563683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [249.563777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [249.563871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [249.563960] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [249.564068] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [249.564168] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [249.565207] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [249.575640] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [249.575919] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [249.576951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [249.577048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [249.577137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [249.577225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [249.577310] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [249.577393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [249.577477] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [249.577560] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [249.577649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [249.577731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [249.577813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [249.577894] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [249.577983] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [249.578064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [249.578144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [249.578225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [249.578305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [249.578386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [249.578465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [249.578561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [249.578656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [249.578743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [249.578827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [249.578912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [249.578995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [249.579077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [249.579158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [249.579240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [249.579321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [249.579406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [249.579492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [249.579576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [249.579666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [249.579751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [249.579841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [249.579930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [249.580020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [249.580106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [249.580191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [249.580274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [249.580356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [249.580438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [249.580519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [249.580601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [249.580692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [249.580775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [249.580857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [249.580939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [249.581019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [249.581101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [249.581185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [249.581266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [249.581347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [249.581428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [249.581509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [249.581592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [249.581681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [249.581762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [249.581843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [249.581927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [249.582010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [249.582092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [249.582172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [249.582252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [249.582333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [249.582416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [249.582496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [249.582576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [249.582666] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [249.582797] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [249.582802] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38318, lrc_seqno=38318, guc_id=0, flags=0x73 in no process [-1] <7> [249.582804] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [249.582877] ------------[ cut here ]------------ <4> [249.582878] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [249.582880] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:2/121 <4> [249.582963] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [249.583027] <4> [249.583029] CPU: 6 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [249.583033] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [249.583034] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [249.583035] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [249.583041] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [249.583121] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [249.583123] RSP: 0018:ffffc9000056fca0 EFLAGS: 00010246 <4> [249.583126] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [249.583127] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [249.583129] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [249.583130] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [249.583131] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [249.583132] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [249.583134] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [249.583135] CR2: 0000718d911e3000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [249.583137] PKRU: 55555554 <4> [249.583138] Call Trace: <4> [249.583139] <TASK> <4> [249.583143] ? lock_acquire+0x60/0x300 <4> [249.583149] ? lock_release+0xd0/0x2b0 <4> [249.583154] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [249.583160] process_one_work+0x239/0x740 <4> [249.583167] worker_thread+0x200/0x3f0 <4> [249.583170] ? __pfx_worker_thread+0x10/0x10 <4> [249.583172] kthread+0x10d/0x150 <4> [249.583175] ? __pfx_kthread+0x10/0x10 <4> [249.583178] ret_from_fork+0x3bd/0x470 <4> [249.583180] ? __pfx_kthread+0x10/0x10 <4> [249.583183] ret_from_fork_asm+0x1a/0x30 <4> [249.583191] </TASK> <4> [249.583192] irq event stamp: 777057 <4> [249.583193] hardirqs last enabled at (777063): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [249.583196] hardirqs last disabled at (777068): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [249.583197] softirqs last enabled at (775768): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.583200] softirqs last disabled at (775759): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.583203] ---[ end trace 0000000000000000 ]--- <7> [249.584525] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [249.584664] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [249.591210] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38326, lrc_seqno=38326, guc_id=0, flags=0x73 in no process [-1] <7> [249.591213] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [249.591282] ------------[ cut here ]------------ <4> [249.591283] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [249.591285] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:2/121 <4> [249.591363] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [249.591428] <4> [249.591430] CPU: 6 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [249.591433] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [249.591434] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [249.591436] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [249.591441] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [249.591517] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [249.591518] RSP: 0018:ffffc9000056fca0 EFLAGS: 00010246 <4> [249.591521] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [249.591522] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [249.591523] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [249.591524] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [249.591526] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [249.591527] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [249.591528] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [249.591530] CR2: 0000718d911e3000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [249.591531] PKRU: 55555554 <4> [249.591532] Call Trace: <4> [249.591533] <TASK> <4> [249.591537] ? lock_acquire+0x60/0x300 <4> [249.591543] ? lock_release+0xd0/0x2b0 <4> [249.591547] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [249.591553] process_one_work+0x239/0x740 <4> [249.591561] worker_thread+0x200/0x3f0 <4> [249.591564] ? __pfx_worker_thread+0x10/0x10 <4> [249.591566] kthread+0x10d/0x150 <4> [249.591569] ? __pfx_kthread+0x10/0x10 <4> [249.591572] ret_from_fork+0x3bd/0x470 <4> [249.591574] ? __pfx_kthread+0x10/0x10 <4> [249.591577] ret_from_fork_asm+0x1a/0x30 <4> [249.591585] </TASK> <4> [249.591586] irq event stamp: 778161 <4> [249.591587] hardirqs last enabled at (778167): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [249.591589] hardirqs last disabled at (778172): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [249.591590] softirqs last enabled at (775768): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.591594] softirqs last disabled at (775759): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.591596] ---[ end trace 0000000000000000 ]--- <6> [249.591598] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [249.591683] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [249.591690] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [249.591864] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [249.592097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [249.592207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [249.592316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [249.592419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [249.592519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [249.592611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [249.592714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [249.592808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [249.592898] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [249.593003] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [249.593102] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [249.594145] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [249.604639] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [249.604902] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [249.605905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [249.605997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [249.606083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [249.606169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [249.606271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [249.606353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [249.606437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [249.606517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [249.606598] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [249.606688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [249.606770] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [249.606853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [249.606934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [249.607016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [249.607097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [249.607178] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [249.607259] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [249.607339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [249.607421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [249.607511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [249.607600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [249.607695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [249.607779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [249.607864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [249.607948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [249.608031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [249.608114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [249.608196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [249.608278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [249.608363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [249.608448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [249.608535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [249.608622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [249.608719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [249.608808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [249.608897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [249.608986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [249.609071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [249.609156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [249.609237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [249.609320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [249.609400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [249.609480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [249.609561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [249.609645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [249.609726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [249.609811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [249.609892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [249.609972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [249.610054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [249.610137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [249.610219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [249.610301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [249.610382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [249.610463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [249.610546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [249.610626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [249.610720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [249.610801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [249.610885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [249.610967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [249.611048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [249.611133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [249.611213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [249.611295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [249.611380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [249.611460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [249.611540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [249.611625] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [249.611767] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [249.611772] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38326, lrc_seqno=38326, guc_id=0, flags=0x73 in no process [-1] <7> [249.611774] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [249.611846] ------------[ cut here ]------------ <4> [249.611848] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [249.611849] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:8/983 <4> [249.611932] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [249.611998] <4> [249.612001] CPU: 8 UID: 0 PID: 983 Comm: kworker/u64:8 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [249.612004] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [249.612005] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [249.612007] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [249.612013] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [249.612094] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [249.612096] RSP: 0018:ffffc90003173ca0 EFLAGS: 00010246 <4> [249.612098] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [249.612100] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [249.612101] RBP: ffffc90003173db0 R08: 0000000000000000 R09: 0000000000000000 <4> [249.612102] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [249.612103] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [249.612105] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [249.612106] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [249.612108] CR2: 0000718d911e3000 CR3: 0000000136bff000 CR4: 0000000000f52ef0 <4> [249.612109] PKRU: 55555554 <4> [249.612110] Call Trace: <4> [249.612111] <TASK> <4> [249.612115] ? lock_acquire+0x60/0x300 <4> [249.612121] ? lock_release+0xd0/0x2b0 <4> [249.612126] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [249.612132] process_one_work+0x239/0x740 <4> [249.612139] worker_thread+0x200/0x3f0 <4> [249.612142] ? __pfx_worker_thread+0x10/0x10 <4> [249.612145] kthread+0x10d/0x150 <4> [249.612147] ? __pfx_kthread+0x10/0x10 <4> [249.612150] ret_from_fork+0x3bd/0x470 <4> [249.612153] ? __pfx_kthread+0x10/0x10 <4> [249.612156] ret_from_fork_asm+0x1a/0x30 <4> [249.612164] </TASK> <4> [249.612165] irq event stamp: 1422023 <4> [249.612166] hardirqs last enabled at (1422029): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [249.612168] hardirqs last disabled at (1422034): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [249.612170] softirqs last enabled at (1421180): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.612173] softirqs last disabled at (1421173): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.612176] ---[ end trace 0000000000000000 ]--- <6> [249.612177] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [249.612259] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [249.612266] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [249.613511] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [249.613636] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [249.613754] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [249.613979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [249.614081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [249.614181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [249.614274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [249.614363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [249.614454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [249.614544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [249.614642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [249.614731] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [249.614832] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [249.614925] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [249.615961] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [249.626975] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [249.627233] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [249.628203] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [249.628292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [249.628374] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [249.628454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [249.628533] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [249.628612] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [249.628704] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [249.628789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [249.628869] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [249.628947] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [249.629024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [249.629100] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [249.629177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [249.629253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [249.629330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [249.629406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [249.629482] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [249.629558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [249.629640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [249.629730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [249.629815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [249.629897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [249.629978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [249.630060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [249.630145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [249.630223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [249.630301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [249.630378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [249.630456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [249.630536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [249.630618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [249.630712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [249.630796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [249.630878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [249.630964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [249.631049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [249.631134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [249.631232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [249.631315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [249.631393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [249.631475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [249.631555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [249.631641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [249.631729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [249.631810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [249.631888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [249.631970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [249.632049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [249.632126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [249.632204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [249.632284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [249.632363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [249.632444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [249.632523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [249.632600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [249.632697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [249.632776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [249.632853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [249.632928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [249.633006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [249.633085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [249.633162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [249.633239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [249.633315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [249.633393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [249.633470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [249.633549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [249.633625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [249.633723] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [249.633849] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [249.633853] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38326, lrc_seqno=38326, guc_id=0, flags=0x73 in no process [-1] <7> [249.633856] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [249.633924] ------------[ cut here ]------------ <4> [249.633925] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [249.633927] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:7/708 <4> [249.634006] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [249.634070] <4> [249.634073] CPU: 1 UID: 0 PID: 708 Comm: kworker/u64:7 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [249.634076] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [249.634077] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [249.634079] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [249.634085] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [249.634160] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [249.634162] RSP: 0018:ffffc900016c3ca0 EFLAGS: 00010246 <4> [249.634165] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [249.634166] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [249.634168] RBP: ffffc900016c3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [249.634169] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [249.634170] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [249.634171] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [249.634173] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [249.634174] CR2: 0000718d911e3000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [249.634176] PKRU: 55555554 <4> [249.634177] Call Trace: <4> [249.634178] <TASK> <4> [249.634182] ? lock_acquire+0x60/0x300 <4> [249.634188] ? lock_release+0xd0/0x2b0 <4> [249.634192] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [249.634198] process_one_work+0x239/0x740 <4> [249.634205] worker_thread+0x200/0x3f0 <4> [249.634208] ? __pfx_worker_thread+0x10/0x10 <4> [249.634211] kthread+0x10d/0x150 <4> [249.634213] ? __pfx_kthread+0x10/0x10 <4> [249.634216] ret_from_fork+0x3bd/0x470 <4> [249.634218] ? __pfx_kthread+0x10/0x10 <4> [249.634221] ret_from_fork_asm+0x1a/0x30 <4> [249.634228] </TASK> <4> [249.634229] irq event stamp: 388949 <4> [249.634231] hardirqs last enabled at (388955): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [249.634233] hardirqs last disabled at (388960): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [249.634235] softirqs last enabled at (388098): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.634237] softirqs last disabled at (388091): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.634240] ---[ end trace 0000000000000000 ]--- <7> [249.635513] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [249.635627] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [249.636506] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1515) -> ( 0 - 1989), size 1515 -> 1989 <7> [249.636601] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb (1515 - 1989) -> ( 0 - 0), size 474 -> 0 <7> [249.636699] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [249.636778] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.636855] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.636931] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.637005] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [249.637078] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.637151] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.637223] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.637313] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 594000 num active planes 1 <7> [249.637420] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000 <7> [249.637525] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000 <7> [249.637628] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624 <7> [249.647701] xe 0000:03:00.0: [drm:i915_fifo_underrun_reset_write [xe]] Re-arming FIFO underruns on pipe C <7> [249.731908] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1989) -> ( 0 - 1515), size 1989 -> 1515 <7> [249.732418] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb ( 0 - 0) -> (1515 - 1989), size 0 -> 474 <7> [249.732918] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm <7> [249.733320] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [249.733785] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 <7> [249.734210] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 <7> [249.734578] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm <7> [249.735006] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [249.735369] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 <7> [249.735767] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 <7> [249.736186] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 1188000 num active planes 2 <7> [249.736449] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1989) -> ( 0 - 1515), size 1989 -> 1515 <7> [249.736523] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb ( 0 - 0) -> (1515 - 1989), size 0 -> 474 <7> [249.736593] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm <7> [249.736670] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [249.736740] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 <7> [249.736805] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 <7> [249.736868] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm <7> [249.736931] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [249.736994] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 <7> [249.737055] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 <7> [249.737120] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 1188000 num active planes 2 <7> [249.737213] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 1248 qgv_peak_bw: 48000 <7> [249.737305] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 1248 qgv_peak_bw: 48000 <7> [249.737395] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 1248 <5> [249.781827] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38327, lrc_seqno=38327, guc_id=0, flags=0x73 in no process [-1] <7> [249.781851] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [249.782243] ------------[ cut here ]------------ <4> [249.782249] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [249.782257] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:2/121 <4> [249.782745] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [249.783238] <4> [249.783252] CPU: 11 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [249.783270] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [249.783277] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [249.783287] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [249.783317] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [249.783777] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [249.783793] RSP: 0018:ffffc9000056fca0 EFLAGS: 00010246 <4> [249.783815] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [249.783830] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [249.783843] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [249.783854] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [249.783865] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [249.783878] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [249.783894] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [249.783907] CR2: 0000718d911e3000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [249.783920] PKRU: 55555554 <4> [249.783932] Call Trace: <4> [249.783944] <TASK> <4> [249.783980] ? lock_acquire+0x60/0x300 <4> [249.784027] ? lock_release+0xd0/0x2b0 <4> [249.784074] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [249.784126] process_one_work+0x239/0x740 <4> [249.784162] worker_thread+0x200/0x3f0 <4> [249.784179] ? __pfx_worker_thread+0x10/0x10 <4> [249.784194] kthread+0x10d/0x150 <4> [249.784207] ? __pfx_kthread+0x10/0x10 <4> [249.784222] ret_from_fork+0x3bd/0x470 <4> [249.784234] ? __pfx_kthread+0x10/0x10 <4> [249.784248] ret_from_fork_asm+0x1a/0x30 <4> [249.784287] </TASK> <4> [249.784293] irq event stamp: 780169 <4> [249.784299] hardirqs last enabled at (780175): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [249.784311] hardirqs last disabled at (780180): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [249.784319] softirqs last enabled at (779424): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.784334] softirqs last disabled at (779417): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.784348] ---[ end trace 0000000000000000 ]--- <6> [249.784358] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [249.784813] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [249.784888] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [249.784974] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [249.785692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [249.786202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [249.786798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [249.787273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [249.787433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [249.787522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [249.787612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [249.787727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [249.787812] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [249.787906] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [249.787993] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [249.789077] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [249.799903] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [249.800262] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [249.801504] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [249.801672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [249.801816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [249.801956] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [249.802091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [249.802227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [249.802360] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [249.802503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [249.802656] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [249.802799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [249.802944] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [249.803091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [249.803238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [249.803382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [249.803521] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [249.803669] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [249.803804] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [249.803938] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [249.804072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [249.804228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [249.804372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [249.804507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [249.804645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [249.804777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [249.804906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [249.805030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [249.805153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [249.805270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [249.805384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [249.805500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [249.805620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [249.805751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [249.805863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [249.805972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [249.806084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [249.806198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [249.806311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [249.806418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [249.806520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [249.806620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [249.806737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [249.806835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [249.806927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [249.807020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [249.807114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [249.807207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [249.807301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [249.807389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [249.807474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [249.807562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [249.807656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [249.807741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [249.807824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [249.807905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [249.807986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [249.808074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [249.808161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [249.808244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [249.808320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [249.808399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [249.808474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [249.808551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [249.808628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [249.808717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [249.808795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [249.808871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [249.808946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [249.809023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [249.809101] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [249.809239] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [249.809244] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38327, lrc_seqno=38327, guc_id=0, flags=0x73 in no process [-1] <7> [249.809247] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [249.809313] ------------[ cut here ]------------ <4> [249.809315] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [249.809317] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:2/121 <4> [249.809395] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [249.809460] <4> [249.809462] CPU: 11 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [249.809465] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [249.809467] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [249.809468] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [249.809474] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [249.809549] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [249.809550] RSP: 0018:ffffc9000056fca0 EFLAGS: 00010246 <4> [249.809553] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [249.809554] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [249.809556] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [249.809557] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [249.809558] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [249.809559] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [249.809561] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [249.809562] CR2: 0000718d911e3000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [249.809564] PKRU: 55555554 <4> [249.809565] Call Trace: <4> [249.809566] <TASK> <4> [249.809570] ? lock_acquire+0x60/0x300 <4> [249.809576] ? lock_release+0xd0/0x2b0 <4> [249.809580] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [249.809587] process_one_work+0x239/0x740 <4> [249.809593] worker_thread+0x200/0x3f0 <4> [249.809596] ? __pfx_worker_thread+0x10/0x10 <4> [249.809599] kthread+0x10d/0x150 <4> [249.809601] ? __pfx_kthread+0x10/0x10 <4> [249.809604] ret_from_fork+0x3bd/0x470 <4> [249.809606] ? __pfx_kthread+0x10/0x10 <4> [249.809609] ret_from_fork_asm+0x1a/0x30 <4> [249.809617] </TASK> <4> [249.809618] irq event stamp: 783367 <4> [249.809619] hardirqs last enabled at (783373): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [249.809621] hardirqs last disabled at (783378): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [249.809623] softirqs last enabled at (782398): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.809625] softirqs last disabled at (782391): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.809628] ---[ end trace 0000000000000000 ]--- <6> [249.809630] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [249.809718] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [249.809725] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [249.810130] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [249.810340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [249.810429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [249.810521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [249.810608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [249.810706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [249.810792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [249.810878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [249.810965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [249.811048] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [249.811149] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [249.811243] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [249.812276] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [249.823143] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [249.823473] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [249.824610] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [249.824750] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [249.824877] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [249.825006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [249.825133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [249.825261] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [249.825388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [249.825515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [249.825649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [249.825777] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [249.825905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [249.826032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [249.826170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [249.826281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [249.826377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [249.826466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [249.826552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [249.826641] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [249.826725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [249.826819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [249.826912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [249.827001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [249.827086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [249.827174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [249.827260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [249.827342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [249.827426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [249.827508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [249.827591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [249.827686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [249.827782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [249.827868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [249.827953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [249.828038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [249.828129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [249.828220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [249.828308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [249.828394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [249.828482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [249.828569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [249.828669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [249.828754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [249.828837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [249.828920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [249.829004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [249.829086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [249.829169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [249.829256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [249.829337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [249.829419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [249.829504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [249.829586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [249.829680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [249.829763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [249.829843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [249.829929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [249.830014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [249.830096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [249.830177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [249.830262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [249.830344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [249.830425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [249.830506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [249.830586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [249.830677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [249.830759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [249.830839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [249.830918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [249.831002] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [249.831132] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [249.831137] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38327, lrc_seqno=38327, guc_id=0, flags=0x73 in no process [-1] <7> [249.831139] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [249.831212] ------------[ cut here ]------------ <4> [249.831213] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [249.831214] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:2/121 <4> [249.831298] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [249.831362] <4> [249.831364] CPU: 6 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [249.831367] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [249.831368] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [249.831370] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [249.831376] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [249.831456] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [249.831460] RSP: 0000:ffffc9000056fca0 EFLAGS: 00010246 <4> [249.831462] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [249.831464] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [249.831465] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [249.831466] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [249.831467] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [249.831469] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [249.831470] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [249.831472] CR2: 00007fe398472000 CR3: 0000000136bff000 CR4: 0000000000f52ef0 <4> [249.831473] PKRU: 55555554 <4> [249.831474] Call Trace: <4> [249.831475] <TASK> <4> [249.831479] ? lock_acquire+0x60/0x300 <4> [249.831484] ? lock_release+0xd0/0x2b0 <4> [249.831489] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [249.831495] process_one_work+0x239/0x740 <4> [249.831502] worker_thread+0x200/0x3f0 <4> [249.831505] ? __pfx_worker_thread+0x10/0x10 <4> [249.831508] kthread+0x10d/0x150 <4> [249.831510] ? __pfx_kthread+0x10/0x10 <4> [249.831513] ret_from_fork+0x3bd/0x470 <4> [249.831515] ? __pfx_kthread+0x10/0x10 <4> [249.831518] ret_from_fork_asm+0x1a/0x30 <4> [249.831525] </TASK> <4> [249.831526] irq event stamp: 786537 <4> [249.831527] hardirqs last enabled at (786543): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [249.831530] hardirqs last disabled at (786548): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [249.831531] softirqs last enabled at (785660): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.831534] softirqs last disabled at (785655): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.831537] ---[ end trace 0000000000000000 ]--- <7> [249.832810] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [249.832923] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [249.838665] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38335, lrc_seqno=38335, guc_id=0, flags=0x73 in no process [-1] <7> [249.838669] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [249.838747] ------------[ cut here ]------------ <4> [249.838748] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [249.838750] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:8/983 <4> [249.838836] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [249.838900] <4> [249.838902] CPU: 11 UID: 0 PID: 983 Comm: kworker/u64:8 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [249.838905] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [249.838906] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [249.838907] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [249.838913] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [249.838992] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [249.838994] RSP: 0018:ffffc90003173ca0 EFLAGS: 00010246 <4> [249.838996] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [249.838997] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [249.838999] RBP: ffffc90003173db0 R08: 0000000000000000 R09: 0000000000000000 <4> [249.839000] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [249.839001] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [249.839002] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [249.839004] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [249.839005] CR2: 0000718d911e3000 CR3: 0000000136bff000 CR4: 0000000000f52ef0 <4> [249.839007] PKRU: 55555554 <4> [249.839008] Call Trace: <4> [249.839009] <TASK> <4> [249.839013] ? lock_acquire+0x60/0x300 <4> [249.839018] ? lock_release+0xd0/0x2b0 <4> [249.839022] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [249.839028] process_one_work+0x239/0x740 <4> [249.839035] worker_thread+0x200/0x3f0 <4> [249.839038] ? __pfx_worker_thread+0x10/0x10 <4> [249.839040] kthread+0x10d/0x150 <4> [249.839043] ? __pfx_kthread+0x10/0x10 <4> [249.839046] ret_from_fork+0x3bd/0x470 <4> [249.839048] ? __pfx_kthread+0x10/0x10 <4> [249.839051] ret_from_fork_asm+0x1a/0x30 <4> [249.839058] </TASK> <4> [249.839059] irq event stamp: 1423775 <4> [249.839060] hardirqs last enabled at (1423781): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [249.839063] hardirqs last disabled at (1423786): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [249.839064] softirqs last enabled at (1422804): [<ffffffff8133ad53>] kernel_fpu_end+0x53/0x70 <4> [249.839067] softirqs last disabled at (1422802): [<ffffffff8133b464>] kernel_fpu_begin_mask+0xc4/0x120 <4> [249.839069] ---[ end trace 0000000000000000 ]--- <6> [249.839071] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [249.839148] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [249.839154] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [249.839416] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [249.839647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [249.839748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [249.839848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [249.839940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [249.840030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [249.840118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [249.840210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [249.840304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [249.840392] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [249.840494] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [249.840589] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [249.841629] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [249.851642] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [249.851899] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [249.852995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [249.853080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [249.853160] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [249.853240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [249.853319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [249.853398] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [249.853475] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [249.853550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [249.853626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [249.853720] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [249.853797] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [249.853873] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [249.853950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [249.854030] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [249.854108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [249.854185] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [249.854260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [249.854336] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [249.854412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [249.854498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [249.854583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [249.854675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [249.854754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [249.854834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [249.854913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [249.854991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [249.855069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [249.855147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [249.855224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [249.855304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [249.855385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [249.855462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [249.855542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [249.855620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [249.855718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [249.855802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [249.855885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [249.855965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [249.856044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [249.856121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [249.856198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [249.856273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [249.856349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [249.856425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [249.856502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [249.856579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [249.856664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [249.856741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [249.856817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [249.856893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [249.856974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [249.857051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [249.857129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [249.857205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [249.857282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [249.857360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [249.857438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [249.857514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [249.857589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [249.857679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [249.857755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [249.857833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [249.857909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [249.857984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [249.858059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [249.858134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [249.858210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [249.858285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [249.858363] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [249.858486] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [249.858490] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38335, lrc_seqno=38335, guc_id=0, flags=0x73 in no process [-1] <7> [249.858493] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [249.858560] ------------[ cut here ]------------ <4> [249.858562] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [249.858563] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#7: kworker/u64:2/121 <4> [249.858649] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [249.858715] <4> [249.858717] CPU: 7 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [249.858720] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [249.858722] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [249.858723] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [249.858729] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [249.858805] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [249.858807] RSP: 0000:ffffc9000056fca0 EFLAGS: 00010246 <4> [249.858810] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [249.858811] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [249.858812] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [249.858814] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [249.858815] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [249.858816] FS: 0000000000000000(0000) GS:ffff8888db003000(0000) knlGS:0000000000000000 <4> [249.858818] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [249.858819] CR2: 0000718d911e3000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [249.858821] PKRU: 55555554 <4> [249.858822] Call Trace: <4> [249.858823] <TASK> <4> [249.858827] ? lock_acquire+0x60/0x300 <4> [249.858832] ? lock_release+0xd0/0x2b0 <4> [249.858837] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [249.858843] process_one_work+0x239/0x740 <4> [249.858850] worker_thread+0x200/0x3f0 <4> [249.858853] ? __pfx_worker_thread+0x10/0x10 <4> [249.858855] kthread+0x10d/0x150 <4> [249.858858] ? __pfx_kthread+0x10/0x10 <4> [249.858860] ret_from_fork+0x3bd/0x470 <4> [249.858863] ? __pfx_kthread+0x10/0x10 <4> [249.858865] ret_from_fork_asm+0x1a/0x30 <4> [249.858873] </TASK> <4> [249.858874] irq event stamp: 789781 <4> [249.858875] hardirqs last enabled at (789787): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [249.858877] hardirqs last disabled at (789792): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [249.858879] softirqs last enabled at (789038): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.858881] softirqs last disabled at (789025): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.858884] ---[ end trace 0000000000000000 ]--- <6> [249.858886] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [249.858964] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [249.858969] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [249.859376] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [249.859593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [249.859700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [249.859796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [249.859884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [249.859973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [249.860060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [249.860147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [249.860232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [249.860315] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [249.860415] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [249.860509] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [249.861542] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [249.872270] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [249.872526] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [249.873505] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [249.873590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [249.873680] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [249.873760] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [249.873838] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [249.873915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [249.873992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [249.874068] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [249.874141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [249.874217] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [249.874292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [249.874365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [249.874439] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [249.874514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [249.874587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [249.874670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [249.874744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [249.874818] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [249.874891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [249.874977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [249.875060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [249.875145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [249.875224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [249.875305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [249.875385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [249.875466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [249.875544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [249.875621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [249.875711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [249.875789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [249.875868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [249.875947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [249.876028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [249.876106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [249.876192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [249.876276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [249.876360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [249.876442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [249.876521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [249.876599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [249.876684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [249.876761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [249.876837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [249.876914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [249.876992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [249.877068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [249.877146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [249.877223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [249.877302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [249.877383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [249.877464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [249.877541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [249.877620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [249.877709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [249.877786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [249.877864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [249.877942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [249.878017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [249.878094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [249.878172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [249.878249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [249.878327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [249.878405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [249.878480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [249.878558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [249.878637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [249.878713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [249.878788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [249.878867] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [249.878986] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [249.878991] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38335, lrc_seqno=38335, guc_id=0, flags=0x73 in no process [-1] <7> [249.878993] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [249.879061] ------------[ cut here ]------------ <4> [249.879062] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [249.879063] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#7: kworker/u64:2/121 <4> [249.879141] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [249.879205] <4> [249.879207] CPU: 7 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [249.879210] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [249.879211] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [249.879212] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [249.879218] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [249.879293] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [249.879295] RSP: 0000:ffffc9000056fca0 EFLAGS: 00010246 <4> [249.879297] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [249.879299] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [249.879300] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [249.879301] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [249.879302] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [249.879304] FS: 0000000000000000(0000) GS:ffff8888db003000(0000) knlGS:0000000000000000 <4> [249.879305] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [249.879307] CR2: 0000718d911e3000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [249.879308] PKRU: 55555554 <4> [249.879309] Call Trace: <4> [249.879310] <TASK> <4> [249.879314] ? lock_acquire+0x60/0x300 <4> [249.879319] ? lock_release+0xd0/0x2b0 <4> [249.879324] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [249.879330] process_one_work+0x239/0x740 <4> [249.879337] worker_thread+0x200/0x3f0 <4> [249.879339] ? __pfx_worker_thread+0x10/0x10 <4> [249.879342] kthread+0x10d/0x150 <4> [249.879344] ? __pfx_kthread+0x10/0x10 <4> [249.879347] ret_from_fork+0x3bd/0x470 <4> [249.879349] ? __pfx_kthread+0x10/0x10 <4> [249.879352] ret_from_fork_asm+0x1a/0x30 <4> [249.879359] </TASK> <4> [249.879361] irq event stamp: 792943 <4> [249.879362] hardirqs last enabled at (792949): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [249.879364] hardirqs last disabled at (792954): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [249.879365] softirqs last enabled at (791808): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.879368] softirqs last disabled at (791799): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [249.879371] ---[ end trace 0000000000000000 ]--- <7> [249.880428] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [249.880545] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [249.881696] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1515) -> ( 0 - 1989), size 1515 -> 1989 <7> [249.881812] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb (1515 - 1989) -> ( 0 - 0), size 474 -> 0 <7> [249.881898] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [249.881979] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.882058] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.882151] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.882229] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [249.882304] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.882377] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.882449] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.882545] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 594000 num active planes 1 <7> [249.882753] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1515) -> ( 0 - 1989), size 1515 -> 1989 <7> [249.882828] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb (1515 - 1989) -> ( 0 - 0), size 474 -> 0 <7> [249.882915] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [249.882986] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.883057] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.883127] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.883197] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [249.883264] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.883332] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.883399] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [249.883473] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 594000 num active planes 1 <7> [249.883581] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000 <7> [249.883702] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000 <7> [249.883805] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624 <7> [249.897765] xe 0000:03:00.0: [drm:i915_fifo_underrun_reset_write [xe]] Re-arming FIFO underruns on pipe C <7> [249.981726] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1989) -> ( 0 - 1515), size 1989 -> 1515 <7> [249.982227] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb ( 0 - 0) -> (1515 - 1989), size 0 -> 474 <7> [249.982689] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm <7> [249.983086] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [249.983466] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 <7> [249.983888] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 <7> [249.984256] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm, stwm <7> [249.984618] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [249.985045] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 <7> [249.985407] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 <7> [249.985871] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 1188000 num active planes 2 <7> [249.986470] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:153:plane 1C] ddb ( 0 - 1989) -> ( 0 - 1515), size 1989 -> 1515 <7> [249.986542] xe 0000:03:00.0: [drm:skl_print_plane_ddb_changes [xe]] [PLANE:183:plane 2C] ddb ( 0 - 0) -> (1515 - 1989), size 0 -> 474 <7> [249.986608] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm <7> [249.986687] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 2, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [249.986751] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 28, 82, 82, 154, 154, 154, 154, 28, 136, 150 <7> [249.986816] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 32, 92, 92, 171, 171, 0, 0, 29, 151, 151 <7> [249.986881] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,*swm, stwm <7> [249.986942] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 5, 5, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [249.987003] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 14, 14, 28, 28, 52, 52, 52, 52, 28, 46, 0 <7> [249.987065] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 17, 17, 32, 32, 59, 59, 0, 0, 29, 52, 0 <7> [249.987129] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:269:pipe C] data rate 1188000 num active planes 2 <7> [249.987222] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 1248 qgv_peak_bw: 48000 <7> [249.987315] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 1248 qgv_peak_bw: 48000 <7> [249.987408] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 1248 <5> [250.031949] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38336, lrc_seqno=38336, guc_id=0, flags=0x73 in no process [-1] <7> [250.031977] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [250.032579] ------------[ cut here ]------------ <4> [250.032589] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [250.032599] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#7: kworker/u64:4/203 <4> [250.033255] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [250.033728] <4> [250.033744] CPU: 7 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [250.033761] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [250.033768] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [250.033776] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [250.033809] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [250.034232] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [250.034242] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [250.034254] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [250.034262] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [250.034269] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [250.034275] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [250.034281] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [250.034288] FS: 0000000000000000(0000) GS:ffff8888db003000(0000) knlGS:0000000000000000 <4> [250.034295] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [250.034302] CR2: 0000718d911e3000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [250.034310] PKRU: 55555554 <4> [250.034316] Call Trace: <4> [250.034322] <TASK> <4> [250.034342] ? lock_acquire+0x60/0x300 <4> [250.034370] ? lock_release+0xd0/0x2b0 <4> [250.034395] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [250.034425] process_one_work+0x239/0x740 <4> [250.034459] worker_thread+0x200/0x3f0 <4> [250.034476] ? __pfx_worker_thread+0x10/0x10 <4> [250.034490] kthread+0x10d/0x150 <4> [250.034501] ? __pfx_kthread+0x10/0x10 <4> [250.034516] ret_from_fork+0x3bd/0x470 <4> [250.034527] ? __pfx_kthread+0x10/0x10 <4> [250.034542] ret_from_fork_asm+0x1a/0x30 <4> [250.034580] </TASK> <4> [250.034586] irq event stamp: 317009 <4> [250.034592] hardirqs last enabled at (317015): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [250.034604] hardirqs last disabled at (317020): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [250.034613] softirqs last enabled at (316264): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [250.034628] softirqs last disabled at (316257): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [250.034668] ---[ end trace 0000000000000000 ]--- <6> [250.034685] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [250.035209] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [250.035255] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [250.035359] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [250.036198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [250.036759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [250.037260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [250.037777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [250.038213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [250.038688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [250.039114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [250.039605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [250.040133] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [250.040671] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [250.041157] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [250.042949] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [250.054001] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [250.054310] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [250.055390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [250.055487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [250.055580] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [250.055686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [250.055775] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [250.055864] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [250.055956] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [250.056047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [250.056136] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [250.056225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [250.056315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [250.056396] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [250.056477] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [250.056560] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [250.056647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [250.056728] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [250.056811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [250.056888] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [250.056962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [250.057050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [250.057135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [250.057218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [250.057301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [250.057384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [250.057465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [250.057546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [250.057624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [250.057717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [250.057795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [250.057874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [250.057953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [250.058053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [250.058135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [250.058215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [250.058299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [250.058383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [250.058466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [250.058567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [250.058738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [250.058834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [250.058914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [250.058993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [250.059070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [250.059148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [250.059229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [250.059307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [250.059384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [250.059463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [250.059544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [250.059624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [250.059722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [250.059800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [250.059878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [250.059955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [250.060031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [250.060106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [250.060183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [250.060258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [250.060341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [250.060418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [250.060494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [250.060571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [250.060652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [250.060729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [250.060806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [250.060885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [250.060963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [250.061040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [250.061120] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [250.061243] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [250.061248] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38336, lrc_seqno=38336, guc_id=0, flags=0x73 in no process [-1] <7> [250.061251] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [250.061318] ------------[ cut here ]------------ <4> [250.061319] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [250.061321] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:2/121 <4> [250.061399] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [250.061465] <4> [250.061467] CPU: 11 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [250.061470] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [250.061471] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [250.061473] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [250.061479] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [250.061560] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [250.061562] RSP: 0018:ffffc9000056fca0 EFLAGS: 00010246 <4> [250.061565] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [250.061566] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [250.061567] RBP: ffffc9000056fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [250.061569] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [250.061570] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [250.061571] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [250.061573] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [250.061574] CR2: 00007fe398473000 CR3: 000000000344a000 CR4: 0000000000f52ef0 <4> [250.061576] PKRU: 55555554 <4> [250.061577] Call Trace: <4> [250.061578] <TASK> <4> [250.061582] ? lock_acquire+0x60/0x300 <4> [250.061587] ? lock_release+0xd0/0x2b0 <4> [250.061592] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [250.061598] process_one_work+0x239/0x740 <4> [250.061605] worker_thread+0x200/0x3f0 <4> [250.061608] ? __pfx_worker_thread+0x10/0x10 <4> [250.061611] kthread+0x10d/0x150 <4> [250.061613] ? __pfx_kthread+0x10/0x10 <4> [250.061616] ret_from_fork+0x3bd/0x470 <4> [250.061618] ? __pfx_kthread+0x10/0x10 <4> [250.061621] ret_from_fork_asm+0x1a/0x30 <4> [250.061629] </TASK> <4> [250.061630] irq event stamp: 796167 <4> [250.061639] hardirqs last enabled at (796187): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [250.061642] hardirqs last disabled at (796192): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [250.061644] softirqs last enabled at (796182): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [250.061647] softirqs last disabled at (796171): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [250.061649] ---[ end trace 0000000000000000 ]--- <6> [250.062804] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [250.062888] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [250.062894] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [250.062910] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [250.063020] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [250.063130] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [250.063354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [250.063456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [250.063556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [250.063663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [250.063764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [250.063857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [250.063946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [250.064035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [250.064122] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [250.064224] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [250.064319] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [250.065361] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [250.075640] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [250.075913] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [250.076868] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [250.076955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [250.077036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [250.077116] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [250.077194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [250.077271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [250.077347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [250.077422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [250.077498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [250.077573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [250.077665] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [250.077750] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [250.077827] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [250.077902] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [250.077979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [250.078057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [250.078134] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [250.078210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [250.078284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [250.078370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [250.078453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [250.078534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [250.078614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [250.078712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [250.078804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [250.078883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [250.078961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [250.079039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [250.079117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [250.079197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [250.079278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [250.079356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [250.079434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [250.079511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [250.079595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [250.079693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [250.079787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [250.079869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [250.079949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [250.080027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [250.080104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [250.080181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [250.080262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [250.080340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [250.080419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [250.080497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [250.080579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [250.080666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [250.080755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [250.080834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [250.080914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [250.080991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [250.081073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [250.081150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [250.081225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [250.081302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [250.081378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [250.081455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [250.081532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [250.081610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [250.081703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [250.081795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [250.081872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [250.081948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [250.082024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [250.082101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [250.082178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [250.082254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [250.082334] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [250.082460] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [250.082464] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=38336, lrc_seqno=38336, guc_id=0, flags=0x73 in no process [-1] <7> [250.082467] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [250.082982] ------------[ cut here ]------------ <4> [250.082987] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [250.082990] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:4/203 <4> [250.083350] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [250.083479] <4> [250.083485] CPU: 6 UID: 0 PID: 203 Comm: kworker/u64:4 Tainted: G S U W L 7.1.0-rc3-lgci-xe-xe-5043-0ce1c813197dfbe15-debug+ #1 PREEMPT(lazy) <4> [250.083491] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [250.083493] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023 <4> [250.083496] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [250.083514] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [250.083723] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [250.083725] RSP: 0018:ffffc9000162fca0 EFLAGS: 00010246 <4> [250.083729] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [250.083731] RDX: ffff888103f8e590 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [250.083733] RBP: ffffc9000162fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [250.083734] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [250.083736] R13: ffff888103f8e590 R14: ffff888123eeb818 R15: 00000000ffffffc2 <4> [250.083738] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [250.083740] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [250.083742] CR2: 0000718d911e3000 CR3: 0000000136bff000 CR4: 0000000000f52ef0 <4> [250.083744] PKRU: 55555554 <4> [250.083745] Call Trace: <4> [250.083747] <TASK> <4> [250.083753] ? lock_acquire+0x60/0x300 <4> [250.083761] ? lock_release+0xd0/0x2b0 <4> [250.083768] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [250.083776] process_one_work+0x239/0x740 <4> [250.083786] worker_thread+0x200/0x3f0 <4> [250.083791] ? __pfx_worker_thread+0x10/0x10 <4> [250.083795] kthread+0x10d/0x150 <4> [250.083798] ? __pfx_kthread+0x10/0x10

<4> [246.750356] gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [246.751504] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [246.780101] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [246.780249] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [246.799965] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [246.800108] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [246.807448] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [246.807695] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [246.829346] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [246.829515] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [246.850878] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [246.851035] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [246.853620] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [246.853785] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [246.874078] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [246.874239] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [246.895920] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [246.896080] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [246.901107] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [246.901269] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [246.921993] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [246.922152] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [246.942930] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [246.943087] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [246.945600] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [246.945773] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [246.965644] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [246.965801] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [246.985555] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [246.985716] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [246.990593] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [246.990764] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [247.011377] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.011533] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [247.031559] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.031716] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<7> [247.035047] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:153:plane 1C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm

<4> [247.047581] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.047751] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [247.067614] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.067773] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [247.088142] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.088293] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [247.095197] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.095355] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [247.115626] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.115783] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [247.136122] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.136274] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<7> [247.232770] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm

<7> [247.234470] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm

<4> [247.282470] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.283391] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [247.311664] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.311851] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [247.332087] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.332246] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [247.339780] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.339945] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [247.360877] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.361038] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [247.383443] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.383600] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<7> [247.385630] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [247.385977] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [247.482742] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm

<7> [247.484456] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm

<4> [247.532564] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.533592] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [247.560995] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.561144] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [247.582436] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.582600] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [247.590977] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.591138] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [247.611536] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.611706] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [247.633189] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.633345] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<7> [247.636213] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [247.636536] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [247.732821] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm

<7> [247.734469] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm

<7> [247.736574] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm

<7> [247.736870] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm

<4> [247.782796] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.783726] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [247.808380] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.808535] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [247.828886] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.829041] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [247.836450] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.836603] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [247.856856] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.857009] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [247.878986] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [247.879147] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<7> [247.881649] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [247.881945] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [247.882588] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [247.882895] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [247.982805] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm

<7> [247.984460] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm

<7> [247.986605] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm

<7> [247.986899] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm

<4> [248.032698] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [248.033710] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [248.061188] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [248.061352] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [248.082519] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [248.082676] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [248.090608] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [248.090774] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [248.110869] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [248.111026] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [248.132926] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [248.133086] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<7> [248.135350] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [248.135682] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [248.232771] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm

<7> [248.234459] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm

<4> [248.282753] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [248.284243] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [248.315168] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [248.315317] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [248.337211] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [248.337365] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [248.344699] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [248.344942] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [248.367008] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [248.367161] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [248.388077] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [248.388230] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<7> [248.390451] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [248.390768] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [248.482764] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm

<7> [248.484469] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm

<4> [248.533035] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [248.534100] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [248.562012] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [248.562223] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [248.582832] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [248.582991] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [248.590407] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [248.590569] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [248.612109] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [248.612272] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [248.634007] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [248.634164] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<7> [248.636613] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [248.636922] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [248.732875] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm

<7> [248.734538] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm

<7> [248.736821] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm

<7> [248.737087] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm

<4> [248.782710] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [248.783585] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [248.810176] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [248.810335] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [248.832359] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [248.832521] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [248.840667] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [248.840905] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [248.860964] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [248.861123] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [248.883002] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [248.883158] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<7> [248.885629] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [248.885981] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [248.886681] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [248.886980] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [248.982775] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm

<7> [248.984456] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm

<7> [248.986548] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm

<7> [248.986847] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm

<4> [249.032980] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [249.033850] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [249.060967] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [249.061121] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [249.082747] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [249.082902] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [249.090449] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [249.090609] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [249.110730] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [249.110908] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [249.132939] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [249.133100] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<7> [249.135516] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [249.135823] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [249.232669] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm

<7> [249.234366] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm

<4> [249.282767] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [249.283711] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [249.310433] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [249.310591] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [249.331969] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [249.332125] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [249.339426] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [249.339584] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [249.360055] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [249.360408] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [249.380927] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [249.381085] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<7> [249.383519] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [249.383836] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [249.482760] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm

<7> [249.484475] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm

<4> [249.532936] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [249.533868] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [249.562089] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [249.562507] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [249.582963] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [249.583121] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [249.591363] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [249.591517] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [249.611932] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [249.612094] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [249.634006] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [249.634160] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<7> [249.636699] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [249.637005] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [249.732918] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm

<7> [249.734578] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm

<7> [249.736593] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm

<7> [249.736868] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm

<4> [249.782745] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [249.783777] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [249.809395] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [249.809549] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [249.831298] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [249.831456] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [249.838836] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [249.838992] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [249.858649] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [249.858805] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [249.879141] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [249.879293] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<7> [249.881898] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [249.882229] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [249.882915] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [249.883197] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<7> [249.982689] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm

<7> [249.984256] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm

<7> [249.986608] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:183:plane 2C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm

<7> [249.986881] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:263:cursor C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm, stwm

<4> [250.033255] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [250.034232] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [250.061399] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [250.061560] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [250.083350] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_hda_intel cmdlinepart snd_intel_dspcfg kvm hid_generic asus_nb_wmi snd_hda_codec spi_nor asus_wmi snd_hda_core sparse_keymap mtd wmi_bmof irqbypass snd_hwdep aesni_intel gf128mul r8169 snd_pcm usbhid video rapl mei_pxp mei_hdcp binfmt_misc intel_cstate hid i2c_i801 snd_timer realtek phy_package i2c_mux spi_intel_pci snd i2c_smbus spi_intel soundcore nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class idma64 intel_pmc_ssram_telemetry acpi_tad pinctrl_alderlake acpi_pad mei_me mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [250.083723] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

Results for igt@kms_plane_cursor@overlay@pipe-c-dp-2-size-256